2023-05-11T07:17:20.539 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-11T07:17:20.540 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_vshankar@teuthology --name vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901 --verbose -- /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901/orig.config.yaml 2023-05-11T07:17:20.591 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-11T07:17:20.660 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901 branch: wip-vshankar-testing-20230509.090020 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7270901' kernel: client: branch: testing flavor: default kdb: true sha1: 8e556bdd976f3f21d05767a0961743c8693c7799 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230509.090020 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230509.090020 sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230509.090020 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlGhGs0SjxiMin4K5Sa6hP4Hi4shFui+YtO9U04w6W6jO4zBCcJgF46I5/0JxvQeYA9x2C4tGrU6URVC1gXhNI= smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBLhZz8GTbAiU22rlzxooC3AZqgdTcWcYnox5Vetw2sI8LMvB8PUKFTuNvjqMnv/dSRZ70MCQ9faXn0IY1mbycGLXr4+zsNOhMwgDT6DG53AfoRs4cUvlZhYJiZR+xFSEE7K9RctenCxK/YNJ/Kg5/H4+kShene45bvu6LKK3c2jeeUBy48p6960yWRtWKR0koAeUo0ydjTNk4wW0IEZ3AWEX0nlWCxL24+ifY4M2aMsXWRiIi2vcg2O+9i+pWfIBHvKd8f6nRmdyUkiZ3eFdk9j/+eTjLf0iH1ozABKGZ18hMtxhLHrf/QZ1C02HaPwXQfQM9rvFkGaEa5q9sGyMU2QmktbEl2BqmKpAbYwpqDSU5odzWVMiYcGpwAs6QU5Ti/yd6q6quouxVW/N+rrHrisnZVws9bbNwj1voiURoFAFWQWSJWdfPDlzMt+QvCBDtxR49bAA2XQvNie2IpA62U5wAnbiJWXNovgSuaw6mF5T7qFNim7MB2W348N40SoE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-11_06:18:33 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-11T07:17:20.661 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa; will attempt to use it 2023-05-11T07:17:20.661 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa/tasks 2023-05-11T07:17:20.662 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-11T07:17:20.663 INFO:teuthology.task.internal:Checking packages... 2023-05-11T07:17:20.691 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e28f4bf0df5d53a504fe40e32a78dd63506e2421' 2023-05-11T07:17:20.691 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-11T07:17:20.691 INFO:teuthology.packaging:ref: None 2023-05-11T07:17:20.692 INFO:teuthology.packaging:tag: None 2023-05-11T07:17:20.692 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230509.090020 2023-05-11T07:17:20.692 INFO:teuthology.packaging:sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T07:17:20.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230509.090020 2023-05-11T07:17:20.833 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3879.ge28f4bf0 2023-05-11T07:17:20.833 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-11T07:17:20.849 INFO:teuthology.task.internal:no buildpackages task found 2023-05-11T07:17:20.849 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-11T07:17:20.865 INFO:teuthology.task.internal:Saving configuration 2023-05-11T07:17:20.880 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-11T07:17:20.961 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-11T07:17:20.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-11 07:12:13.298856', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlGhGs0SjxiMin4K5Sa6hP4Hi4shFui+YtO9U04w6W6jO4zBCcJgF46I5/0JxvQeYA9x2C4tGrU6URVC1gXhNI='} 2023-05-11T07:17:21.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-11 07:12:13.300896', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXhNVSwKxkk528YNIfaCyLvtsLhEwlrtiOQvAl9NTz6d2pwJjXpgaKlFgrgJ19hsR/MKHznxB2Vz3ZEWHNThrs='} 2023-05-11T07:17:21.014 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-11T07:17:21.025 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-11T07:17:21.025 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-11T07:17:21.026 INFO:teuthology.run_tasks:Running task console_log... 2023-05-11T07:17:21.126 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8753621ee0>, signals=[15]) 2023-05-11T07:17:21.128 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-11T07:17:21.134 INFO:teuthology.task.internal:Opening connections... 2023-05-11T07:17:21.134 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:17:21.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:17:21.203 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:17:21.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:17:21.272 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-11T07:17:21.279 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-05-11T07:17:21.302 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-05-11T07:17:21.302 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-05-11T07:17:21.362 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-05-11T07:17:21.363 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-05-11T07:17:21.363 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-05-11T07:17:21.363 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-05-11T07:17:21.363 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-05-11T07:17:21.363 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-11T07:17:21.364 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-11T07:17:21.365 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-05-11T07:17:21.395 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-05-11T07:17:21.417 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-05-11T07:17:21.417 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-05-11T07:17:21.477 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-11T07:17:21.478 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-05-11T07:17:21.479 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-11T07:17:21.479 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-05-11T07:17:21.479 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-11T07:17:21.479 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-11T07:17:21.479 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-11T07:17:21.479 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-05-11T07:17:21.502 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-11T07:17:21.514 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-11T07:17:21.552 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-11T07:17:21.552 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-05-11T07:17:21.555 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2023-05-11T07:17:21.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-11T07:17:21.583 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-11T07:17:21.583 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-05-11T07:17:21.615 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2023-05-11T07:17:21.647 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-11T07:17:21.710 INFO:teuthology.run_tasks:Running task kernel... 2023-05-11T07:17:21.730 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'} 2023-05-11T07:17:21.731 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-05-11T07:17:21.731 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-05-11T07:17:21.732 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-11T07:17:21.733 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-11T07:17:21.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:17:21.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-05-11T07:17:21.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:17:21.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-05-11T07:17:21.969 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:21.969 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8e556bdd976f3f21d05767a0961743c8693c7799"... 2023-05-11T07:17:21.970 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-05-11T07:17:21.981 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:21.981 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8e556bdd976f3f21d05767a0961743c8693c7799"... 2023-05-11T07:17:21.982 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2023-05-11T07:17:21.990 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-489.el8.x86_64 2023-05-11T07:17:21.990 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:21.991 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-11T07:17:21.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2023-05-11T07:17:22.002 INFO:teuthology.orchestra.run.smithi145.stdout:4.18.0-489.el8.x86_64 2023-05-11T07:17:22.002 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:22.003 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-11T07:17:22.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum upgrade -y linux-firmware 2023-05-11T07:17:25.583 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - AppStream 29 MB/s | 29 MB 00:00 2023-05-11T07:17:25.766 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - AppStream 25 MB/s | 29 MB 00:01 2023-05-11T07:17:31.982 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - BaseOS 30 MB/s | 34 MB 00:01 2023-05-11T07:17:36.924 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - BaseOS 5.8 MB/s | 34 MB 00:05 2023-05-11T07:17:37.632 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras 37 kB/s | 18 kB 00:00 2023-05-11T07:17:38.016 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.4 kB 00:00 2023-05-11T07:17:40.410 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-05-11T07:17:41.785 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2023-05-11T07:17:42.649 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-05-11T07:17:42.957 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras common packages 43 kB/s | 6.4 kB 00:00 2023-05-11T07:17:45.143 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 640 kB/s | 24 kB 00:00 2023-05-11T07:17:45.559 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-11T07:17:48.404 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2023-05-11T07:17:48.405 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2023-05-11T07:17:48.405 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2023-05-11T07:17:48.454 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 14 MB 00:02 2023-05-11T07:17:48.561 INFO:teuthology.task.kernel:Downloading kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on client.1... 2023-05-11T07:17:48.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:48.702 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ 2023-05-11T07:17:48.702 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-11T07:17:48.704 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi145.front.sepia.ceph.com to complete... 2023-05-11T07:17:51.801 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 577 kB/s | 24 kB 00:00 2023-05-11T07:17:55.094 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-05-11T07:17:55.095 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2023-05-11T07:17:55.095 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-05-11T07:17:55.222 INFO:teuthology.task.kernel:Downloading kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on client.0... 2023-05-11T07:17:55.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T07:17:55.356 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ 2023-05-11T07:17:55.357 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-11T07:17:55.360 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2023-05-11T07:18:05.897 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11 07:18:05 URL:https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm [378544876/378544876] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-11T07:18:05.897 INFO:teuthology.orchestra.run.smithi145.stderr:FINISHED --2023-05-11 07:18:05-- 2023-05-11T07:18:05.897 INFO:teuthology.orchestra.run.smithi145.stderr:Total wall clock time: 17s 2023-05-11T07:18:05.898 INFO:teuthology.orchestra.run.smithi145.stderr:Downloaded: 1 files, 361M in 17s (21.4 MB/s) 2023-05-11T07:18:05.899 INFO:teuthology.task.kernel:Installing kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on client.1... 2023-05-11T07:18:05.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-11T07:18:07.644 INFO:teuthology.orchestra.run.smithi145.stdout:Verifying... ######################################## 2023-05-11T07:18:07.720 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing... ######################################## 2023-05-11T07:18:07.859 INFO:teuthology.orchestra.run.smithi145.stdout:Updating / installing... 2023-05-11T07:18:20.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11 07:18:20 URL:https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm [378544876/378544876] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-11T07:18:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2023-05-11 07:18:20-- 2023-05-11T07:18:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 25s 2023-05-11T07:18:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 361M in 25s (14.5 MB/s) 2023-05-11T07:18:20.659 INFO:teuthology.task.kernel:Installing kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on client.0... 2023-05-11T07:18:20.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-11T07:18:22.404 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2023-05-11T07:18:22.482 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2023-05-11T07:18:22.610 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2023-05-11T07:18:45.720 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-6.3.0_g8e556bdd976f-1 ######################################## 2023-05-11T07:19:00.183 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.3.0_g8e556bdd976f-1 ######################################## 2023-05-11T07:19:12.074 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-11T07:19:12.075 DEBUG:teuthology.orchestra.run.smithi145:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-11T07:19:12.124 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T07:19:12.124 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/config-6.3.0-g8e556bdd976f 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/boot/vmlinuz-6.3.0-g8e556bdd976f 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto 2023-05-11T07:19:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-11T07:19:12.126 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-11T07:19:12.127 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu 2023-05-11T07:19:12.128 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm.ko 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ansi_cprng.ko 2023-05-11T07:19:12.129 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/anubis.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/arc4.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_memcpy.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_pq.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_tx.ko 2023-05-11T07:19:12.130 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_xor.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/raid6test.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authenc.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authencesn.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blake2b_generic.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_common.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_generic.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/camellia_generic.ko 2023-05-11T07:19:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast5_generic.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast6_generic.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast_common.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ccm.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cmac.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crc32_generic.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_engine.ko 2023-05-11T07:19:12.132 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_user.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cts.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/des_generic.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/dh_generic.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/echainiv.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/essiv.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/fcrypt.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/khazad.ko 2023-05-11T07:19:12.133 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4hc.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/md4.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/michael_mic.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcbc.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcrypt.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/rmd160.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/seed.ko 2023-05-11T07:19:12.134 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/serpent_generic.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tcrypt.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tea.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_common.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_generic.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/vmac.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/wp512.ko 2023-05-11T07:19:12.135 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xcbc.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xor.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xxhash_generic.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_pad.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/custom_method.ko 2023-05-11T07:19:12.136 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/ec_sys.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/platform_profile.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbs.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbshc.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/video.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/acard-ahci.ko 2023-05-11T07:19:12.137 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ahci_platform.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ata_generic.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/libahci_platform.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_acpi.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ali.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_amd.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_artop.ko 2023-05-11T07:19:12.138 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atiixp.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atp867x.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd640.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd64x.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cypress.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_efar.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt366.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt37x.ko 2023-05-11T07:19:12.139 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it8213.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it821x.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_jmicron.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_marvell.ko 2023-05-11T07:19:12.140 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_mpiix.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_netcell.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ninja32.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87410.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87415.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_oldpiix.ko 2023-05-11T07:19:12.141 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_opti.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_optidma.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pcmcia.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_piccolo.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_rdc.ko 2023-05-11T07:19:12.142 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sch.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_serverworks.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sil680.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sis.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sl82c105.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_triflex.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_via.ko 2023-05-11T07:19:12.143 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pdc_adma.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_inic162x.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_mv.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_nv.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_promise.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_qstor.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil.ko 2023-05-11T07:19:12.144 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil24.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sis.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_svw.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sx4.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_uli.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_via.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_vsc.ko 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay 2023-05-11T07:19:12.145 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay/ks0108.ko 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma/bcma.ko 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe 2023-05-11T07:19:12.146 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe/aoe.ko 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/brd.ko 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd/drbd.ko 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/floppy.ko 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/loop.ko 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx 2023-05-11T07:19:12.147 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/nbd.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk/null_blk.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/pktcdvd.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/rbd.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/virtio_blk.ko 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback 2023-05-11T07:19:12.148 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkfront.ko 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram/zram.ko 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hangcheck-timer.ko 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random 2023-05-11T07:19:12.149 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/via-rng.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-11T07:19:12.150 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/lp.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave/mwave.ko 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia 2023-05-11T07:19:12.151 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ppdev.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tlclk.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-11T07:19:12.152 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/uv_mmtimer.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/virtio_console.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-11T07:19:12.153 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-11T07:19:12.154 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp.ko 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-aes.ko 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-sha.ko 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-11T07:19:12.155 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca/dca.ko 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma 2023-05-11T07:19:12.156 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/amd64_edac.ko 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/e752x_edac.ko 2023-05-11T07:19:12.157 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/edac_mce_amd.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3000_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3200_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5100_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5400_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7300_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7core_edac.ko 2023-05-11T07:19:12.158 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i82975x_edac.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/ie31200_edac.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/sb_edac.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/x38_edac.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/edd.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio 2023-05-11T07:19:12.159 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-ich.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-appleir.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-aureal.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-axff.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-dr.ko 2023-05-11T07:19:12.160 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elecom.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elo.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-emsff.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gaff.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gt683r.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gyration.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-11T07:19:12.161 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtekff.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-hyperv.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-icade.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-keytouch.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-kye.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lcpower.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-led.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lenovo.ko 2023-05-11T07:19:12.162 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-multitouch.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-ortek.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-penmount.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-petalynx.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-picolcd.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-pl.ko 2023-05-11T07:19:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-plantronics.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-primax.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-rmi.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-common.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-11T07:19:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat.ko 2023-05-11T07:19:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-saitek.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-samsung.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sjoy.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sony.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-speedlink.ko 2023-05-11T07:19:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-steelseries.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sunplus.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tivo.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tmff.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-topseed.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-twinhan.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-uclogic.ko 2023-05-11T07:19:12.167 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-waltop.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-wiimote.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-xinmo.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zpff.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zydacron.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/uhid.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/wacom.ko 2023-05-11T07:19:12.168 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_balloon.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_utils.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_vmbus.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru3.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-11T07:19:12.169 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7414.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7418.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adc128d818.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1025.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1026.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1029.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1031.ko 2023-05-11T07:19:12.170 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm9240.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ads7828.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7410.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7411.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7462.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7470.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7475.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7x10.ko 2023-05-11T07:19:12.171 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/amc6821.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/applesmc.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asb100.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asc7621.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/atxp1.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/coretemp.ko 2023-05-11T07:19:12.172 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dme1737.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds1621.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds620.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc1403.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc6w201.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71805f.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71882fg.ko 2023-05-11T07:19:12.173 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f75375s.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fam15h_power.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fschmd.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g760a.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g762.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl518sm.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl520sm.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-11T07:19:12.174 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5500_temp.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5k_amb.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmaem.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmpex.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina209.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina2xx.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/it87.ko 2023-05-11T07:19:12.175 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k10temp.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k8temp.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lineage-pem.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm63.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm73.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm75.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm77.ko 2023-05-11T07:19:12.176 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm78.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm80.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm83.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm85.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm87.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm90.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm92.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm93.ko 2023-05-11T07:19:12.177 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95234.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95241.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95245.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc2945.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4151.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4215.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4222.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4245.ko 2023-05-11T07:19:12.178 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4260.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4261.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max16065.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1619.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1668.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max197.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6639.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6650.ko 2023-05-11T07:19:12.179 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6697.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/mcp3021.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6683.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775-core.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct7802.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87360.ko 2023-05-11T07:19:12.180 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87427.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pcf8591.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-11T07:19:12.181 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/powr1220.ko 2023-05-11T07:19:12.182 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5627.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5636.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht15.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht21.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/shtc1.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sis5595.ko 2023-05-11T07:19:12.183 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47b397.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m1.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m192.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/thmc50.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp102.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp103.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp401.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp421.ko 2023-05-11T07:19:12.184 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via-cputemp.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via686a.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt1211.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt8231.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627ehf.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627hf.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83781d.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83791d.ko 2023-05-11T07:19:12.185 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83792d.ko 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83793.ko 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83795.ko 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l785ts.ko 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l786ng.ko 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos 2023-05-11T07:19:12.186 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-11T07:19:12.187 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-11T07:19:12.188 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-11T07:19:12.189 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-dev.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-mux.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-smbus.ko 2023-05-11T07:19:12.190 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-stub.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_core.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-11T07:19:12.191 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-11T07:19:12.192 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser 2023-05-11T07:19:12.193 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input 2023-05-11T07:19:12.194 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/gameport.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/lightning.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/ns558.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/joydev.ko 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard 2023-05-11T07:19:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/appletouch.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/bcm5974.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/cyapatp.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/sermouse.ko 2023-05-11T07:19:12.196 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/altera_ps2.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/arc_ps2.ko 2023-05-11T07:19:12.197 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/serio_raw.ko 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/sparse-keymap.ko 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-blinkm.ko 2023-05-11T07:19:12.198 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lm3530.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lp3944.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-ss4200.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-11T07:19:12.199 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache 2023-05-11T07:19:12.200 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache/bcache.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-bio-prison.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache-smq.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-crypt.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-delay.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-flakey.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-log-userspace.ko 2023-05-11T07:19:12.201 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-multipath.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-queue-length.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-raid.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-round-robin.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-service-time.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-switch.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-thin-pool.ko 2023-05-11T07:19:12.202 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-verity.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/faulty.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/linear.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/multipath.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid0.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid1.ko 2023-05-11T07:19:12.203 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid10.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid456.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptbase.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptctl.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptfc.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptlan.ko 2023-05-11T07:19:12.204 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptsas.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptscsih.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptspi.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_ich.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_sch.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/mfd-core.ko 2023-05-11T07:19:12.205 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/sm501.ko 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/viperboard.ko 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/vx855.ko 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/wl1273-core.ko 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-11T07:19:12.206 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds9802als.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds990x.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/bh1770glc.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710/cb710.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/at24.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-11T07:19:12.207 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/max6875.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/enclosure.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/hpilo.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29003.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29020.ko 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d 2023-05-11T07:19:12.208 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-me.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-txe.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-11T07:19:12.209 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_7xx1.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_core.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tsl2550.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_balloon.ko 2023-05-11T07:19:12.210 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding/bonding.ko 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-11T07:19:12.211 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dummy.ko 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/eql.ko 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet 2023-05-11T07:19:12.212 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-11T07:19:12.213 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-11T07:19:12.214 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros 2023-05-11T07:19:12.215 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-11T07:19:12.216 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet 2023-05-11T07:19:12.217 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-11T07:19:12.218 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-11T07:19:12.219 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-11T07:19:12.220 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-11T07:19:12.221 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dnet.ko 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ethoc.ko 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/fealnx.ko 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel 2023-05-11T07:19:12.222 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e 2023-05-11T07:19:12.223 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-11T07:19:12.224 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/jme.ko 2023-05-11T07:19:12.225 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-11T07:19:12.226 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-11T07:19:12.227 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia 2023-05-11T07:19:12.228 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-11T07:19:12.229 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-11T07:19:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-11T07:19:12.231 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-11T07:19:12.232 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-11T07:19:12.233 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti 2023-05-11T07:19:12.234 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom 2023-05-11T07:19:12.235 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/geneve.ko 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-11T07:19:12.236 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ifb.ko 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvlan.ko 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvtap.ko 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio.ko 2023-05-11T07:19:12.237 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mii.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/net_failover.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/netconsole.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/nlmon.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-11T07:19:12.238 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/amd.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm87xx.ko 2023-05-11T07:19:12.239 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/broadcom.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/cicada.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/davicom.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/dp83640.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/et1011c.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/icplus.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/lxt.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/marvell.ko 2023-05-11T07:19:12.240 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/micrel.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/national.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/phylink.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/qsemi.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/realtek.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/smsc.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/ste10Xp.ko 2023-05-11T07:19:12.241 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/vitesse.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_async.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-11T07:19:12.242 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppoe.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppox.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pptp.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slhc.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slip.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/sungem_phy.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tap.ko 2023-05-11T07:19:12.243 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_random.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tun.ko 2023-05-11T07:19:12.244 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/veth.ko 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/virtio_net.ko 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan/vxlan.ko 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback 2023-05-11T07:19:12.245 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netfront.ko 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb/ntb.ko 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme-core.ko 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme.ko 2023-05-11T07:19:12.246 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport.ko 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_cs.ko 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_pc.ko 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_serial.ko 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug 2023-05-11T07:19:12.247 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/xen-pcifront.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/i82092.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/pd6729.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-11T07:19:12.248 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acerhdf.ko 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-11T07:19:12.249 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-11T07:19:12.250 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/hdaps.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel_ips.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-11T07:19:12.251 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi.ko 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap 2023-05-11T07:19:12.252 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps_parport.ko 2023-05-11T07:19:12.253 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/pps_core.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp_kvm.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-11T07:19:12.254 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-11T07:19:12.255 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-em3027.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-max6900.ko 2023-05-11T07:19:12.256 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-11T07:19:12.257 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-x1205.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-9xxx.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-sas.ko 2023-05-11T07:19:12.258 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-xxxx.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/BusLogic.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/a100u2w.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/advansys.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-11T07:19:12.259 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/am53c974.ko 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/atp870u.ko 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa 2023-05-11T07:19:12.260 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa/bfa.ko 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ch.ko 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor 2023-05-11T07:19:12.261 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dc395x.ko 2023-05-11T07:19:12.262 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dmx3191d.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-11T07:19:12.263 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esp_scsi.ko 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic/fnic.ko 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hpsa.ko 2023-05-11T07:19:12.264 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hptiop.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hv_storvsc.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/initio.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ipr.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ips.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci/isci.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-11T07:19:12.265 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc/libfc.ko 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi.ko 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas/libsas.ko 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc 2023-05-11T07:19:12.266 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-11T07:19:12.267 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvumi.ko 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pmcraid.ko 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla1280.ko 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx 2023-05-11T07:19:12.268 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/raid_class.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_debug.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-11T07:19:12.269 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ses.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/st.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/stex.ko 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2 2023-05-11T07:19:12.270 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/virtio_scsi.ko 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/wd719x.ko 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb/ssb.ko 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi 2023-05-11T07:19:12.271 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_file.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_iblock.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_mod.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_pscsi.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_user.ko 2023-05-11T07:19:12.272 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-11T07:19:12.273 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-11T07:19:12.274 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-11T07:19:12.275 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_gsm.ko 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_hdlc.ko 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/nozomi.ko 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/arc_uart.ko 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm 2023-05-11T07:19:12.276 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/synclink_gt.ko 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio 2023-05-11T07:19:12.277 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio.ko 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_aec.ko 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_cif.ko 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_pci_generic.ko 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_sercos3.ko 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class 2023-05-11T07:19:12.278 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-acm.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usblp.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usbtmc.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/u132-hcd.ko 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image 2023-05-11T07:19:12.279 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/mdc800.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/microtek.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/adutux.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/appledisplay.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi26.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi62.ko 2023-05-11T07:19:12.280 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ezusb.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/idmouse.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/iowarrior.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ldusb.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/legousbtower.ko 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga 2023-05-11T07:19:12.281 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usb3503.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usblcd.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/uss720.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/yurex.ko 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy 2023-05-11T07:19:12.282 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy/phy-generic.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/aircable.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ark3116.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ch341.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cp210x.ko 2023-05-11T07:19:12.283 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cyberjack.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/empeg.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_ti.ko 2023-05-11T07:19:12.284 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipaq.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipw.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ir-usb.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-11T07:19:12.285 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mct_u232.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7720.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7840.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/navman.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/omninet.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/opticon.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/option.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/oti6858.ko 2023-05-11T07:19:12.286 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/pl2303.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcaux.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcserial.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/quatech2.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/safe_serial.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/sierra.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ssu100.ko 2023-05-11T07:19:12.287 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/symbolserial.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_debug.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/visor.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/whiteheat.ko 2023-05-11T07:19:12.288 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/uas.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-11T07:19:12.289 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-karma.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-11T07:19:12.290 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/usb-storage.ko 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-11T07:19:12.291 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_net.ko 2023-05-11T07:19:12.292 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_scsi.ko 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/apple_bl.ko 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/lcd.ko 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio.ko 2023-05-11T07:19:12.293 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_balloon.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_mmio.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_ring.ko 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters 2023-05-11T07:19:12.294 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2482.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2490.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-11T07:19:12.295 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/wire.ko 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog 2023-05-11T07:19:12.296 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/hpwdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/i6300esb.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ib700wdt.ko 2023-05-11T07:19:12.297 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ibmasr.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it87_wdt.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/machzwd.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/nv_tco.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-11T07:19:12.298 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/softdog.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/via_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-11T07:19:12.299 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/wdt_pci.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/xen_wdt.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-evtchn.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntalloc.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntdev.ko 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback 2023-05-11T07:19:12.300 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-privcmd.ko 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p/9p.ko 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs 2023-05-11T07:19:12.301 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs/affs.ko 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs/befs.ko 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/binfmt_misc.ko 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs/btrfs.ko 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles/cachefiles.ko 2023-05-11T07:19:12.302 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph/ceph.ko 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs/cifs.ko 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda/coda.ko 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs 2023-05-11T07:19:12.303 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs/cramfs.ko 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm/dlm.ko 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs/f2fs.ko 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat 2023-05-11T07:19:12.304 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/fat.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/msdos.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/vfat.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache/fscache.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/cuse.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/fuse.ko 2023-05-11T07:19:12.305 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2/gfs2.ko 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs/hfs.ko 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus/hfsplus.ko 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs/isofs.ko 2023-05-11T07:19:12.306 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs/jfs.ko 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd/lockd.ko 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix/minix.ko 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs/netfs.ko 2023-05-11T07:19:12.307 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfs.ko 2023-05-11T07:19:12.308 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv3.ko 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv4.ko 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/grace.ko 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/nfs_acl.ko 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd/nfsd.ko 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2 2023-05-11T07:19:12.309 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2/nilfs2.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-celtic.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-centeuro.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-croatian.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-cyrillic.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-gaelic.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-greek.ko 2023-05-11T07:19:12.310 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-iceland.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-inuit.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-roman.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-romanian.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-turkish.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1250.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1251.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1255.ko 2023-05-11T07:19:12.311 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp737.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp775.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp850.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp852.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp855.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp857.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp860.ko 2023-05-11T07:19:12.312 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp861.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp862.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp863.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp864.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp865.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp866.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp869.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp874.ko 2023-05-11T07:19:12.313 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp932.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp936.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp949.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp950.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_euc-jp.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-1.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-13.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-14.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-15.ko 2023-05-11T07:19:12.314 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-2.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-3.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-4.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-5.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-6.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-7.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-9.ko 2023-05-11T07:19:12.315 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-r.ko 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-ru.ko 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-u.ko 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_utf8.ko 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm 2023-05-11T07:19:12.316 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs 2023-05-11T07:19:12.317 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs/overlay.ko 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore/ramoops.ko 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs/reiserfs.ko 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs/romfs.ko 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common 2023-05-11T07:19:12.318 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs/squashfs.ko 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv/sysv.ko 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf/udf.ko 2023-05-11T07:19:12.319 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs/ufs.ko 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs/xfs.ko 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu/rcutorture.ko 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/torture.ko 2023-05-11T07:19:12.320 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/asn1_encoder.ko 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc-itu-t.ko 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc8.ko 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libarc4.ko 2023-05-11T07:19:12.321 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libdes.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/libcrc32c.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lru_cache.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4_compress.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4hc_compress.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math/cordic.ko 2023-05-11T07:19:12.322 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6/raid6_pq.ko 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_bm.ko 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_fsm.ko 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_kmp.ko 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd 2023-05-11T07:19:12.323 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd/zstd_compress.ko 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm/hwpoison-inject.ko 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/6lowpan.ko 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_dest.ko 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_fragment.ko 2023-05-11T07:19:12.324 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_hop.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_mobility.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_routing.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_udp.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/garp.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/mrp.ko 2023-05-11T07:19:12.325 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/p8022.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/psnap.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/stp.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q/8021q.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_fd.ko 2023-05-11T07:19:12.326 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_rdma.ko 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_virtio.ko 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv/batman-adv.ko 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/br_netfilter.ko 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/bridge.ko 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter 2023-05-11T07:19:12.327 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-11T07:19:12.328 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-11T07:19:12.329 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtables.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-11T07:19:12.330 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph/libceph.ko 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/failover.ko 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/pktgen.ko 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp.ko 2023-05-11T07:19:12.331 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_diag.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv4.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv6.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver/dns_resolver.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/dsa_core.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_brcm.ko 2023-05-11T07:19:12.332 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_dsa.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_none.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_trailer.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-11T07:19:12.333 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ah4.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/esp4.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/fou.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/gre.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/inet_diag.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_gre.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_tunnel.ko 2023-05-11T07:19:12.334 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_vti.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipcomp.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipip.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-11T07:19:12.335 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-11T07:19:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-11T07:19:12.337 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_bic.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_dctcp.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_diag.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_highspeed.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_htcp.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_hybla.ko 2023-05-11T07:19:12.338 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_illinois.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_lp.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_scalable.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_vegas.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_veno.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_westwood.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_yeah.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tunnel4.ko 2023-05-11T07:19:12.339 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_diag.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_tunnel.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ah6.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/esp6.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/fou6.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_tunnel.ko 2023-05-11T07:19:12.340 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_vti.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ipcomp6.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-11T07:19:12.341 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-11T07:19:12.342 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-11T07:19:12.343 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/sit.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/tunnel6.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key 2023-05-11T07:19:12.344 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key/af_key.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_core.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_eth.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip6.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_netlink.ko 2023-05-11T07:19:12.345 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ppp.ko 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc/llc.ko 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154/mac802154.ko 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls/mpls_gso.ko 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter 2023-05-11T07:19:12.346 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-11T07:19:12.347 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-11T07:19:12.348 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-11T07:19:12.349 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-11T07:19:12.350 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conncount.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-11T07:19:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-11T07:19:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_log_syslog.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-11T07:19:12.353 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_irc.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_sip.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_tables.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_log.ko 2023-05-11T07:19:12.354 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_chain_nat.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_compat.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_ct.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fib.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-11T07:19:12.355 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_hash.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_limit.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_log.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_masq.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_nat.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_numgen.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_queue.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_quota.ko 2023-05-11T07:19:12.356 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_redir.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject_inet.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_socket.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_tunnel.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_AUDIT.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-11T07:19:12.357 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CT.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_DSCP.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HL.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HMARK.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LED.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LOG.ko 2023-05-11T07:19:12.358 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NETMAP.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFLOG.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_RATEEST.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_SECMARK.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-11T07:19:12.359 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TEE.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TPROXY.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TRACE.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_addrtype.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_bpf.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cgroup.ko 2023-05-11T07:19:12.360 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cluster.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_comment.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connbytes.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlabel.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlimit.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connmark.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_conntrack.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cpu.ko 2023-05-11T07:19:12.361 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dccp.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_devgroup.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dscp.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ecn.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_esp.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hashlimit.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_helper.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hl.ko 2023-05-11T07:19:12.362 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipcomp.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_iprange.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipvs.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_l2tp.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_length.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_limit.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mac.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mark.ko 2023-05-11T07:19:12.363 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_multiport.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nat.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nfacct.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_osf.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_owner.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_physdev.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_pkttype.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_policy.ko 2023-05-11T07:19:12.364 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_quota.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_rateest.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_realm.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_recent.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_sctp.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_set.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_socket.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_state.ko 2023-05-11T07:19:12.365 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_statistic.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_string.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_tcpmss.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_time.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_u32.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink/netlink_diag.ko 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh 2023-05-11T07:19:12.366 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh/nsh.ko 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/openvswitch.ko 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-geneve.ko 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-gre.ko 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-vxlan.ko 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet 2023-05-11T07:19:12.367 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet/af_packet_diag.ko 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds.ko 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_rdma.ko 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_tcp.ko 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched 2023-05-11T07:19:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_csum.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_gact.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_ipt.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_mirred.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_nat.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_pedit.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_police.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_simple.ko 2023-05-11T07:19:12.369 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_skbedit.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_vlan.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_basic.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_bpf.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_flow.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_fw.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_route.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_u32.ko 2023-05-11T07:19:12.370 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_cmp.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_ipset.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_meta.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_nbyte.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_text.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_u32.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_choke.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_codel.ko 2023-05-11T07:19:12.371 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_drr.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_fq.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_gred.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hfsc.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hhf.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_htb.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_ingress.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio.ko 2023-05-11T07:19:12.372 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio_lib.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_multiq.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_netem.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_pie.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_plug.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_prio.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_qfq.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_red.ko 2023-05-11T07:19:12.373 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfb.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfq.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_tbf.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_teql.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp_diag.ko 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc 2023-05-11T07:19:12.374 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/sunrpc.ko 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc 2023-05-11T07:19:12.375 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/diag.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/tipc.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix/unix_diag.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock.ko 2023-05-11T07:19:12.376 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-11T07:19:12.377 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys/trusted.ko 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib/irqbypass.ko 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias.bin 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin 2023-05-11T07:19:12.378 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.bin 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.modinfo 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep.bin 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.devname 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.order 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.softdep 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols 2023-05-11T07:19:12.379 INFO:teuthology.orchestra.run.smithi145.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols.bin 2023-05-11T07:19:12.380 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g8e556bdd976f 2023-05-11T07:19:12.381 DEBUG:teuthology.orchestra.run.smithi145:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-11T07:19:12.409 INFO:teuthology.orchestra.run.smithi145.stdout:postinstall scriptlet (using /bin/sh): 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g8e556bdd976f -a -r /boot/System.map-6.3.0-g8e556bdd976f ]; then 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:cp /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:cp /boot/System.map-6.3.0-g8e556bdd976f /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:rm -f /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:/sbin/installkernel 6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:rm -f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:12.410 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:new-kernel-pkg --remove 6.3.0-g8e556bdd976f --rminitrd --initrdfile=/boot/initramfs-6.3.0-g8e556bdd976f.img 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-install remove 6.3.0-g8e556bdd976f 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-11T07:19:12.411 INFO:teuthology.orchestra.run.smithi145.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-11T07:19:12.412 INFO:teuthology.orchestra.run.smithi145.stdout:/sbin/update-bootloader --remove 6.3.0-g8e556bdd976f 2023-05-11T07:19:12.412 INFO:teuthology.orchestra.run.smithi145.stdout:fi 2023-05-11T07:19:12.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2023-05-11T07:19:12.492 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2023-05-11T07:19:12.492 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2023-05-11T07:19:12.492 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.02 2023-05-11T07:19:12.492 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 129.el8 2023-05-11T07:19:12.492 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Group : System Environment/Base 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 9265586 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-11T07:19:12.493 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:Relocations : (not relocatable) 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : CentOS BuildSystem 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2023-05-11T07:19:12.494 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:19:12.495 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2023-05-11T07:19:12.496 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-11T07:19:12.496 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 6.3.0-g8e556bdd976f 2023-05-11T07:19:12.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-11T07:19:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2023-05-11T07:19:17.033 INFO:teuthology.orchestra.run.smithi145.stderr:done 2023-05-11T07:19:17.034 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2023-05-11T07:19:17.075 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.X4fkyjy9oa 2023-05-11T07:19:17.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.X4fkyjy9oa 2023-05-11T07:19:17.149 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.X4fkyjy9oa 2023-05-11T07:19:17.296 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.X4fkyjy9oa is 6KB 2023-05-11T07:19:17.318 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.X4fkyjy9oa 2023-05-11T07:19:17.335 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2023-05-11T07:19:17.409 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-11T07:19:17.410 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-11T07:19:17.410 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-11T07:19:17.410 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f.conf 2023-05-11T07:19:17.411 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f 2023-05-11T07:19:17.574 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2023-05-11T07:19:22.813 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-11T07:19:22.814 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-11T07:19:22.861 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.3.0-g8e556bdd976f 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.3.0-g8e556bdd976f 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86 2023-05-11T07:19:22.862 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-11T07:19:22.863 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-11T07:19:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel 2023-05-11T07:19:22.865 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm.ko 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto 2023-05-11T07:19:22.866 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ansi_cprng.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/anubis.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/arc4.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_memcpy.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_pq.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_tx.ko 2023-05-11T07:19:22.867 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_xor.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/raid6test.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authenc.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authencesn.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blake2b_generic.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_common.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_generic.ko 2023-05-11T07:19:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/camellia_generic.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast5_generic.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast6_generic.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast_common.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ccm.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cmac.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crc32_generic.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_engine.ko 2023-05-11T07:19:22.869 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_user.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cts.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/des_generic.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/dh_generic.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/echainiv.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/essiv.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/fcrypt.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/khazad.ko 2023-05-11T07:19:22.870 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4hc.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/md4.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/michael_mic.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcbc.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcrypt.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/rmd160.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/seed.ko 2023-05-11T07:19:22.871 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/serpent_generic.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tcrypt.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tea.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_common.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_generic.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/vmac.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/wp512.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xcbc.ko 2023-05-11T07:19:22.872 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xor.ko 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xxhash_generic.ko 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_pad.ko 2023-05-11T07:19:22.873 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/custom_method.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/ec_sys.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/platform_profile.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbs.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbshc.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/video.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/acard-ahci.ko 2023-05-11T07:19:22.874 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ahci_platform.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ata_generic.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/libahci_platform.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_acpi.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ali.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_amd.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_artop.ko 2023-05-11T07:19:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atiixp.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atp867x.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd640.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd64x.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cypress.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_efar.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt366.ko 2023-05-11T07:19:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt37x.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it8213.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it821x.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_jmicron.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_marvell.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_mpiix.ko 2023-05-11T07:19:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_netcell.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ninja32.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87410.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87415.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_oldpiix.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_opti.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_optidma.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pcmcia.ko 2023-05-11T07:19:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_piccolo.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_rdc.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sch.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_serverworks.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sil680.ko 2023-05-11T07:19:22.879 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sis.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sl82c105.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_triflex.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_via.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pdc_adma.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_inic162x.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_mv.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_nv.ko 2023-05-11T07:19:22.880 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_promise.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_qstor.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil24.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sis.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_svw.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sx4.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_uli.ko 2023-05-11T07:19:22.881 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_via.ko 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_vsc.ko 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay/ks0108.ko 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma 2023-05-11T07:19:22.882 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma/bcma.ko 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe/aoe.ko 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/brd.ko 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd/drbd.ko 2023-05-11T07:19:22.883 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/floppy.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/loop.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/nbd.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk/null_blk.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/pktcdvd.ko 2023-05-11T07:19:22.884 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/rbd.ko 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/virtio_blk.ko 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkfront.ko 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram/zram.ko 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char 2023-05-11T07:19:22.885 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hangcheck-timer.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/via-rng.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi 2023-05-11T07:19:22.886 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/lp.ko 2023-05-11T07:19:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave/mwave.ko 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ppdev.ko 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tlclk.ko 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm 2023-05-11T07:19:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/uv_mmtimer.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/virtio_console.ko 2023-05-11T07:19:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto 2023-05-11T07:19:22.890 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp.ko 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-aes.ko 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-sha.ko 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common 2023-05-11T07:19:22.891 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca/dca.ko 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq 2023-05-11T07:19:22.892 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/amd64_edac.ko 2023-05-11T07:19:22.893 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/e752x_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/edac_mce_amd.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3000_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3200_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5100_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5400_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7300_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7core_edac.ko 2023-05-11T07:19:22.894 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i82975x_edac.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/ie31200_edac.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/sb_edac.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/x38_edac.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/edd.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-11T07:19:22.895 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-ich.ko 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-appleir.ko 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-aureal.ko 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-axff.ko 2023-05-11T07:19:22.896 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-dr.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elecom.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elo.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-emsff.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gaff.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gt683r.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gyration.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-11T07:19:22.897 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtekff.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-hyperv.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-icade.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-keytouch.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-kye.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lcpower.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-led.ko 2023-05-11T07:19:22.898 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lenovo.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-multitouch.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-ortek.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-penmount.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-petalynx.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-picolcd.ko 2023-05-11T07:19:22.899 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-pl.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-plantronics.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-primax.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-rmi.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-common.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-11T07:19:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-11T07:19:22.901 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-11T07:19:22.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat.ko 2023-05-11T07:19:22.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-saitek.ko 2023-05-11T07:19:22.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-samsung.ko 2023-05-11T07:19:22.902 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-11T07:19:22.905 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sjoy.ko 2023-05-11T07:19:22.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sony.ko 2023-05-11T07:19:22.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-speedlink.ko 2023-05-11T07:19:22.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-steelseries.ko 2023-05-11T07:19:22.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sunplus.ko 2023-05-11T07:19:22.906 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tivo.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tmff.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-topseed.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-twinhan.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-uclogic.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-waltop.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-wiimote.ko 2023-05-11T07:19:22.907 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-xinmo.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zpff.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zydacron.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/uhid.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/wacom.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_balloon.ko 2023-05-11T07:19:22.908 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_utils.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_vmbus.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru3.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7414.ko 2023-05-11T07:19:22.909 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7418.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adc128d818.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1025.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1026.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1029.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1031.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm9240.ko 2023-05-11T07:19:22.910 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ads7828.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7410.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7411.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7462.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7470.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7475.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7x10.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/amc6821.ko 2023-05-11T07:19:22.911 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/applesmc.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asb100.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asc7621.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/atxp1.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/coretemp.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-11T07:19:22.912 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dme1737.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds1621.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds620.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc1403.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc6w201.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71805f.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71882fg.ko 2023-05-11T07:19:22.913 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f75375s.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fam15h_power.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fschmd.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g760a.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g762.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl518sm.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl520sm.ko 2023-05-11T07:19:22.914 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5500_temp.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5k_amb.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmaem.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmpex.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina209.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina2xx.ko 2023-05-11T07:19:22.915 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/it87.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k10temp.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k8temp.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lineage-pem.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm63.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm73.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm75.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm77.ko 2023-05-11T07:19:22.916 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm78.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm80.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm83.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm85.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm87.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm90.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm92.ko 2023-05-11T07:19:22.917 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm93.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95234.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95241.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95245.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc2945.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4151.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4215.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4222.ko 2023-05-11T07:19:22.918 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4245.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4260.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4261.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max16065.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1619.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1668.ko 2023-05-11T07:19:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max197.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6639.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6650.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6697.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/mcp3021.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6683.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775-core.ko 2023-05-11T07:19:22.920 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct7802.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87360.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87427.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pcf8591.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-11T07:19:22.921 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-11T07:19:22.922 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/powr1220.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5627.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5636.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-11T07:19:22.923 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht15.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht21.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/shtc1.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sis5595.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47b397.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m1.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m192.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/thmc50.ko 2023-05-11T07:19:22.924 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp102.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp103.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp401.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp421.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via-cputemp.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via686a.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt1211.ko 2023-05-11T07:19:22.925 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt8231.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627ehf.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627hf.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83781d.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83791d.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83792d.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83793.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83795.ko 2023-05-11T07:19:22.926 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l785ts.ko 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l786ng.ko 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-11T07:19:22.927 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-11T07:19:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-11T07:19:22.929 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-dev.ko 2023-05-11T07:19:22.930 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-mux.ko 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-smbus.ko 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-stub.ko 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-11T07:19:22.931 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_core.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw 2023-05-11T07:19:22.932 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca 2023-05-11T07:19:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert 2023-05-11T07:19:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-11T07:19:22.935 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/gameport.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/lightning.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/ns558.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/joydev.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-11T07:19:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/appletouch.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/bcm5974.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/cyapatp.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/sermouse.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-11T07:19:22.937 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/altera_ps2.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/arc_ps2.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/serio_raw.ko 2023-05-11T07:19:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/sparse-keymap.ko 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-blinkm.ko 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lm3530.ko 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lp3944.ko 2023-05-11T07:19:22.939 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-ss4200.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-11T07:19:22.940 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache/bcache.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-bio-prison.ko 2023-05-11T07:19:22.941 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache-smq.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-crypt.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-delay.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-flakey.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-log-userspace.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-multipath.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-queue-length.ko 2023-05-11T07:19:22.942 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-raid.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-round-robin.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-service-time.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-switch.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-thin-pool.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-verity.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/faulty.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/linear.ko 2023-05-11T07:19:22.943 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/multipath.ko 2023-05-11T07:19:22.944 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data 2023-05-11T07:19:22.944 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-11T07:19:22.944 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid0.ko 2023-05-11T07:19:22.944 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid1.ko 2023-05-11T07:19:22.944 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid10.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid456.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptbase.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptctl.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptfc.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptlan.ko 2023-05-11T07:19:22.945 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptsas.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptscsih.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptspi.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_ich.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_sch.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/mfd-core.ko 2023-05-11T07:19:22.946 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/sm501.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/viperboard.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/vx855.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/wl1273-core.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds9802als.ko 2023-05-11T07:19:22.947 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds990x.ko 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/bh1770glc.ko 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710/cb710.ko 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/at24.ko 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-11T07:19:22.948 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/max6875.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/enclosure.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/hpilo.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29003.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29020.ko 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d 2023-05-11T07:19:22.949 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-me.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-txe.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-11T07:19:22.950 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_7xx1.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_core.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tsl2550.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_balloon.ko 2023-05-11T07:19:22.951 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding/bonding.ko 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53 2023-05-11T07:19:22.952 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dummy.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/eql.ko 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet 2023-05-11T07:19:22.953 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-11T07:19:22.954 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-11T07:19:22.955 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx 2023-05-11T07:19:22.956 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-11T07:19:22.957 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-11T07:19:22.958 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-11T07:19:22.959 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-11T07:19:22.960 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-11T07:19:22.961 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-11T07:19:22.962 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dnet.ko 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ethoc.ko 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/fealnx.ko 2023-05-11T07:19:22.963 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k 2023-05-11T07:19:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf 2023-05-11T07:19:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/jme.ko 2023-05-11T07:19:22.966 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-11T07:19:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-11T07:19:22.968 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-11T07:19:22.969 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-11T07:19:22.970 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-11T07:19:22.971 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis 2023-05-11T07:19:22.972 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro 2023-05-11T07:19:22.973 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-11T07:19:22.974 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-11T07:19:22.975 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/geneve.ko 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-11T07:19:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ifb.ko 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvlan.ko 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvtap.ko 2023-05-11T07:19:22.977 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mii.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/net_failover.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/netconsole.ko 2023-05-11T07:19:22.978 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/nlmon.ko 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/amd.ko 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-11T07:19:22.979 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm87xx.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/broadcom.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/cicada.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/davicom.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/dp83640.ko 2023-05-11T07:19:22.980 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/et1011c.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/icplus.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/lxt.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/marvell.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/micrel.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/national.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/phylink.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/qsemi.ko 2023-05-11T07:19:22.981 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/realtek.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/smsc.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/ste10Xp.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/vitesse.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_async.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-11T07:19:22.982 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppoe.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppox.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pptp.ko 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip 2023-05-11T07:19:22.983 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slhc.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slip.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/sungem_phy.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tap.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-11T07:19:22.984 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_random.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tun.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/veth.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/virtio_net.ko 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3 2023-05-11T07:19:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan/vxlan.ko 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netfront.ko 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb/ntb.ko 2023-05-11T07:19:22.986 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme-core.ko 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme.ko 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport.ko 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_cs.ko 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_pc.ko 2023-05-11T07:19:22.987 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_serial.ko 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/xen-pcifront.ko 2023-05-11T07:19:22.988 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/i82092.ko 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/pd6729.ko 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform 2023-05-11T07:19:22.989 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acerhdf.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-11T07:19:22.990 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/hdaps.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-11T07:19:22.991 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel_ips.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-11T07:19:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi.ko 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-11T07:19:22.993 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps_parport.ko 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/pps_core.ko 2023-05-11T07:19:22.994 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp_kvm.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-11T07:19:22.995 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-em3027.ko 2023-05-11T07:19:22.996 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-max6900.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-11T07:19:22.997 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-11T07:19:22.998 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-x1205.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-9xxx.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-sas.ko 2023-05-11T07:19:22.999 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-xxxx.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/BusLogic.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/a100u2w.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/advansys.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-11T07:19:23.000 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/am53c974.ko 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/atp870u.ko 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa 2023-05-11T07:19:23.001 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa/bfa.ko 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ch.ko 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-11T07:19:23.002 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dc395x.ko 2023-05-11T07:19:23.003 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dmx3191d.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-11T07:19:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esp_scsi.ko 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic/fnic.ko 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hpsa.ko 2023-05-11T07:19:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hptiop.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hv_storvsc.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/initio.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ipr.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ips.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci/isci.ko 2023-05-11T07:19:23.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc/libfc.ko 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi.ko 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas 2023-05-11T07:19:23.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas/libsas.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-11T07:19:23.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvumi.ko 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-11T07:19:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pmcraid.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla1280.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/raid_class.ko 2023-05-11T07:19:23.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_debug.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ses.ko 2023-05-11T07:19:23.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/st.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/stex.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/virtio_scsi.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/wd719x.ko 2023-05-11T07:19:23.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb/ssb.ko 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_file.ko 2023-05-11T07:19:23.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_iblock.ko 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_mod.ko 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_pscsi.ko 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_user.ko 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal 2023-05-11T07:19:23.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-11T07:19:23.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-11T07:19:23.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_gsm.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_hdlc.ko 2023-05-11T07:19:23.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/nozomi.ko 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/arc_uart.ko 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-11T07:19:23.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/synclink_gt.ko 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio.ko 2023-05-11T07:19:23.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_aec.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_cif.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_pci_generic.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_sercos3.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-acm.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-11T07:19:23.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usblp.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usbtmc.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/u132-hcd.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/mdc800.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/microtek.ko 2023-05-11T07:19:23.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/adutux.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/appledisplay.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi26.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi62.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ezusb.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-11T07:19:23.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/idmouse.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/iowarrior.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ldusb.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/legousbtower.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-11T07:19:23.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usb3503.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usblcd.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/uss720.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/yurex.ko 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy 2023-05-11T07:19:23.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy/phy-generic.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/aircable.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ark3116.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ch341.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cp210x.ko 2023-05-11T07:19:23.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cyberjack.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/empeg.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_ti.ko 2023-05-11T07:19:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipaq.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipw.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ir-usb.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-11T07:19:23.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mct_u232.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7720.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7840.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/navman.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/omninet.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/opticon.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/option.ko 2023-05-11T07:19:23.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/oti6858.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/pl2303.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcaux.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcserial.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/quatech2.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/safe_serial.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/sierra.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-11T07:19:23.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ssu100.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/symbolserial.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_debug.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/visor.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/whiteheat.ko 2023-05-11T07:19:23.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/uas.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-11T07:19:23.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-karma.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-11T07:19:23.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/usb-storage.ko 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci 2023-05-11T07:19:23.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_net.ko 2023-05-11T07:19:23.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_scsi.ko 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/apple_bl.ko 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/lcd.ko 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio.ko 2023-05-11T07:19:23.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_balloon.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_mmio.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_ring.ko 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters 2023-05-11T07:19:23.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2482.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2490.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-11T07:19:23.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/wire.ko 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog 2023-05-11T07:19:23.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/hpwdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/i6300esb.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ib700wdt.ko 2023-05-11T07:19:23.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ibmasr.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it87_wdt.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/machzwd.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/nv_tco.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-11T07:19:23.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/softdog.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/via_wdt.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-11T07:19:23.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/wdt_pci.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/xen_wdt.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-evtchn.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntalloc.ko 2023-05-11T07:19:23.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntdev.ko 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-privcmd.ko 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p 2023-05-11T07:19:23.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p/9p.ko 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs/affs.ko 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs/befs.ko 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/binfmt_misc.ko 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs/btrfs.ko 2023-05-11T07:19:23.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles/cachefiles.ko 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph/ceph.ko 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs/cifs.ko 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda/coda.ko 2023-05-11T07:19:23.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs/cramfs.ko 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm/dlm.ko 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs/f2fs.ko 2023-05-11T07:19:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/fat.ko 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/msdos.ko 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/vfat.ko 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache/fscache.ko 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse 2023-05-11T07:19:23.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/cuse.ko 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/fuse.ko 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2/gfs2.ko 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs/hfs.ko 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus 2023-05-11T07:19:23.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus/hfsplus.ko 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs/isofs.ko 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs/jfs.ko 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd/lockd.ko 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix 2023-05-11T07:19:23.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix/minix.ko 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs/netfs.ko 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout 2023-05-11T07:19:23.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfs.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv3.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv4.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/grace.ko 2023-05-11T07:19:23.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/nfs_acl.ko 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd/nfsd.ko 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2/nilfs2.ko 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-celtic.ko 2023-05-11T07:19:23.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-centeuro.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-croatian.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-cyrillic.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-gaelic.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-greek.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-iceland.ko 2023-05-11T07:19:23.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-inuit.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-roman.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-romanian.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-turkish.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1250.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1251.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1255.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp737.ko 2023-05-11T07:19:23.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp775.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp850.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp852.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp855.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp857.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp860.ko 2023-05-11T07:19:23.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp861.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp862.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp863.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp864.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp865.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp866.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp869.ko 2023-05-11T07:19:23.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp874.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp932.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp936.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp949.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp950.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_euc-jp.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-1.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-13.ko 2023-05-11T07:19:23.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-14.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-15.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-2.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-3.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-4.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-5.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-6.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-7.ko 2023-05-11T07:19:23.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-9.ko 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-r.ko 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-ru.ko 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-u.ko 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_utf8.ko 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster 2023-05-11T07:19:23.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-11T07:19:23.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs/overlay.ko 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore/ramoops.ko 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs 2023-05-11T07:19:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs/reiserfs.ko 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs/romfs.ko 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs 2023-05-11T07:19:23.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs/squashfs.ko 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv/sysv.ko 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf/udf.ko 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs/ufs.ko 2023-05-11T07:19:23.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs/xfs.ko 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu/rcutorture.ko 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/torture.ko 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-11T07:19:23.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/asn1_encoder.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc-itu-t.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc8.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libarc4.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libdes.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/libcrc32c.ko 2023-05-11T07:19:23.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lru_cache.ko 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4_compress.ko 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4hc_compress.ko 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math/cordic.ko 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6 2023-05-11T07:19:23.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6/raid6_pq.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_bm.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_fsm.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_kmp.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd/zstd_compress.ko 2023-05-11T07:19:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm/hwpoison-inject.ko 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/6lowpan.ko 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_dest.ko 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_fragment.ko 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_hop.ko 2023-05-11T07:19:23.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_mobility.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_routing.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_udp.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/garp.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/mrp.ko 2023-05-11T07:19:23.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/p8022.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/psnap.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/stp.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q/8021q.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_fd.ko 2023-05-11T07:19:23.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_rdma.ko 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_virtio.ko 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv/batman-adv.ko 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/br_netfilter.ko 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/bridge.ko 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter 2023-05-11T07:19:23.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-11T07:19:23.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-11T07:19:23.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtables.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-11T07:19:23.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph/libceph.ko 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/failover.ko 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/pktgen.ko 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp 2023-05-11T07:19:23.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_diag.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv4.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv6.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver/dns_resolver.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/dsa_core.ko 2023-05-11T07:19:23.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_brcm.ko 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_dsa.ko 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_none.ko 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_trailer.ko 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-11T07:19:23.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ah4.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/esp4.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/fou.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/gre.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/inet_diag.ko 2023-05-11T07:19:23.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_gre.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_tunnel.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_vti.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipcomp.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipip.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-11T07:19:23.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-11T07:19:23.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-11T07:19:23.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_bic.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_dctcp.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_diag.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_highspeed.ko 2023-05-11T07:19:23.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_htcp.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_hybla.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_illinois.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_lp.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_scalable.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_vegas.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_veno.ko 2023-05-11T07:19:23.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_westwood.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_yeah.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tunnel4.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_diag.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_tunnel.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6 2023-05-11T07:19:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ah6.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/esp6.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/fou6.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_tunnel.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_vti.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ipcomp6.ko 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter 2023-05-11T07:19:23.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-11T07:19:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-11T07:19:23.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-11T07:19:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/sit.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/tunnel6.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key/af_key.ko 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp 2023-05-11T07:19:23.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_core.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_eth.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip6.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_netlink.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ppp.ko 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc 2023-05-11T07:19:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc/llc.ko 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154/mac802154.ko 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls/mpls_gso.ko 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set.ko 2023-05-11T07:19:23.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-11T07:19:23.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-11T07:19:23.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-11T07:19:23.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conncount.ko 2023-05-11T07:19:23.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-11T07:19:23.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table.ko 2023-05-11T07:19:23.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_log_syslog.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_irc.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_sip.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-11T07:19:23.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_tables.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_log.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_chain_nat.ko 2023-05-11T07:19:23.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_compat.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_ct.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fib.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_hash.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_limit.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_log.ko 2023-05-11T07:19:23.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_masq.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_nat.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_numgen.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_queue.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_quota.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_redir.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject_inet.ko 2023-05-11T07:19:23.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_socket.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_tunnel.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_AUDIT.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CT.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_DSCP.ko 2023-05-11T07:19:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HL.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HMARK.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LED.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LOG.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NETMAP.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFLOG.ko 2023-05-11T07:19:23.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_RATEEST.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_SECMARK.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TEE.ko 2023-05-11T07:19:23.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TPROXY.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TRACE.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_addrtype.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_bpf.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cgroup.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cluster.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_comment.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connbytes.ko 2023-05-11T07:19:23.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlabel.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlimit.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connmark.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_conntrack.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cpu.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dccp.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_devgroup.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dscp.ko 2023-05-11T07:19:23.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ecn.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_esp.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hashlimit.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_helper.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hl.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipcomp.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_iprange.ko 2023-05-11T07:19:23.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipvs.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_l2tp.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_length.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_limit.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mac.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mark.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_multiport.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nat.ko 2023-05-11T07:19:23.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nfacct.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_osf.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_owner.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_physdev.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_pkttype.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_policy.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_quota.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_rateest.ko 2023-05-11T07:19:23.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_realm.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_recent.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_sctp.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_set.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_socket.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_state.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_statistic.ko 2023-05-11T07:19:23.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_string.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_tcpmss.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_time.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_u32.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink/netlink_diag.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh/nsh.ko 2023-05-11T07:19:23.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/openvswitch.ko 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-geneve.ko 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-gre.ko 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-vxlan.ko 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet/af_packet_diag.ko 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds 2023-05-11T07:19:23.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds.ko 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_rdma.ko 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_tcp.ko 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_csum.ko 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_gact.ko 2023-05-11T07:19:23.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_ipt.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_mirred.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_nat.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_pedit.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_police.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_simple.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_skbedit.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_vlan.ko 2023-05-11T07:19:23.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_basic.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_bpf.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_flow.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_fw.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_route.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_u32.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_cmp.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_ipset.ko 2023-05-11T07:19:23.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_meta.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_nbyte.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_text.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_u32.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_choke.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_codel.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_drr.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_fq.ko 2023-05-11T07:19:23.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_gred.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hfsc.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hhf.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_htb.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_ingress.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio_lib.ko 2023-05-11T07:19:23.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_multiq.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_netem.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_pie.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_plug.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_prio.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_qfq.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_red.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfb.ko 2023-05-11T07:19:23.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfq.ko 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_tbf.ko 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_teql.ko 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp.ko 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp_diag.ko 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss 2023-05-11T07:19:23.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/sunrpc.ko 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/diag.ko 2023-05-11T07:19:23.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/tipc.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix/unix_diag.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-11T07:19:23.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys 2023-05-11T07:19:23.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys/trusted.ko 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib/irqbypass.ko 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias.bin 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin 2023-05-11T07:19:23.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.bin 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.modinfo 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep.bin 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.devname 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.order 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.softdep 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols 2023-05-11T07:19:23.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols.bin 2023-05-11T07:19:23.125 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g8e556bdd976f 2023-05-11T07:19:23.126 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-11T07:19:23.152 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2023-05-11T07:19:23.153 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g8e556bdd976f -a -r /boot/System.map-6.3.0-g8e556bdd976f ]; then 2023-05-11T07:19:23.153 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:23.153 INFO:teuthology.orchestra.run.smithi144.stdout:cp /boot/System.map-6.3.0-g8e556bdd976f /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:23.153 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T07:19:23.153 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/installkernel 6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:rm -f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:new-kernel-pkg --remove 6.3.0-g8e556bdd976f --rminitrd --initrdfile=/boot/initramfs-6.3.0-g8e556bdd976f.img 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-11T07:19:23.154 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.3.0-g8e556bdd976f 2023-05-11T07:19:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-05-11T07:19:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-11T07:19:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-11T07:19:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/update-bootloader --remove 6.3.0-g8e556bdd976f 2023-05-11T07:19:23.155 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2023-05-11T07:19:23.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2023-05-11T07:19:23.233 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2023-05-11T07:19:23.233 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2023-05-11T07:19:23.233 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.02 2023-05-11T07:19:23.233 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 129.el8 2023-05-11T07:19:23.233 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Group : System Environment/Base 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 9265586 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-11T07:19:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Relocations : (not relocatable) 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : CentOS BuildSystem 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2023-05-11T07:19:23.235 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:19:23.236 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2023-05-11T07:19:23.237 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-11T07:19:23.238 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.3.0-g8e556bdd976f 2023-05-11T07:19:23.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-11T07:19:27.418 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2023-05-11T07:19:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:done 2023-05-11T07:19:29.927 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-05-11T07:19:29.974 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.CWol0iQZiR 2023-05-11T07:19:29.974 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CWol0iQZiR 2023-05-11T07:19:30.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.CWol0iQZiR 2023-05-11T07:19:30.158 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.CWol0iQZiR is 6KB 2023-05-11T07:19:30.205 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.CWol0iQZiR 2023-05-11T07:19:30.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2023-05-11T07:19:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-11T07:19:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-11T07:19:30.297 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-11T07:19:30.298 INFO:teuthology.orchestra.run.smithi144.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f.conf 2023-05-11T07:19:30.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f 2023-05-11T07:19:30.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2023-05-11T07:19:47.587 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-05-11T07:19:47.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-05-11T07:19:47.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:20:00.464 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-05-11T07:20:00.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-05-11T07:20:00.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:20:06.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-05-11T07:20:18.800 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-05-11T07:20:36.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-05-11T07:20:36.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:20:39.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-05-11T07:20:48.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-05-11T07:20:48.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:21:07.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-05-11T07:21:09.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-05-11T07:21:09.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:21:09.486 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-05-11T07:21:09.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-05-11T07:21:09.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.3.0-g8e556bdd976f"... 2023-05-11T07:21:09.884 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2023-05-11T07:21:09.925 INFO:teuthology.orchestra.run.smithi145.stdout:6.3.0-g8e556bdd976f 2023-05-11T07:21:09.926 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g8e556bdd976f vs 6.3.0-g8e556bdd976f 2023-05-11T07:21:09.926 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-11T07:21:09.926 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-11T07:21:10.928 DEBUG:teuthology.parallel:result is None 2023-05-11T07:21:37.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-05-11T07:21:37.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:21:37.588 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-05-11T07:21:38.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-05-11T07:21:38.053 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.3.0-g8e556bdd976f"... 2023-05-11T07:21:38.053 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-05-11T07:21:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:6.3.0-g8e556bdd976f 2023-05-11T07:21:38.095 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g8e556bdd976f vs 6.3.0-g8e556bdd976f 2023-05-11T07:21:38.095 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-11T07:21:38.095 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-11T07:21:39.096 DEBUG:teuthology.parallel:result is None 2023-05-11T07:21:39.097 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-11T07:21:39.104 INFO:teuthology.task.internal:Creating test directory... 2023-05-11T07:21:39.104 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-11T07:21:39.109 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-11T07:21:39.155 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-11T07:21:39.163 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-11T07:21:39.172 INFO:teuthology.task.internal:Creating archive directory... 2023-05-11T07:21:39.173 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-11T07:21:39.194 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-11T07:21:39.319 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-11T07:21:39.327 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-11T07:21:39.327 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-11T07:21:39.331 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-11T07:21:39.435 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T07:21:39.464 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T07:21:39.470 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T07:21:39.496 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T07:21:39.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-11T07:21:39.505 INFO:teuthology.task.internal:Configuring sudo... 2023-05-11T07:21:39.506 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-11T07:21:39.510 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-11T07:21:39.573 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-11T07:21:39.582 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-11T07:21:39.583 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-11T07:21:39.587 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-11T07:21:39.628 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T07:21:39.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T07:21:39.810 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T07:21:39.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T07:21:39.956 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:21:39.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-11T07:21:40.019 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T07:21:40.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T07:21:40.168 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T07:21:40.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T07:21:40.314 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:21:40.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-11T07:21:40.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-05-11T07:21:40.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2023-05-11T07:21:40.482 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-11T07:21:40.519 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-11T07:21:40.949 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-11T07:21:40.958 INFO:teuthology.task.internal:Starting timer... 2023-05-11T07:21:40.958 INFO:teuthology.run_tasks:Running task pcp... 2023-05-11T07:21:40.973 INFO:teuthology.run_tasks:Running task selinux... 2023-05-11T07:21:40.982 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-05-11T07:21:40.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-05-11T07:21:41.135 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-05-11T07:21:41.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2023-05-11T07:21:41.268 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2023-05-11T07:21:41.270 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-11T07:21:41.271 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-05-11T07:21:41.323 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-05-11T07:21:41.324 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2023-05-11T07:21:41.372 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2023-05-11T07:21:41.372 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2023-05-11T07:21:41.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-11T07:21:41.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:21:41.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-11T07:21:41.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:21:41.506 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-11T07:21:41.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-05-11T07:21:41.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2023-05-11T07:21:41.632 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-11T07:21:41.641 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-11T07:21:41.648 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-11T07:21:41.811 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-11T07:21:41.833 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-11T07:21:41.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-11T07:29:53.371 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2023-05-11T07:29:53.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-05-11T07:29:53.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:29:53.458 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-05-11T07:29:53.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-05-11T07:29:53.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T07:29:53.645 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-05-11T07:29:53.754 INFO:teuthology.run_tasks:Running task clock... 2023-05-11T07:29:53.764 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-11T07:29:53.765 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-11T07:29:53.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-11T07:29:53.769 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-11T07:29:53.770 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-11T07:29:53.833 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-11T07:29:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-11T07:29:53.863 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-11T07:29:53.892 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-11T07:29:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-05-11T07:29:53.975 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-05-11T07:29:53.981 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2023-05-11T07:29:54.004 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-11T07:29:54.005 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2023-05-11T07:29:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-11T07:29:54.035 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-11T07:29:54.064 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-11T07:29:54.115 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-05-11T07:29:54.121 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-11T07:29:54.121 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-05-11T07:29:54.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.143 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2023-05-11T07:29:54.149 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-11T07:29:54.150 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2023-05-11T07:29:54.150 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.150 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.150 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.150 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T07:29:54.151 INFO:teuthology.run_tasks:Running task install... 2023-05-11T07:29:54.161 DEBUG:teuthology.task.install:project ceph 2023-05-11T07:29:54.161 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}} 2023-05-11T07:29:54.161 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'} 2023-05-11T07:29:54.162 INFO:teuthology.task.install:Using flavor: default 2023-05-11T07:29:54.168 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-11T07:29:54.168 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-11T07:29:54.169 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'tag': None, 'wait_for_package': False} 2023-05-11T07:29:54.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T07:29:54.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'tag': None, 'wait_for_package': False} 2023-05-11T07:29:54.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T07:29:54.315 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/ 2023-05-11T07:29:54.315 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3879.ge28f4bf0 2023-05-11T07:29:54.328 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/ 2023-05-11T07:29:54.328 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3879.ge28f4bf0 2023-05-11T07:29:54.429 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-11T07:29:54.429 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:29:54.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-11T07:29:54.434 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-11T07:29:54.434 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:29:54.434 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-11T07:29:54.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-11T07:29:54.492 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e28f4bf0df5d53a504fe40e32a78dd63506e2421/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-11T07:29:54.497 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-11T07:29:54.497 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e28f4bf0df5d53a504fe40e32a78dd63506e2421/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-11T07:29:54.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-11T07:29:54.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-11T07:29:54.687 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-11T07:29:54.691 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-11T07:29:54.749 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-05-11T07:29:54.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-05-11T07:29:54.752 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2023-05-11T07:29:54.755 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2023-05-11T07:29:55.063 INFO:teuthology.orchestra.run.smithi145.stdout:53 files removed 2023-05-11T07:29:55.073 INFO:teuthology.orchestra.run.smithi144.stdout:53 files removed 2023-05-11T07:29:55.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-11T07:29:55.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-11T07:29:55.916 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 306 kB/s | 80 kB 00:00 2023-05-11T07:29:55.924 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 309 kB/s | 80 kB 00:00 2023-05-11T07:29:56.175 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 43 kB/s | 9.4 kB 00:00 2023-05-11T07:29:56.197 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-05-11T07:29:56.426 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 6.6 kB/s | 1.5 kB 00:00 2023-05-11T07:29:56.457 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-05-11T07:29:57.568 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - AppStream 26 MB/s | 29 MB 00:01 2023-05-11T07:29:57.615 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - AppStream 26 MB/s | 29 MB 00:01 2023-05-11T07:30:05.259 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 34 MB 00:02 2023-05-11T07:30:06.065 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 34 MB 00:02 2023-05-11T07:30:11.901 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras 14 kB/s | 18 kB 00:01 2023-05-11T07:30:12.165 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras 26 kB/s | 18 kB 00:00 2023-05-11T07:30:12.368 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.4 kB 00:00 2023-05-11T07:30:12.499 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 8 - Extras common packages 37 kB/s | 6.4 kB 00:00 2023-05-11T07:30:14.935 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-05-11T07:30:15.078 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-05-11T07:30:16.814 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 14 MB 00:01 2023-05-11T07:30:20.753 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 382 kB/s | 24 kB 00:00 2023-05-11T07:30:24.169 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T07:30:24.169 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T07:30:24.180 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-11T07:30:24.180 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-11T07:30:24.181 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-11T07:30:24.182 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T07:30:24.183 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T07:30:24.184 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T07:30:24.187 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T07:30:24.188 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T07:30:24.350 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2023-05-11T07:30:24.362 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================================ 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================================ 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.4 k 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 5.3 M 2023-05-11T07:30:24.363 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 847 k 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 165 k 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 1.5 M 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 127 k 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 1.7 M 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 7.4 M 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 47 k 2023-05-11T07:30:24.364 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 13 M 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 41 M 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 265 k 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 83 k 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 258 k 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 18 k 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-11T07:30:24.365 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 31 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 771 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 139 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-11T07:30:24.366 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 197 k 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 370 k 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 364 k 2023-05-11T07:30:24.367 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 107 k 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 95 k 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.4 M 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 179 k 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-11T07:30:24.368 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.7 M 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.6 M 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 22 M 2023-05-11T07:30:24.369 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 23 k 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 2.3 M 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 240 k 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 4.6 M 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 18 M 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 15 k 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 24 k 2023-05-11T07:30:24.370 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 137 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-11T07:30:24.371 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 473 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.5 M 2023-05-11T07:30:24.372 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-11T07:30:24.373 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-11T07:30:24.374 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 45 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 119 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-11T07:30:24.375 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-11T07:30:24.376 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-11T07:30:24.377 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-11T07:30:24.378 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-11T07:30:24.379 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-11T07:30:24.380 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-11T07:30:24.381 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:Enabling module streams: 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql 10 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================================ 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:Install 128 Packages 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 5 Packages 2023-05-11T07:30:24.382 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:30:24.383 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 197 M 2023-05-11T07:30:24.383 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2023-05-11T07:30:24.871 INFO:teuthology.orchestra.run.smithi145.stdout:(1/133): ceph-18.0.0-3879.ge28f4bf0.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2023-05-11T07:30:25.088 INFO:teuthology.orchestra.run.smithi145.stdout:(2/133): ceph-fuse-18.0.0-3879.ge28f4bf0.el8.x8 3.8 MB/s | 847 kB 00:00 2023-05-11T07:30:25.172 INFO:teuthology.orchestra.run.smithi145.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 1.9 MB/s | 165 kB 00:00 2023-05-11T07:30:25.505 INFO:teuthology.orchestra.run.smithi145.stdout:(4/133): ceph-base-18.0.0-3879.ge28f4bf0.el8.x8 7.0 MB/s | 5.3 MB 00:00 2023-05-11T07:30:25.564 INFO:teuthology.orchestra.run.smithi145.stdout:(5/133): ceph-mds-18.0.0-3879.ge28f4bf0.el8.x86 5.8 MB/s | 2.3 MB 00:00 2023-05-11T07:30:25.705 INFO:teuthology.orchestra.run.smithi145.stdout:(6/133): ceph-mgr-18.0.0-3879.ge28f4bf0.el8.x86 7.8 MB/s | 1.5 MB 00:00 2023-05-11T07:30:26.249 INFO:teuthology.orchestra.run.smithi145.stdout:(7/133): ceph-mon-18.0.0-3879.ge28f4bf0.el8.x86 6.7 MB/s | 4.6 MB 00:00 2023-05-11T07:30:26.890 INFO:teuthology.orchestra.run.smithi145.stdout:(8/133): ceph-common-18.0.0-3879.ge28f4bf0.el8. 10 MB/s | 22 MB 00:02 2023-05-11T07:30:26.948 INFO:teuthology.orchestra.run.smithi145.stdout:(9/133): ceph-selinux-18.0.0-3879.ge28f4bf0.el8 419 kB/s | 24 kB 00:00 2023-05-11T07:30:27.432 INFO:teuthology.orchestra.run.smithi145.stdout:(10/133): ceph-osd-18.0.0-3879.ge28f4bf0.el8.x8 10 MB/s | 18 MB 00:01 2023-05-11T07:30:27.515 INFO:teuthology.orchestra.run.smithi145.stdout:(11/133): cephfs-mirror-18.0.0-3879.ge28f4bf0.e 3.0 MB/s | 258 kB 00:00 2023-05-11T07:30:27.591 INFO:teuthology.orchestra.run.smithi145.stdout:(12/133): libcephfs-devel-18.0.0-3879.ge28f4bf0 414 kB/s | 31 kB 00:00 2023-05-11T07:30:27.741 INFO:teuthology.orchestra.run.smithi145.stdout:(13/133): libcephfs2-18.0.0-3879.ge28f4bf0.el8. 5.0 MB/s | 771 kB 00:00 2023-05-11T07:30:27.891 INFO:teuthology.orchestra.run.smithi145.stdout:(14/133): ceph-radosgw-18.0.0-3879.ge28f4bf0.el 7.9 MB/s | 13 MB 00:01 2023-05-11T07:30:27.916 INFO:teuthology.orchestra.run.smithi145.stdout:(15/133): libcephsqlite-18.0.0-3879.ge28f4bf0.e 784 kB/s | 137 kB 00:00 2023-05-11T07:30:27.941 INFO:teuthology.orchestra.run.smithi145.stdout:(16/133): librados-devel-18.0.0-3879.ge28f4bf0. 2.7 MB/s | 139 kB 00:00 2023-05-11T07:30:27.975 INFO:teuthology.orchestra.run.smithi145.stdout:(17/133): libradosstriper1-18.0.0-3879.ge28f4bf 7.9 MB/s | 473 kB 00:00 2023-05-11T07:30:28.042 INFO:teuthology.orchestra.run.smithi145.stdout:(18/133): python3-ceph-argparse-18.0.0-3879.ge2 673 kB/s | 45 kB 00:00 2023-05-11T07:30:28.126 INFO:teuthology.orchestra.run.smithi145.stdout:(19/133): python3-ceph-common-18.0.0-3879.ge28f 1.4 MB/s | 119 kB 00:00 2023-05-11T07:30:28.301 INFO:teuthology.orchestra.run.smithi145.stdout:(20/133): python3-cephfs-18.0.0-3879.ge28f4bf0. 1.1 MB/s | 197 kB 00:00 2023-05-11T07:30:28.418 INFO:teuthology.orchestra.run.smithi145.stdout:(21/133): python3-rados-18.0.0-3879.ge28f4bf0.e 3.1 MB/s | 370 kB 00:00 2023-05-11T07:30:28.535 INFO:teuthology.orchestra.run.smithi145.stdout:(22/133): python3-rbd-18.0.0-3879.ge28f4bf0.el8 3.1 MB/s | 364 kB 00:00 2023-05-11T07:30:28.636 INFO:teuthology.orchestra.run.smithi145.stdout:(23/133): librgw2-18.0.0-3879.ge28f4bf0.el8.x86 9.4 MB/s | 6.5 MB 00:00 2023-05-11T07:30:28.661 INFO:teuthology.orchestra.run.smithi145.stdout:(24/133): python3-rgw-18.0.0-3879.ge28f4bf0.el8 851 kB/s | 107 kB 00:00 2023-05-11T07:30:28.703 INFO:teuthology.orchestra.run.smithi145.stdout:(25/133): rbd-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.4 MB/s | 95 kB 00:00 2023-05-11T07:30:28.811 INFO:teuthology.orchestra.run.smithi145.stdout:(26/133): rbd-nbd-18.0.0-3879.ge28f4bf0.el8.x86 1.6 MB/s | 179 kB 00:00 2023-05-11T07:30:28.895 INFO:teuthology.orchestra.run.smithi145.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3879.g 277 kB/s | 23 kB 00:00 2023-05-11T07:30:29.004 INFO:teuthology.orchestra.run.smithi145.stdout:(28/133): rbd-mirror-18.0.0-3879.ge28f4bf0.el8. 10 MB/s | 3.4 MB 00:00 2023-05-11T07:30:29.178 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 14 MB 00:14 2023-05-11T07:30:29.196 INFO:teuthology.orchestra.run.smithi145.stdout:(29/133): ceph-mgr-cephadm-18.0.0-3879.ge28f4bf 424 kB/s | 127 kB 00:00 2023-05-11T07:30:29.421 INFO:teuthology.orchestra.run.smithi145.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3879.ge28f4 4.1 MB/s | 1.7 MB 00:00 2023-05-11T07:30:29.771 INFO:teuthology.orchestra.run.smithi145.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3879.ge2 686 kB/s | 240 kB 00:00 2023-05-11T07:30:30.172 INFO:teuthology.orchestra.run.smithi145.stdout:(32/133): ceph-test-18.0.0-3879.ge28f4bf0.el8.x 13 MB/s | 41 MB 00:03 2023-05-11T07:30:30.188 INFO:teuthology.orchestra.run.smithi145.stdout:(33/133): ceph-mgr-rook-18.0.0-3879.ge28f4bf0.e 114 kB/s | 47 kB 00:00 2023-05-11T07:30:30.214 INFO:teuthology.orchestra.run.smithi145.stdout:(34/133): ceph-prometheus-alerts-18.0.0-3879.ge 350 kB/s | 15 kB 00:00 2023-05-11T07:30:30.322 INFO:teuthology.orchestra.run.smithi145.stdout:(35/133): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-05-11T07:30:30.348 INFO:teuthology.orchestra.run.smithi145.stdout:(36/133): cephadm-18.0.0-3879.ge28f4bf0.el8.noa 625 kB/s | 83 kB 00:00 2023-05-11T07:30:30.373 INFO:teuthology.orchestra.run.smithi145.stdout:(37/133): ceph-volume-18.0.0-3879.ge28f4bf0.el8 1.4 MB/s | 265 kB 00:00 2023-05-11T07:30:30.415 INFO:teuthology.orchestra.run.smithi145.stdout:(38/133): cephfs-top-18.0.0-3879.ge28f4bf0.el8. 196 kB/s | 18 kB 00:00 2023-05-11T07:30:30.490 INFO:teuthology.orchestra.run.smithi145.stdout:(39/133): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-05-11T07:30:30.524 INFO:teuthology.orchestra.run.smithi145.stdout:(40/133): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2023-05-11T07:30:30.549 INFO:teuthology.orchestra.run.smithi145.stdout:(41/133): jq-1.6-7.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-05-11T07:30:30.583 INFO:teuthology.orchestra.run.smithi145.stdout:(42/133): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2023-05-11T07:30:30.608 INFO:teuthology.orchestra.run.smithi145.stdout:(43/133): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-05-11T07:30:30.633 INFO:teuthology.orchestra.run.smithi145.stdout:(44/133): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-05-11T07:30:30.658 INFO:teuthology.orchestra.run.smithi145.stdout:(45/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-05-11T07:30:30.684 INFO:teuthology.orchestra.run.smithi145.stdout:(46/133): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-05-11T07:30:30.709 INFO:teuthology.orchestra.run.smithi145.stdout:(47/133): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-05-11T07:30:30.801 INFO:teuthology.orchestra.run.smithi145.stdout:(48/133): postgresql-10.23-1.module_el8+300+2c5 17 MB/s | 1.6 MB 00:00 2023-05-11T07:30:30.902 INFO:teuthology.orchestra.run.smithi145.stdout:(49/133): openblas-0.3.15-4.el8.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2023-05-11T07:30:30.935 INFO:teuthology.orchestra.run.smithi145.stdout:(50/133): postgresql-contrib-10.23-1.module_el8 6.6 MB/s | 903 kB 00:00 2023-05-11T07:30:31.002 INFO:teuthology.orchestra.run.smithi145.stdout:(51/133): openblas-threads-0.3.15-4.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-05-11T07:30:31.061 INFO:teuthology.orchestra.run.smithi145.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-05-11T07:30:31.180 INFO:teuthology.orchestra.run.smithi145.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 225 kB/s | 27 kB 00:00 2023-05-11T07:30:31.253 INFO:teuthology.orchestra.run.smithi145.stdout:(54/133): postgresql-server-10.23-1.module_el8+ 15 MB/s | 5.1 MB 00:00 2023-05-11T07:30:31.279 INFO:teuthology.orchestra.run.smithi145.stdout:(55/133): python3-jsonpointer-1.10-11.el8.noarc 203 kB/s | 20 kB 00:00 2023-05-11T07:30:31.304 INFO:teuthology.orchestra.run.smithi145.stdout:(56/133): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-05-11T07:30:31.329 INFO:teuthology.orchestra.run.smithi145.stdout:(57/133): python3-markupsafe-0.23-19.el8.x86_64 776 kB/s | 39 kB 00:00 2023-05-11T07:30:31.421 INFO:teuthology.orchestra.run.smithi145.stdout:(58/133): python3-babel-2.5.1-7.el8.noarch.rpm 9.9 MB/s | 4.8 MB 00:00 2023-05-11T07:30:31.446 INFO:teuthology.orchestra.run.smithi145.stdout:(59/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2023-05-11T07:30:31.472 INFO:teuthology.orchestra.run.smithi145.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 876 kB/s | 44 kB 00:00 2023-05-11T07:30:31.497 INFO:teuthology.orchestra.run.smithi145.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-05-11T07:30:31.523 INFO:teuthology.orchestra.run.smithi145.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-05-11T07:30:31.547 INFO:teuthology.orchestra.run.smithi145.stdout:(63/133): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-05-11T07:30:31.565 INFO:teuthology.orchestra.run.smithi145.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-11T07:30:31.648 INFO:teuthology.orchestra.run.smithi145.stdout:(65/133): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-05-11T07:30:31.682 INFO:teuthology.orchestra.run.smithi145.stdout:(66/133): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-05-11T07:30:31.707 INFO:teuthology.orchestra.run.smithi145.stdout:(67/133): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-05-11T07:30:31.724 INFO:teuthology.orchestra.run.smithi145.stdout:(68/133): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-05-11T07:30:31.749 INFO:teuthology.orchestra.run.smithi145.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 71 kB 00:00 2023-05-11T07:30:31.983 INFO:teuthology.orchestra.run.smithi145.stdout:(70/133): python3-scipy-1.0.0-21.module_el8.5.0 31 MB/s | 14 MB 00:00 2023-05-11T07:30:32.008 INFO:teuthology.orchestra.run.smithi145.stdout:(71/133): elfutils-libelf-devel-0.189-2.el8.x86 217 kB/s | 61 kB 00:00 2023-05-11T07:30:32.033 INFO:teuthology.orchestra.run.smithi145.stdout:(72/133): fuse-2.9.7-17.el8.x86_64.rpm 292 kB/s | 83 kB 00:00 2023-05-11T07:30:32.108 INFO:teuthology.orchestra.run.smithi145.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 249 kB/s | 19 kB 00:00 2023-05-11T07:30:32.150 INFO:teuthology.orchestra.run.smithi145.stdout:(74/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2023-05-11T07:30:32.176 INFO:teuthology.orchestra.run.smithi145.stdout:(75/133): libcom_err-devel-1.45.6-5.el8.x86_64. 579 kB/s | 39 kB 00:00 2023-05-11T07:30:32.212 INFO:teuthology.orchestra.run.smithi145.stdout:(76/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.7 MB/s | 561 kB 00:00 2023-05-11T07:30:32.260 INFO:teuthology.orchestra.run.smithi145.stdout:(77/133): libquadmath-8.5.0-19.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2023-05-11T07:30:32.285 INFO:teuthology.orchestra.run.smithi145.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 620 kB/s | 47 kB 00:00 2023-05-11T07:30:32.319 INFO:teuthology.orchestra.run.smithi145.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-05-11T07:30:32.344 INFO:teuthology.orchestra.run.smithi145.stdout:(80/133): libgfortran-8.5.0-19.el8.x86_64.rpm 3.3 MB/s | 645 kB 00:00 2023-05-11T07:30:32.369 INFO:teuthology.orchestra.run.smithi145.stdout:(81/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-05-11T07:30:32.403 INFO:teuthology.orchestra.run.smithi145.stdout:(82/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 1.2 MB/s | 99 kB 00:00 2023-05-11T07:30:32.437 INFO:teuthology.orchestra.run.smithi145.stdout:(83/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 196 kB/s | 18 kB 00:00 2023-05-11T07:30:32.462 INFO:teuthology.orchestra.run.smithi145.stdout:(84/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 474 kB/s | 44 kB 00:00 2023-05-11T07:30:32.512 INFO:teuthology.orchestra.run.smithi145.stdout:(85/133): pcre2-devel-10.32-3.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2023-05-11T07:30:32.563 INFO:teuthology.orchestra.run.smithi145.stdout:(86/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-05-11T07:30:32.588 INFO:teuthology.orchestra.run.smithi145.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-05-11T07:30:32.680 INFO:teuthology.orchestra.run.smithi145.stdout:(88/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-05-11T07:30:32.705 INFO:teuthology.orchestra.run.smithi145.stdout:(89/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 237 kB 00:00 2023-05-11T07:30:32.739 INFO:teuthology.orchestra.run.smithi145.stdout:(90/133): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2023-05-11T07:30:32.764 INFO:teuthology.orchestra.run.smithi145.stdout:(91/133): python3-jwt-1.6.1-2.el8.noarch.rpm 508 kB/s | 43 kB 00:00 2023-05-11T07:30:32.789 INFO:teuthology.orchestra.run.smithi145.stdout:(92/133): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-05-11T07:30:32.814 INFO:teuthology.orchestra.run.smithi145.stdout:(93/133): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-05-11T07:30:32.840 INFO:teuthology.orchestra.run.smithi145.stdout:(94/133): python3-requests-oauthlib-1.0.0-1.el8 566 kB/s | 43 kB 00:00 2023-05-11T07:30:32.865 INFO:teuthology.orchestra.run.smithi145.stdout:(95/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 960 kB/s | 72 kB 00:00 2023-05-11T07:30:32.890 INFO:teuthology.orchestra.run.smithi145.stdout:(96/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 768 kB/s | 58 kB 00:00 2023-05-11T07:30:33.200 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 340 kB/s | 24 kB 00:00 2023-05-11T07:30:33.399 INFO:teuthology.orchestra.run.smithi145.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 110 kB/s | 59 kB 00:00 2023-05-11T07:30:33.424 INFO:teuthology.orchestra.run.smithi145.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 141 kB/s | 75 kB 00:00 2023-05-11T07:30:33.591 INFO:teuthology.orchestra.run.smithi145.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 262 kB/s | 44 kB 00:00 2023-05-11T07:30:33.750 INFO:teuthology.orchestra.run.smithi145.stdout:(100/133): gperftools-libs-2.7-9.el8.x86_64.rpm 337 kB/s | 306 kB 00:00 2023-05-11T07:30:33.858 INFO:teuthology.orchestra.run.smithi145.stdout:(101/133): python3-cachetools-3.1.1-4.el8.noarc 305 kB/s | 33 kB 00:00 2023-05-11T07:30:33.884 INFO:teuthology.orchestra.run.smithi145.stdout:(102/133): python3-beautifulsoup4-4.6.3-2.el8.1 634 kB/s | 185 kB 00:00 2023-05-11T07:30:33.967 INFO:teuthology.orchestra.run.smithi145.stdout:(103/133): python3-certifi-2018.10.15-7.el8.noa 150 kB/s | 16 kB 00:00 2023-05-11T07:30:34.018 INFO:teuthology.orchestra.run.smithi145.stdout:(104/133): python3-asyncssh-2.7.0-2.el8.noarch. 770 kB/s | 476 kB 00:00 2023-05-11T07:30:34.168 INFO:teuthology.orchestra.run.smithi145.stdout:(105/133): python3-cheroot-8.5.2-1.el8.noarch.r 607 kB/s | 173 kB 00:00 2023-05-11T07:30:34.210 INFO:teuthology.orchestra.run.smithi145.stdout:(106/133): python3-google-auth-1.1.1-10.el8.noa 423 kB/s | 81 kB 00:00 2023-05-11T07:30:34.269 INFO:teuthology.orchestra.run.smithi145.stdout:(107/133): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-05-11T07:30:34.319 INFO:teuthology.orchestra.run.smithi145.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-05-11T07:30:34.427 INFO:teuthology.orchestra.run.smithi145.stdout:(109/133): python3-logutils-0.3.5-11.el8.noarch 450 kB/s | 49 kB 00:00 2023-05-11T07:30:34.536 INFO:teuthology.orchestra.run.smithi145.stdout:(110/133): python3-cherrypy-18.4.0-1.el8.noarch 676 kB/s | 384 kB 00:00 2023-05-11T07:30:34.561 INFO:teuthology.orchestra.run.smithi145.stdout:(111/133): python3-more-itertools-7.2.0-3.el8.n 440 kB/s | 59 kB 00:00 2023-05-11T07:30:34.645 INFO:teuthology.orchestra.run.smithi145.stdout:(112/133): python3-natsort-7.1.1-2.el8.noarch.r 556 kB/s | 60 kB 00:00 2023-05-11T07:30:34.754 INFO:teuthology.orchestra.run.smithi145.stdout:(113/133): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-05-11T07:30:34.871 INFO:teuthology.orchestra.run.smithi145.stdout:(114/133): python3-repoze-lru-0.7-6.el8.noarch. 288 kB/s | 34 kB 00:00 2023-05-11T07:30:34.954 INFO:teuthology.orchestra.run.smithi145.stdout:(115/133): python3-pecan-1.3.2-9.el8.noarch.rpm 721 kB/s | 283 kB 00:00 2023-05-11T07:30:35.063 INFO:teuthology.orchestra.run.smithi145.stdout:(116/133): python3-rsa-4.8-1.el8.noarch.rpm 569 kB/s | 61 kB 00:00 2023-05-11T07:30:35.146 INFO:teuthology.orchestra.run.smithi145.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 714 kB/s | 196 kB 00:00 2023-05-11T07:30:35.172 INFO:teuthology.orchestra.run.smithi145.stdout:(118/133): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-05-11T07:30:35.255 INFO:teuthology.orchestra.run.smithi145.stdout:(119/133): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-05-11T07:30:35.281 INFO:teuthology.orchestra.run.smithi145.stdout:(120/133): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-05-11T07:30:35.364 INFO:teuthology.orchestra.run.smithi145.stdout:(121/133): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-05-11T07:30:35.490 INFO:teuthology.orchestra.run.smithi145.stdout:(122/133): python3-kubernetes-11.0.0-6.el8.noar 978 kB/s | 1.2 MB 00:01 2023-05-11T07:30:35.557 INFO:teuthology.orchestra.run.smithi145.stdout:(123/133): python3-waitress-1.2.1-2.el8.1.noarc 874 kB/s | 241 kB 00:00 2023-05-11T07:30:35.599 INFO:teuthology.orchestra.run.smithi145.stdout:(124/133): python3-websocket-client-0.56.0-5.el 564 kB/s | 61 kB 00:00 2023-05-11T07:30:35.707 INFO:teuthology.orchestra.run.smithi145.stdout:(125/133): python3-zc-lockfile-2.0-2.el8.noarch 212 kB/s | 23 kB 00:00 2023-05-11T07:30:35.749 INFO:teuthology.orchestra.run.smithi145.stdout:(126/133): python3-webob-1.8.5-1.el8.1.noarch.r 654 kB/s | 251 kB 00:00 2023-05-11T07:30:35.774 INFO:teuthology.orchestra.run.smithi145.stdout:(127/133): python3-webtest-2.0.33-1.el8.noarch. 393 kB/s | 85 kB 00:00 2023-05-11T07:30:36.572 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T07:30:36.573 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T07:30:36.584 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-11T07:30:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-11T07:30:36.585 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-11T07:30:36.586 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T07:30:36.587 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T07:30:36.589 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T07:30:36.591 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T07:30:36.592 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T07:30:36.754 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-05-11T07:30:36.766 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================================ 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================================ 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.4 k 2023-05-11T07:30:36.767 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 5.3 M 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 847 k 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 165 k 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 1.5 M 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 127 k 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 1.7 M 2023-05-11T07:30:36.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 7.4 M 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 47 k 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 13 M 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 41 M 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 265 k 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 83 k 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 258 k 2023-05-11T07:30:36.769 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 18 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 31 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 771 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 139 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-11T07:30:36.770 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 197 k 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 370 k 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 364 k 2023-05-11T07:30:36.771 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 107 k 2023-05-11T07:30:36.772 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 95 k 2023-05-11T07:30:36.772 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.4 M 2023-05-11T07:30:36.772 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 179 k 2023-05-11T07:30:36.772 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.7 M 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.6 M 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-05-11T07:30:36.773 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 22 M 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 23 k 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 2.3 M 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 240 k 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 4.6 M 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 18 M 2023-05-11T07:30:36.774 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 15 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 24 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 137 k 2023-05-11T07:30:36.775 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 473 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-11T07:30:36.776 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.5 M 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-11T07:30:36.777 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-11T07:30:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 45 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 119 k 2023-05-11T07:30:36.779 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-11T07:30:36.780 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-11T07:30:36.781 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-11T07:30:36.782 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-11T07:30:36.782 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-11T07:30:36.782 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-11T07:30:36.782 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-11T07:30:36.782 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-11T07:30:36.783 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-11T07:30:36.784 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-11T07:30:36.785 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-11T07:30:36.786 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql 10 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================================ 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout:Install 128 Packages 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 5 Packages 2023-05-11T07:30:36.787 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:30:36.788 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 197 M 2023-05-11T07:30:36.788 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-05-11T07:30:36.866 INFO:teuthology.orchestra.run.smithi145.stdout:(128/133): librados2-18.0.0-3879.ge28f4bf0.el8. 3.3 MB/s | 3.7 MB 00:01 2023-05-11T07:30:36.991 INFO:teuthology.orchestra.run.smithi145.stdout:(129/133): librbd1-18.0.0-3879.ge28f4bf0.el8.x8 2.9 MB/s | 3.6 MB 00:01 2023-05-11T07:30:37.033 INFO:teuthology.orchestra.run.smithi145.stdout:(130/133): elfutils-debuginfod-client-0.189-2.e 455 kB/s | 76 kB 00:00 2023-05-11T07:30:37.142 INFO:teuthology.orchestra.run.smithi145.stdout:(131/133): elfutils-libs-0.189-2.el8.x86_64.rpm 2.7 MB/s | 302 kB 00:00 2023-05-11T07:30:37.167 INFO:teuthology.orchestra.run.smithi145.stdout:(132/133): elfutils-libelf-0.189-2.el8.x86_64.r 1.3 MB/s | 232 kB 00:00 2023-05-11T07:30:37.568 INFO:teuthology.orchestra.run.smithi144.stdout:(1/133): ceph-18.0.0-3879.ge28f4bf0.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-05-11T07:30:37.876 INFO:teuthology.orchestra.run.smithi145.stdout:(133/133): thrift-0.13.0-2.el8.x86_64.rpm 819 kB/s | 1.7 MB 00:02 2023-05-11T07:30:37.881 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2023-05-11T07:30:37.882 INFO:teuthology.orchestra.run.smithi145.stdout:Total 15 MB/s | 197 MB 00:13 2023-05-11T07:30:38.218 INFO:teuthology.orchestra.run.smithi144.stdout:(2/133): ceph-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.3 MB/s | 847 kB 00:00 2023-05-11T07:30:38.326 INFO:teuthology.orchestra.run.smithi144.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 1.5 MB/s | 165 kB 00:00 2023-05-11T07:30:39.001 INFO:teuthology.orchestra.run.smithi144.stdout:(4/133): ceph-mds-18.0.0-3879.ge28f4bf0.el8.x86 3.4 MB/s | 2.3 MB 00:00 2023-05-11T07:30:39.085 INFO:teuthology.orchestra.run.smithi144.stdout:(5/133): ceph-base-18.0.0-3879.ge28f4bf0.el8.x8 3.0 MB/s | 5.3 MB 00:01 2023-05-11T07:30:39.275 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2023-05-11T07:30:39.460 INFO:teuthology.orchestra.run.smithi144.stdout:(6/133): ceph-mgr-18.0.0-3879.ge28f4bf0.el8.x86 3.4 MB/s | 1.5 MB 00:00 2023-05-11T07:30:39.532 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2023-05-11T07:30:39.533 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2023-05-11T07:30:39.944 INFO:teuthology.orchestra.run.smithi144.stdout:(7/133): ceph-mon-18.0.0-3879.ge28f4bf0.el8.x86 5.4 MB/s | 4.6 MB 00:00 2023-05-11T07:30:40.169 INFO:teuthology.orchestra.run.smithi144.stdout:(8/133): ceph-common-18.0.0-3879.ge28f4bf0.el8. 7.6 MB/s | 22 MB 00:02 2023-05-11T07:30:40.228 INFO:teuthology.orchestra.run.smithi144.stdout:(9/133): ceph-selinux-18.0.0-3879.ge28f4bf0.el8 419 kB/s | 24 kB 00:00 2023-05-11T07:30:41.231 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2023-05-11T07:30:41.234 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2023-05-11T07:30:42.261 INFO:teuthology.orchestra.run.smithi144.stdout:(10/133): ceph-radosgw-18.0.0-3879.ge28f4bf0.el 5.6 MB/s | 13 MB 00:02 2023-05-11T07:30:42.428 INFO:teuthology.orchestra.run.smithi144.stdout:(11/133): cephfs-mirror-18.0.0-3879.ge28f4bf0.e 1.5 MB/s | 258 kB 00:00 2023-05-11T07:30:42.520 INFO:teuthology.orchestra.run.smithi144.stdout:(12/133): libcephfs-devel-18.0.0-3879.ge28f4bf0 338 kB/s | 31 kB 00:00 2023-05-11T07:30:42.712 INFO:teuthology.orchestra.run.smithi144.stdout:(13/133): libcephfs2-18.0.0-3879.ge28f4bf0.el8. 3.9 MB/s | 771 kB 00:00 2023-05-11T07:30:42.812 INFO:teuthology.orchestra.run.smithi144.stdout:(14/133): libcephsqlite-18.0.0-3879.ge28f4bf0.e 1.3 MB/s | 137 kB 00:00 2023-05-11T07:30:42.912 INFO:teuthology.orchestra.run.smithi144.stdout:(15/133): librados-devel-18.0.0-3879.ge28f4bf0. 1.4 MB/s | 139 kB 00:00 2023-05-11T07:30:43.029 INFO:teuthology.orchestra.run.smithi144.stdout:(16/133): libradosstriper1-18.0.0-3879.ge28f4bf 4.0 MB/s | 473 kB 00:00 2023-05-11T07:30:43.696 INFO:teuthology.orchestra.run.smithi144.stdout:(17/133): ceph-osd-18.0.0-3879.ge28f4bf0.el8.x8 4.2 MB/s | 18 MB 00:04 2023-05-11T07:30:44.088 INFO:teuthology.orchestra.run.smithi144.stdout:(18/133): ceph-test-18.0.0-3879.ge28f4bf0.el8.x 11 MB/s | 41 MB 00:03 2023-05-11T07:30:44.105 INFO:teuthology.orchestra.run.smithi144.stdout:(19/133): python3-ceph-argparse-18.0.0-3879.ge2 109 kB/s | 45 kB 00:00 2023-05-11T07:30:44.147 INFO:teuthology.orchestra.run.smithi144.stdout:(20/133): python3-ceph-common-18.0.0-3879.ge28f 2.0 MB/s | 119 kB 00:00 2023-05-11T07:30:44.173 INFO:teuthology.orchestra.run.smithi144.stdout:(21/133): python3-cephfs-18.0.0-3879.ge28f4bf0. 2.9 MB/s | 197 kB 00:00 2023-05-11T07:30:44.273 INFO:teuthology.orchestra.run.smithi144.stdout:(22/133): librgw2-18.0.0-3879.ge28f4bf0.el8.x86 5.2 MB/s | 6.5 MB 00:01 2023-05-11T07:30:44.298 INFO:teuthology.orchestra.run.smithi144.stdout:(23/133): python3-rados-18.0.0-3879.ge28f4bf0.e 2.4 MB/s | 370 kB 00:00 2023-05-11T07:30:44.323 INFO:teuthology.orchestra.run.smithi144.stdout:(24/133): python3-rgw-18.0.0-3879.ge28f4bf0.el8 2.1 MB/s | 107 kB 00:00 2023-05-11T07:30:44.340 INFO:teuthology.orchestra.run.smithi144.stdout:(25/133): rbd-fuse-18.0.0-3879.ge28f4bf0.el8.x8 2.2 MB/s | 95 kB 00:00 2023-05-11T07:30:44.374 INFO:teuthology.orchestra.run.smithi144.stdout:(26/133): python3-rbd-18.0.0-3879.ge28f4bf0.el8 1.8 MB/s | 364 kB 00:00 2023-05-11T07:30:44.399 INFO:teuthology.orchestra.run.smithi144.stdout:(27/133): rbd-nbd-18.0.0-3879.ge28f4bf0.el8.x86 3.0 MB/s | 179 kB 00:00 2023-05-11T07:30:44.433 INFO:teuthology.orchestra.run.smithi144.stdout:(28/133): ceph-grafana-dashboards-18.0.0-3879.g 395 kB/s | 23 kB 00:00 2023-05-11T07:30:44.467 INFO:teuthology.orchestra.run.smithi144.stdout:(29/133): ceph-mgr-cephadm-18.0.0-3879.ge28f4bf 1.9 MB/s | 127 kB 00:00 2023-05-11T07:30:44.809 INFO:teuthology.orchestra.run.smithi144.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3879.ge28f4 4.6 MB/s | 1.7 MB 00:00 2023-05-11T07:30:44.867 INFO:teuthology.orchestra.run.smithi144.stdout:(31/133): rbd-mirror-18.0.0-3879.ge28f4bf0.el8. 6.3 MB/s | 3.4 MB 00:00 2023-05-11T07:30:44.892 INFO:teuthology.orchestra.run.smithi144.stdout:(32/133): ceph-mgr-modules-core-18.0.0-3879.ge2 2.8 MB/s | 240 kB 00:00 2023-05-11T07:30:44.934 INFO:teuthology.orchestra.run.smithi144.stdout:(33/133): ceph-mgr-rook-18.0.0-3879.ge28f4bf0.e 712 kB/s | 47 kB 00:00 2023-05-11T07:30:44.951 INFO:teuthology.orchestra.run.smithi144.stdout:(34/133): ceph-prometheus-alerts-18.0.0-3879.ge 248 kB/s | 15 kB 00:00 2023-05-11T07:30:45.018 INFO:teuthology.orchestra.run.smithi144.stdout:(35/133): ceph-volume-18.0.0-3879.ge28f4bf0.el8 3.1 MB/s | 265 kB 00:00 2023-05-11T07:30:45.043 INFO:teuthology.orchestra.run.smithi144.stdout:(36/133): cephadm-18.0.0-3879.ge28f4bf0.el8.noa 909 kB/s | 83 kB 00:00 2023-05-11T07:30:45.085 INFO:teuthology.orchestra.run.smithi144.stdout:(37/133): cephfs-top-18.0.0-3879.ge28f4bf0.el8. 269 kB/s | 18 kB 00:00 2023-05-11T07:30:45.185 INFO:teuthology.orchestra.run.smithi144.stdout:(38/133): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-05-11T07:30:45.294 INFO:teuthology.orchestra.run.smithi144.stdout:(39/133): automake-1.16.1-7.el8.noarch.rpm 2.8 MB/s | 713 kB 00:00 2023-05-11T07:30:45.319 INFO:teuthology.orchestra.run.smithi144.stdout:(40/133): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-05-11T07:30:45.353 INFO:teuthology.orchestra.run.smithi144.stdout:(41/133): bison-3.0.4-10.el8.x86_64.rpm 2.5 MB/s | 688 kB 00:00 2023-05-11T07:30:45.378 INFO:teuthology.orchestra.run.smithi144.stdout:(42/133): jq-1.6-7.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-05-11T07:30:45.403 INFO:teuthology.orchestra.run.smithi144.stdout:(43/133): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-05-11T07:30:45.429 INFO:teuthology.orchestra.run.smithi144.stdout:(44/133): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-05-11T07:30:45.454 INFO:teuthology.orchestra.run.smithi144.stdout:(45/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-05-11T07:30:45.479 INFO:teuthology.orchestra.run.smithi144.stdout:(46/133): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-05-11T07:30:45.504 INFO:teuthology.orchestra.run.smithi144.stdout:(47/133): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-05-11T07:30:45.605 INFO:teuthology.orchestra.run.smithi144.stdout:(48/133): postgresql-10.23-1.module_el8+300+2c5 16 MB/s | 1.6 MB 00:00 2023-05-11T07:30:45.847 INFO:teuthology.orchestra.run.smithi144.stdout:(49/133): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-05-11T07:30:45.881 INFO:teuthology.orchestra.run.smithi144.stdout:(50/133): postgresql-contrib-10.23-1.module_el8 3.2 MB/s | 903 kB 00:00 2023-05-11T07:30:45.948 INFO:teuthology.orchestra.run.smithi144.stdout:(51/133): openblas-threads-0.3.15-4.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2023-05-11T07:30:46.007 INFO:teuthology.orchestra.run.smithi144.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-05-11T07:30:46.049 INFO:teuthology.orchestra.run.smithi144.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-05-11T07:30:46.132 INFO:teuthology.orchestra.run.smithi144.stdout:(54/133): postgresql-server-10.23-1.module_el8+ 18 MB/s | 5.1 MB 00:00 2023-05-11T07:30:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:(55/133): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-05-11T07:30:46.183 INFO:teuthology.orchestra.run.smithi144.stdout:(56/133): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-05-11T07:30:46.208 INFO:teuthology.orchestra.run.smithi144.stdout:(57/133): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-05-11T07:30:46.292 INFO:teuthology.orchestra.run.smithi144.stdout:(58/133): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-05-11T07:30:46.295 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2023-05-11T07:30:46.317 INFO:teuthology.orchestra.run.smithi144.stdout:(59/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-05-11T07:30:46.342 INFO:teuthology.orchestra.run.smithi144.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 881 kB/s | 44 kB 00:00 2023-05-11T07:30:46.368 INFO:teuthology.orchestra.run.smithi144.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-05-11T07:30:46.393 INFO:teuthology.orchestra.run.smithi144.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-05-11T07:30:46.418 INFO:teuthology.orchestra.run.smithi144.stdout:(63/133): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-05-11T07:30:46.435 INFO:teuthology.orchestra.run.smithi144.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-11T07:30:46.503 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-11T07:30:46.510 INFO:teuthology.orchestra.run.smithi144.stdout:(65/133): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-05-11T07:30:46.544 INFO:teuthology.orchestra.run.smithi144.stdout:(66/133): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-05-11T07:30:46.569 INFO:teuthology.orchestra.run.smithi144.stdout:(67/133): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-05-11T07:30:46.594 INFO:teuthology.orchestra.run.smithi144.stdout:(68/133): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-05-11T07:30:46.620 INFO:teuthology.orchestra.run.smithi144.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-05-11T07:30:46.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-11T07:30:46.862 INFO:teuthology.orchestra.run.smithi144.stdout:(70/133): python3-scipy-1.0.0-21.module_el8.5.0 31 MB/s | 14 MB 00:00 2023-05-11T07:30:46.887 INFO:teuthology.orchestra.run.smithi144.stdout:(71/133): elfutils-libelf-devel-0.189-2.el8.x86 210 kB/s | 61 kB 00:00 2023-05-11T07:30:46.912 INFO:teuthology.orchestra.run.smithi144.stdout:(72/133): fuse-2.9.7-17.el8.x86_64.rpm 284 kB/s | 83 kB 00:00 2023-05-11T07:30:46.928 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-11T07:30:46.979 INFO:teuthology.orchestra.run.smithi144.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-05-11T07:30:47.029 INFO:teuthology.orchestra.run.smithi144.stdout:(74/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 287 kB/s | 48 kB 00:00 2023-05-11T07:30:47.055 INFO:teuthology.orchestra.run.smithi144.stdout:(75/133): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2023-05-11T07:30:47.088 INFO:teuthology.orchestra.run.smithi144.stdout:(76/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.7 MB/s | 561 kB 00:00 2023-05-11T07:30:47.111 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T07:30:47.139 INFO:teuthology.orchestra.run.smithi144.stdout:(77/133): libquadmath-8.5.0-19.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2023-05-11T07:30:47.164 INFO:teuthology.orchestra.run.smithi144.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 619 kB/s | 47 kB 00:00 2023-05-11T07:30:47.198 INFO:teuthology.orchestra.run.smithi144.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-05-11T07:30:47.214 INFO:teuthology.orchestra.run.smithi144.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-11T07:30:47.248 INFO:teuthology.orchestra.run.smithi144.stdout:(81/133): libgfortran-8.5.0-19.el8.x86_64.rpm 2.9 MB/s | 645 kB 00:00 2023-05-11T07:30:47.273 INFO:teuthology.orchestra.run.smithi144.stdout:(82/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 307 kB/s | 18 kB 00:00 2023-05-11T07:30:47.299 INFO:teuthology.orchestra.run.smithi144.stdout:(83/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 984 kB/s | 99 kB 00:00 2023-05-11T07:30:47.324 INFO:teuthology.orchestra.run.smithi144.stdout:(84/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 580 kB/s | 44 kB 00:00 2023-05-11T07:30:47.382 INFO:teuthology.orchestra.run.smithi144.stdout:(85/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.9 MB/s | 229 kB 00:00 2023-05-11T07:30:47.424 INFO:teuthology.orchestra.run.smithi144.stdout:(86/133): pcre2-devel-10.32-3.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-05-11T07:30:47.450 INFO:teuthology.orchestra.run.smithi144.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-05-11T07:30:47.483 INFO:teuthology.orchestra.run.smithi144.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 237 kB 00:00 2023-05-11T07:30:47.534 INFO:teuthology.orchestra.run.smithi144.stdout:(89/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-05-11T07:30:47.550 INFO:teuthology.orchestra.run.smithi144.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 639 kB/s | 43 kB 00:00 2023-05-11T07:30:47.580 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T07:30:47.584 INFO:teuthology.orchestra.run.smithi144.stdout:(91/133): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-05-11T07:30:47.601 INFO:teuthology.orchestra.run.smithi144.stdout:(92/133): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-05-11T07:30:47.627 INFO:teuthology.orchestra.run.smithi144.stdout:(93/133): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-05-11T07:30:47.643 INFO:teuthology.orchestra.run.smithi144.stdout:(94/133): python3-requests-oauthlib-1.0.0-1.el8 727 kB/s | 43 kB 00:00 2023-05-11T07:30:47.669 INFO:teuthology.orchestra.run.smithi144.stdout:(95/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.1 MB/s | 72 kB 00:00 2023-05-11T07:30:47.685 INFO:teuthology.orchestra.run.smithi144.stdout:(96/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 987 kB/s | 58 kB 00:00 2023-05-11T07:30:47.778 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T07:30:48.214 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T07:30:48.411 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:30:48.539 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:30:48.762 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:30:48.861 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:30:49.088 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T07:30:49.253 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T07:30:49.383 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T07:30:49.600 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-11T07:30:49.861 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-11T07:30:50.115 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-11T07:30:50.588 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-11T07:30:50.824 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-11T07:30:50.969 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:30:51.095 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:30:51.261 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T07:30:51.400 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T07:30:51.803 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-11T07:30:51.998 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-11T07:30:52.153 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T07:30:52.323 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T07:30:52.502 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T07:30:53.168 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T07:30:53.361 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T07:30:54.059 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T07:30:54.185 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T07:30:55.003 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T07:30:55.371 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-11T07:30:55.587 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-11T07:30:55.768 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-11T07:30:56.012 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-11T07:30:56.210 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 27/138 2023-05-11T07:30:56.357 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 28/138 2023-05-11T07:30:56.593 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 29/138 2023-05-11T07:30:57.992 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-11T07:30:58.358 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-11T07:30:58.671 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-11T07:30:58.868 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T07:31:00.960 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T07:31:01.263 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-11T07:31:01.451 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-11T07:31:01.674 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-11T07:31:01.863 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-11T07:31:02.055 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-11T07:31:02.250 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 39/138 2023-05-11T07:31:02.411 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 40/138 2023-05-11T07:31:02.593 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-11T07:31:02.830 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-11T07:31:03.076 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-11T07:31:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-11T07:31:03.422 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-11T07:31:03.606 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-11T07:31:03.841 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-11T07:31:04.056 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-11T07:31:04.237 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-11T07:31:04.382 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-11T07:31:04.564 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-11T07:31:04.749 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-11T07:31:04.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-11T07:31:05.097 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-11T07:31:05.329 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-11T07:31:05.590 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-11T07:31:05.800 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-11T07:31:06.172 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-11T07:31:06.436 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-11T07:31:06.638 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-11T07:31:07.474 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-11T07:31:07.675 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T07:31:07.747 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T07:31:07.976 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 63/138 2023-05-11T07:31:08.228 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-11T07:31:08.647 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-11T07:31:08.907 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-11T07:31:09.114 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-11T07:31:09.370 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-11T07:31:09.651 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-11T07:31:10.948 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-11T07:31:11.384 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-11T07:31:11.592 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-11T07:31:11.837 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-11T07:31:12.139 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-11T07:31:12.385 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-11T07:31:12.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-11T07:31:12.867 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-11T07:31:13.208 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-11T07:31:13.405 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-11T07:31:13.585 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-11T07:31:13.750 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-11T07:31:13.978 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T07:31:14.330 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-11T07:31:14.570 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-11T07:31:14.722 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-11T07:31:14.963 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-11T07:31:15.176 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-11T07:31:15.368 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-11T07:31:15.552 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-11T07:31:15.698 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T07:31:15.825 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T07:31:16.042 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-11T07:31:16.198 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-11T07:31:19.174 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:31:19.443 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:31:20.115 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:31:20.427 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T07:31:20.555 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T07:31:20.806 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T07:31:41.122 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /run 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2023-05-11T07:31:41.123 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2023-05-11T07:31:41.124 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2023-05-11T07:31:41.124 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2023-05-11T07:31:41.124 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:31:41.561 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T07:31:43.284 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T07:31:43.498 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T07:31:43.760 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T07:31:43.961 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T07:31:44.477 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T07:31:44.693 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T07:31:44.738 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T07:31:44.943 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-11T07:31:45.215 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-11T07:31:45.359 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T07:31:45.440 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T07:31:45.735 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-11T07:31:45.968 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-11T07:31:46.573 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T07:31:46.742 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T07:31:46.884 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 106/138 2023-05-11T07:31:47.088 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 107/138 2023-05-11T07:31:47.309 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T07:31:47.561 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T07:31:47.788 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T07:31:48.891 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T07:31:49.060 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T07:31:49.181 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T07:31:49.554 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 111/138 2023-05-11T07:31:49.797 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T07:31:49.857 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T07:31:50.017 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T07:31:50.041 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T07:31:50.261 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 114/138 2023-05-11T07:31:50.433 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T07:31:54.696 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T07:31:56.240 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 116/138 2023-05-11T07:31:56.445 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T07:31:56.503 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T07:31:56.691 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T07:31:56.757 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T07:31:56.949 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T07:31:57.351 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T07:31:57.549 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T07:31:57.829 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T07:31:58.120 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-11T07:31:59.336 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 122/138 2023-05-11T07:31:59.637 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-11T07:31:59.812 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-11T07:31:59.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-11T07:32:00.166 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 126/138 2023-05-11T07:32:01.361 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:32:01.615 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:32:01.648 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:32:01.849 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 128/138 2023-05-11T07:32:02.091 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T07:32:02.267 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 130/138 2023-05-11T07:32:02.467 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-11T07:32:02.706 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T07:32:02.816 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T07:32:03.056 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T07:32:03.080 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T07:32:03.233 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T07:32:03.405 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-11T07:32:03.405 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T07:32:03.629 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T07:32:03.630 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T07:32:03.867 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T07:32:04.049 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T07:32:04.260 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T07:32:04.260 INFO:teuthology.orchestra.run.smithi145.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-11T07:32:04.261 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:32:04.967 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 1/138 2023-05-11T07:32:04.968 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2/138 2023-05-11T07:32:04.968 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 3/138 2023-05-11T07:32:04.968 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 4/138 2023-05-11T07:32:04.968 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 5/138 2023-05-11T07:32:04.968 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 9/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 10/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 11/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 12/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 13/138 2023-05-11T07:32:04.969 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 14/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 16/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 17/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 18/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 19/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 20/138 2023-05-11T07:32:04.970 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 21/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 22/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 23/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 24/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 25/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 26/138 2023-05-11T07:32:04.971 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 27/138 2023-05-11T07:32:04.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 28/138 2023-05-11T07:32:04.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 29/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 30/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 31/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 32/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 33/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 34/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 35/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 36/138 2023-05-11T07:32:04.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 37/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 38/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-11T07:32:04.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-11T07:32:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-11T07:32:04.982 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-11T07:32:04.983 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-11T07:32:04.984 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-11T07:32:04.985 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-11T07:32:04.986 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-11T07:32:04.987 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-11T07:32:04.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-11T07:32:04.989 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-11T07:32:04.990 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-11T07:32:04.991 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T07:32:04.992 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 131/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-11T07:32:04.993 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-11T07:32:07.023 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-11T07:32:07.024 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.1-7.el8.noarch 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.0.4-10.el8.x86_64 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.025 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.028 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.1-9.el8.x86_64 2023-05-11T07:32:07.029 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-11T07:32:07.030 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-11T07:32:07.030 INFO:teuthology.orchestra.run.smithi145.stdout: jq-1.6-7.el8.x86_64 2023-05-11T07:32:07.030 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-11T07:32:07.030 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-11T07:32:07.030 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-11T07:32:07.031 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: libpq-13.5-1.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-11T07:32:07.032 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-11T07:32:07.033 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-11T07:32:07.034 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-11T07:32:07.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-11T07:32:07.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-11T07:32:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-11T07:32:07.038 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-2.6-1.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-11T07:32:07.039 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-11T07:32:07.040 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-11T07:32:07.041 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-11T07:32:07.042 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-11T07:32:07.043 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-11T07:32:07.044 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-11T07:32:07.044 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:32:07.044 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2023-05-11T07:32:07.263 DEBUG:teuthology.parallel:result is None 2023-05-11T07:32:59.290 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-11T07:32:59.290 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-11T07:32:59.294 INFO:teuthology.orchestra.run.smithi144.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-11T07:32:59.781 INFO:teuthology.orchestra.run.smithi144.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 455 B/s | 59 kB 02:12 2023-05-11T07:32:59.806 INFO:teuthology.orchestra.run.smithi144.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 581 B/s | 75 kB 02:12 2023-05-11T07:32:59.932 INFO:teuthology.orchestra.run.smithi144.stdout:(99/133): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:12 2023-05-11T07:32:59.958 INFO:teuthology.orchestra.run.smithi144.stdout:(100/133): python3-bcrypt-3.1.6-2.el8.1.x86_64. 289 kB/s | 44 kB 00:00 2023-05-11T07:33:00.066 INFO:teuthology.orchestra.run.smithi144.stdout:(101/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.4 MB/s | 185 kB 00:00 2023-05-11T07:33:00.091 INFO:teuthology.orchestra.run.smithi144.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 247 kB/s | 33 kB 00:00 2023-05-11T07:33:00.141 INFO:teuthology.orchestra.run.smithi144.stdout:(103/133): python3-asyncssh-2.7.0-2.el8.noarch. 1.3 MB/s | 476 kB 00:00 2023-05-11T07:33:00.167 INFO:teuthology.orchestra.run.smithi144.stdout:(104/133): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-05-11T07:33:00.292 INFO:teuthology.orchestra.run.smithi144.stdout:(105/133): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2023-05-11T07:33:00.317 INFO:teuthology.orchestra.run.smithi144.stdout:(106/133): python3-cheroot-8.5.2-1.el8.noarch.r 764 kB/s | 173 kB 00:00 2023-05-11T07:33:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:(107/133): python3-google-auth-1.1.1-10.el8.noa 462 kB/s | 81 kB 00:00 2023-05-11T07:33:00.426 INFO:teuthology.orchestra.run.smithi144.stdout:(108/133): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-05-11T07:33:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:(109/133): python3-jaraco-functools-2.0-4.el8.n 124 kB/s | 18 kB 00:00 2023-05-11T07:33:00.535 INFO:teuthology.orchestra.run.smithi144.stdout:(110/133): python3-logutils-0.3.5-11.el8.noarch 449 kB/s | 49 kB 00:00 2023-05-11T07:33:00.577 INFO:teuthology.orchestra.run.smithi144.stdout:(111/133): python3-more-itertools-7.2.0-3.el8.n 503 kB/s | 59 kB 00:00 2023-05-11T07:33:00.644 INFO:teuthology.orchestra.run.smithi144.stdout:(112/133): python3-kubernetes-11.0.0-6.el8.noar 3.9 MB/s | 1.2 MB 00:00 2023-05-11T07:33:00.677 INFO:teuthology.orchestra.run.smithi144.stdout:(113/133): python3-natsort-7.1.1-2.el8.noarch.r 424 kB/s | 60 kB 00:00 2023-05-11T07:33:00.745 INFO:teuthology.orchestra.run.smithi144.stdout:(114/133): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-05-11T07:33:00.770 INFO:teuthology.orchestra.run.smithi144.stdout:(115/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-05-11T07:33:00.795 INFO:teuthology.orchestra.run.smithi144.stdout:(116/133): python3-repoze-lru-0.7-6.el8.noarch. 287 kB/s | 34 kB 00:00 2023-05-11T07:33:00.854 INFO:teuthology.orchestra.run.smithi144.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 1.8 MB/s | 196 kB 00:00 2023-05-11T07:33:00.879 INFO:teuthology.orchestra.run.smithi144.stdout:(118/133): python3-rsa-4.8-1.el8.noarch.rpm 564 kB/s | 61 kB 00:00 2023-05-11T07:33:00.904 INFO:teuthology.orchestra.run.smithi144.stdout:(119/133): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-05-11T07:33:00.954 INFO:teuthology.orchestra.run.smithi144.stdout:(120/133): python3-singledispatch-3.4.0.3-18.el 238 kB/s | 24 kB 00:00 2023-05-11T07:33:00.988 INFO:teuthology.orchestra.run.smithi144.stdout:(121/133): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-05-11T07:33:01.030 INFO:teuthology.orchestra.run.smithi144.stdout:(122/133): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-05-11T07:33:01.097 INFO:teuthology.orchestra.run.smithi144.stdout:(123/133): python3-waitress-1.2.1-2.el8.1.noarc 1.7 MB/s | 241 kB 00:00 2023-05-11T07:33:01.139 INFO:teuthology.orchestra.run.smithi144.stdout:(124/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-05-11T07:33:01.164 INFO:teuthology.orchestra.run.smithi144.stdout:(125/133): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2023-05-11T07:33:01.206 INFO:teuthology.orchestra.run.smithi144.stdout:(126/133): python3-webtest-2.0.33-1.el8.noarch. 785 kB/s | 85 kB 00:00 2023-05-11T07:33:01.248 INFO:teuthology.orchestra.run.smithi144.stdout:(127/133): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-05-11T07:33:01.473 INFO:teuthology.orchestra.run.smithi144.stdout:(128/133): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-05-11T07:33:01.624 INFO:teuthology.orchestra.run.smithi144.stdout:(129/133): elfutils-debuginfod-client-0.189-2.e 506 kB/s | 76 kB 00:00 2023-05-11T07:33:01.682 INFO:teuthology.orchestra.run.smithi144.stdout:(130/133): librados2-18.0.0-3879.ge28f4bf0.el8. 7.7 MB/s | 3.7 MB 00:00 2023-05-11T07:33:01.708 INFO:teuthology.orchestra.run.smithi144.stdout:(131/133): elfutils-libelf-0.189-2.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2023-05-11T07:33:01.775 INFO:teuthology.orchestra.run.smithi144.stdout:(132/133): librbd1-18.0.0-3879.ge28f4bf0.el8.x8 6.8 MB/s | 3.6 MB 00:00 2023-05-11T07:33:01.916 INFO:teuthology.orchestra.run.smithi144.stdout:(133/133): elfutils-libs-0.189-2.el8.x86_64.rpm 1.3 MB/s | 302 kB 00:00 2023-05-11T07:33:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-05-11T07:33:01.921 INFO:teuthology.orchestra.run.smithi144.stdout:Total 1.4 MB/s | 197 MB 02:25 2023-05-11T07:33:03.323 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-05-11T07:33:03.584 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-05-11T07:33:03.585 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-05-11T07:33:05.527 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-05-11T07:33:05.531 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-05-11T07:33:10.405 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-05-11T07:33:10.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-11T07:33:10.805 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-11T07:33:11.008 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-11T07:33:11.199 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T07:33:11.676 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T07:33:11.866 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T07:33:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T07:33:12.483 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:33:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:33:12.824 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:33:12.933 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:33:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T07:33:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T07:33:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T07:33:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-11T07:33:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-11T07:33:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-11T07:33:14.638 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-11T07:33:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-11T07:33:15.007 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:33:15.125 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:33:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T07:33:15.431 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T07:33:15.623 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-11T07:33:15.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-11T07:33:15.973 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T07:33:16.123 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T07:33:16.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T07:33:16.927 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T07:33:17.074 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T07:33:17.752 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T07:33:17.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T07:33:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T07:33:19.040 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-11T07:33:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-11T07:33:19.388 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-11T07:33:19.633 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-11T07:33:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 27/138 2023-05-11T07:33:19.962 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 28/138 2023-05-11T07:33:20.165 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 29/138 2023-05-11T07:33:21.254 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-11T07:33:21.621 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-11T07:33:21.892 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-11T07:33:22.039 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T07:33:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T07:33:24.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-11T07:33:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-11T07:33:24.848 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-11T07:33:25.024 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-11T07:33:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-11T07:33:25.414 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 39/138 2023-05-11T07:33:25.574 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 40/138 2023-05-11T07:33:25.756 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-11T07:33:26.003 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-11T07:33:26.255 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-11T07:33:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-11T07:33:26.569 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-11T07:33:26.763 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-11T07:33:26.998 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-11T07:33:27.213 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-11T07:33:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-11T07:33:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-11T07:33:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-11T07:33:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-11T07:33:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-11T07:33:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-11T07:33:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-11T07:33:28.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-11T07:33:28.996 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-11T07:33:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-11T07:33:29.624 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-11T07:33:29.818 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-11T07:33:30.694 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-11T07:33:30.929 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T07:33:31.025 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T07:33:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 63/138 2023-05-11T07:33:31.516 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-11T07:33:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-11T07:33:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-11T07:33:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-11T07:33:32.624 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-11T07:33:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-11T07:33:34.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-11T07:33:34.522 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-11T07:33:34.721 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-11T07:33:34.941 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-11T07:33:35.287 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-11T07:33:35.515 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-11T07:33:35.741 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-11T07:33:35.939 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-11T07:33:36.255 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-11T07:33:36.459 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-11T07:33:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-11T07:33:36.778 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-11T07:33:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T07:33:37.312 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-11T07:33:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-11T07:33:37.668 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-11T07:33:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-11T07:33:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-11T07:33:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-11T07:33:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-11T07:33:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T07:33:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T07:33:39.029 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-11T07:33:39.187 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-11T07:33:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:33:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:33:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T07:33:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T07:33:43.501 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T07:33:43.702 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T07:34:04.324 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-05-11T07:34:04.325 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-05-11T07:34:04.326 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-05-11T07:34:04.326 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-05-11T07:34:04.326 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:04.716 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T07:34:06.436 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T07:34:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T07:34:06.879 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T07:34:07.049 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T07:34:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T07:34:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T07:34:07.800 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T07:34:07.989 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-11T07:34:08.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-11T07:34:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T07:34:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T07:34:08.747 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-11T07:34:08.990 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-11T07:34:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T07:34:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T07:34:09.889 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 106/138 2023-05-11T07:34:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 107/138 2023-05-11T07:34:10.314 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T07:34:10.568 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T07:34:10.791 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T07:34:11.891 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T07:34:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T07:34:12.178 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T07:34:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 111/138 2023-05-11T07:34:12.791 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T07:34:12.851 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T07:34:13.006 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T07:34:13.028 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T07:34:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 114/138 2023-05-11T07:34:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T07:34:17.746 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T07:34:19.413 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 116/138 2023-05-11T07:34:19.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T07:34:19.672 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T07:34:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T07:34:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T07:34:20.088 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T07:34:20.490 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T07:34:20.663 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T07:34:20.935 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T07:34:21.208 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-11T07:34:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 122/138 2023-05-11T07:34:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-11T07:34:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-11T07:34:23.000 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-11T07:34:23.196 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 126/138 2023-05-11T07:34:24.351 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:34:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:34:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T07:34:24.829 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 128/138 2023-05-11T07:34:25.029 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T07:34:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 130/138 2023-05-11T07:34:25.410 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-11T07:34:25.670 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T07:34:25.776 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T07:34:25.977 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T07:34:26.001 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T07:34:26.188 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T07:34:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-11T07:34:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T07:34:26.576 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T07:34:26.576 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T07:34:26.806 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T07:34:26.979 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T07:34:27.155 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T07:34:27.156 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-11T07:34:27.156 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 1/138 2023-05-11T07:34:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2/138 2023-05-11T07:34:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 3/138 2023-05-11T07:34:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 4/138 2023-05-11T07:34:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 5/138 2023-05-11T07:34:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 9/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 10/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 11/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 12/138 2023-05-11T07:34:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 13/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 14/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 16/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 17/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 18/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 19/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 20/138 2023-05-11T07:34:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 21/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 22/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 23/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 24/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 25/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 26/138 2023-05-11T07:34:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 27/138 2023-05-11T07:34:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 28/138 2023-05-11T07:34:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 29/138 2023-05-11T07:34:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 30/138 2023-05-11T07:34:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 31/138 2023-05-11T07:34:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 32/138 2023-05-11T07:34:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 33/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 34/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 35/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 36/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 37/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 38/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-11T07:34:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-11T07:34:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-11T07:34:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-11T07:34:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-11T07:34:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-11T07:34:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-11T07:34:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-11T07:34:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-11T07:34:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-11T07:34:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-11T07:34:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-11T07:34:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T07:34:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 131/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-11T07:34:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-11T07:34:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-11T07:34:29.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:29.972 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-05-11T07:34:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-11T07:34:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-11T07:34:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-11T07:34:29.972 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.973 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.974 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.975 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-05-11T07:34:29.976 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-7.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.977 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: libpq-13.5-1.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-11T07:34:29.978 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-11T07:34:29.979 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-11T07:34:29.980 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:34:29.981 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.982 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-11T07:34:29.983 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-11T07:34:29.984 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-11T07:34:29.985 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-11T07:34:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-11T07:34:29.987 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-11T07:34:29.988 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T07:34:29.989 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-11T07:34:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-11T07:34:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-11T07:34:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-11T07:34:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-11T07:34:29.990 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-11T07:34:29.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:29.991 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-05-11T07:34:30.206 DEBUG:teuthology.parallel:result is None 2023-05-11T07:34:30.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T07:34:30.348 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-11T07:34:30.400 INFO:teuthology.orchestra.run.smithi144.stdout:18.0.0-3879.ge28f4bf0.el8 2023-05-11T07:34:30.401 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3879.ge28f4bf0.el8 2023-05-11T07:34:30.401 INFO:teuthology.task.install:The correct ceph version 18.0.0-3879.ge28f4bf0 is installed. 2023-05-11T07:34:30.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T07:34:30.538 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-11T07:34:30.595 INFO:teuthology.orchestra.run.smithi145.stdout:18.0.0-3879.ge28f4bf0.el8 2023-05-11T07:34:30.595 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3879.ge28f4bf0.el8 2023-05-11T07:34:30.596 INFO:teuthology.task.install:The correct ceph version 18.0.0-3879.ge28f4bf0 is installed. 2023-05-11T07:34:30.596 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-11T07:34:30.597 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:30.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-11T07:34:30.664 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:30.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-11T07:34:30.733 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-11T07:34:30.733 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:30.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-05-11T07:34:30.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-11T07:34:30.900 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:30.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2023-05-11T07:34:30.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-11T07:34:31.064 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-11T07:34:31.065 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:31.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-11T07:34:31.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-11T07:34:31.233 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:31.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-11T07:34:31.295 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-11T07:34:31.396 INFO:teuthology.run_tasks:Running task ceph... 2023-05-11T07:34:31.475 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-11T07:34:31.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-05-11T07:34:31.480 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2023-05-11T07:34:31.542 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-11T07:34:31.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-11T07:34:31.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-11T07:34:31.607 INFO:tasks.ceph:Creating extra log directories... 2023-05-11T07:34:31.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-11T07:34:31.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-11T07:34:31.683 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-11T07:34:31.684 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-11T07:34:31.684 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-11T07:34:31.684 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:31.685 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-11T07:34:31.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-11T07:34:31.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-11T07:34:31.991 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:31.992 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-11T07:34:32.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-11T07:34:32.254 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-11T07:34:32.321 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-11T07:34:32.321 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-11T07:34:32.321 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270901', 'branch': 'wip-vshankar-testing-20230509.090020', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7270901', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230509.090020'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230509.090020', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230509.090020', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlGhGs0SjxiMin4K5Sa6hP4Hi4shFui+YtO9U04w6W6jO4zBCcJgF46I5/0JxvQeYA9x2C4tGrU6URVC1gXhNI=', 'smithi145.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBLhZz8GTbAiU22rlzxooC3AZqgdTcWcYnox5Vetw2sI8LMvB8PUKFTuNvjqMnv/dSRZ70MCQ9faXn0IY1mbycGLXr4+zsNOhMwgDT6DG53AfoRs4cUvlZhYJiZR+xFSEE7K9RctenCxK/YNJ/Kg5/H4+kShene45bvu6LKK3c2jeeUBy48p6960yWRtWKR0koAeUo0ydjTNk4wW0IEZ3AWEX0nlWCxL24+ifY4M2aMsXWRiIi2vcg2O+9i+pWfIBHvKd8f6nRmdyUkiZ3eFdk9j/+eTjLf0iH1ozABKGZ18hMtxhLHrf/QZ1C02HaPwXQfQM9rvFkGaEa5q9sGyMU2QmktbEl2BqmKpAbYwpqDSU5odzWVMiYcGpwAs6QU5Ti/yd6q6quouxVW/N+rrHrisnZVws9bbNwj1voiURoFAFWQWSJWdfPDlzMt+QvCBDtxR49bAA2XQvNie2IpA62U5wAnbiJWXNovgSuaw6mF5T7qFNim7MB2W348N40SoE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-11_06:18:33', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-11T07:34:32.322 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-11T07:34:32.326 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-11T07:34:32.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-05-11T07:34:32.411 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2023-05-11T07:34:32.473 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:32.473 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-05-11T07:34:32.515 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-11T07:34:32.516 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-05-11T07:34:32.597 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-05-11 07:34:27.390490761 +0000 2023-05-11T07:34:32.598 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-05-11 07:29:14.646510486 +0000 2023-05-11T07:34:32.599 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-05-11 07:29:14.646510486 +0000 2023-05-11T07:34:32.599 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-05-11 07:29:14.620510904 +0000 2023-05-11T07:34:32.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-11T07:34:32.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-05-11T07:34:32.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-05-11T07:34:32.699 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00036515 s, 1.4 MB/s 2023-05-11T07:34:32.701 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-11T07:34:32.744 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-05-11T07:34:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-11T07:34:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:32.829 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-11T07:34:32.829 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:32.830 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:32.830 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-05-11 07:34:27.390490761 +0000 2023-05-11T07:34:32.830 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-05-11 07:29:15.436497796 +0000 2023-05-11T07:34:32.830 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-05-11 07:29:15.436497796 +0000 2023-05-11T07:34:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-05-11 07:29:15.414498149 +0000 2023-05-11T07:34:32.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-11T07:34:32.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-05-11T07:34:32.932 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-05-11T07:34:32.932 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000281307 s, 1.8 MB/s 2023-05-11T07:34:32.934 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-11T07:34:32.977 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-05-11T07:34:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-11T07:34:33.060 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:33.060 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-11T07:34:33.060 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:33.060 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:33.061 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-05-11 07:34:27.390490761 +0000 2023-05-11T07:34:33.061 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-05-11 07:29:16.249484735 +0000 2023-05-11T07:34:33.061 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-05-11 07:29:16.249484735 +0000 2023-05-11T07:34:33.061 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-05-11 07:29:16.223485152 +0000 2023-05-11T07:34:33.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-11T07:34:33.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-05-11T07:34:33.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-05-11T07:34:33.162 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00028693 s, 1.8 MB/s 2023-05-11T07:34:33.163 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-11T07:34:33.208 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-05-11T07:34:33.291 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-11T07:34:33.291 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-05-11 07:34:27.390490761 +0000 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-05-11 07:29:17.061471691 +0000 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-05-11 07:29:17.061471691 +0000 2023-05-11T07:34:33.292 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2023-05-11 07:29:17.039472044 +0000 2023-05-11T07:34:33.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-11T07:34:33.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-05-11T07:34:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-05-11T07:34:33.394 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000286949 s, 1.8 MB/s 2023-05-11T07:34:33.396 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-11T07:34:33.440 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:33.440 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:33.440 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2023-05-11T07:34:33.486 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-11T07:34:33.486 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2023-05-11T07:34:33.570 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-05-11 07:32:04.485258910 +0000 2023-05-11T07:34:33.571 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-05-11 07:29:14.640363786 +0000 2023-05-11T07:34:33.572 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-05-11 07:29:14.640363786 +0000 2023-05-11T07:34:33.572 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2023-05-11 07:29:14.615364311 +0000 2023-05-11T07:34:33.572 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-11T07:34:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-05-11T07:34:33.673 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-05-11T07:34:33.674 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000362397 s, 1.4 MB/s 2023-05-11T07:34:33.675 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-11T07:34:33.719 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2023-05-11T07:34:33.801 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-11T07:34:33.801 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:33.801 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-05-11T07:34:33.801 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:33.802 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:33.802 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-05-11 07:32:04.486258890 +0000 2023-05-11T07:34:33.802 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-05-11 07:29:15.443346913 +0000 2023-05-11T07:34:33.802 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-05-11 07:29:15.443346913 +0000 2023-05-11T07:34:33.802 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2023-05-11 07:29:15.419347417 +0000 2023-05-11T07:34:33.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-11T07:34:33.900 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-05-11T07:34:33.900 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-05-11T07:34:33.900 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000297493 s, 1.7 MB/s 2023-05-11T07:34:33.902 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-11T07:34:33.945 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2023-05-11T07:34:34.026 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-05-11 07:32:04.486258890 +0000 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-05-11 07:29:16.255329850 +0000 2023-05-11T07:34:34.027 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-05-11 07:29:16.255329850 +0000 2023-05-11T07:34:34.028 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2023-05-11 07:29:16.231330355 +0000 2023-05-11T07:34:34.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-11T07:34:34.126 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-05-11T07:34:34.126 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-05-11T07:34:34.126 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000297309 s, 1.7 MB/s 2023-05-11T07:34:34.128 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-11T07:34:34.171 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2023-05-11T07:34:34.252 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-11T07:34:34.252 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2023-05-11 07:32:04.486258890 +0000 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2023-05-11 07:29:17.066312809 +0000 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2023-05-11 07:29:17.066312809 +0000 2023-05-11T07:34:34.253 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2023-05-11 07:29:17.040313355 +0000 2023-05-11T07:34:34.254 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-11T07:34:34.351 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2023-05-11T07:34:34.352 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2023-05-11T07:34:34.352 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000290766 s, 1.8 MB/s 2023-05-11T07:34:34.354 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-11T07:34:34.395 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:34.396 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-11T07:34:34.396 INFO:tasks.ceph:Generating config... 2023-05-11T07:34:34.397 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-11T07:34:34.398 INFO:tasks.ceph:[client] debug client = 20 2023-05-11T07:34:34.398 INFO:tasks.ceph:[client] debug ms = 1 2023-05-11T07:34:34.398 INFO:tasks.ceph:[client] pid file = 2023-05-11T07:34:34.398 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-11T07:34:34.398 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-11T07:34:34.399 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-05-11T07:34:34.399 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-11T07:34:34.399 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-11T07:34:34.399 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-11T07:34:34.399 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-11T07:34:34.400 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-11T07:34:34.400 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-11T07:34:34.400 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-11T07:34:34.400 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-11T07:34:34.400 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-11T07:34:34.401 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-11T07:34:34.401 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-11T07:34:34.401 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-11T07:34:34.401 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-11T07:34:34.402 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-11T07:34:34.402 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-11T07:34:34.402 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-11T07:34:34.402 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-11T07:34:34.402 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-11T07:34:34.403 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-11T07:34:34.403 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-11T07:34:34.403 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-11T07:34:34.403 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-11T07:34:34.403 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-11T07:34:34.404 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-11T07:34:34.404 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-11T07:34:34.404 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-11T07:34:34.404 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-11T07:34:34.404 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-11T07:34:34.405 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-11T07:34:34.405 INFO:tasks.ceph:Setting up mon.a... 2023-05-11T07:34:34.405 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-11T07:34:34.505 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.keyring 2023-05-11T07:34:34.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-11T07:34:34.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T07:34:34.668 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.144'), ('mon.b', '172.21.15.145'), ('mon.c', '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]')] 2023-05-11T07:34:34.669 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.144,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-11T07:34:34.670 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:34.670 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-11T07:34:34.712 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.144 --add b 172.21.15.145 --addv c '[v2:172.21.15.145:3301,v1:172.21.15.145:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:34.842 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:34.842 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: generated fsid 424d6242-b269-485d-aca8-83f4424787ea 2023-05-11T07:34:34.842 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = pacific 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 0 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 424d6242-b269-485d-aca8-83f4424787ea 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:last_changed 2023-05-11T07:34:34.840320+0000 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:created 2023-05-11T07:34:34.840320+0000 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:min_mon_release 16 (pacific) 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:election_strategy: 1 2023-05-11T07:34:34.843 INFO:teuthology.orchestra.run.smithi144.stdout:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2023-05-11T07:34:34.844 INFO:teuthology.orchestra.run.smithi144.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2023-05-11T07:34:34.844 INFO:teuthology.orchestra.run.smithi144.stdout:2: [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] mon.c 2023-05-11T07:34:34.844 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-11T07:34:34.846 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-11T07:34:34.888 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 424d6242-b269-485d-aca8-83f4424787ea... 2023-05-11T07:34:34.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-11T07:34:34.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-11T07:34:35.037 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-05-11T07:34:35.037 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-05-11T07:34:35.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.039 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-05-11T07:34:35.040 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-05-11T07:34:35.041 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.042 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-05-11T07:34:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-05-11T07:34:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-05-11T07:34:35.043 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 424d6242-b269-485d-aca8-83f4424787ea 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-05-11T07:34:35.044 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.045 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-05-11T07:34:35.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-05-11T07:34:35.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-05-11T07:34:35.048 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-05-11T07:34:35.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-05-11T07:34:35.050 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-05-11T07:34:35.051 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.052 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-11T07:34:35.053 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:34:35.054 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-11T07:34:35.055 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-05-11T07:34:35.056 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2023-05-11T07:34:35.057 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-05-11T07:34:35.058 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-05-11T07:34:35.059 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-05-11T07:34:35.059 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2023-05-11T07:34:35.059 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2023-05-11T07:34:35.059 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.060 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2023-05-11T07:34:35.061 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2023-05-11T07:34:35.061 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.061 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2023-05-11T07:34:35.061 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2023-05-11T07:34:35.061 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.062 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2023-05-11T07:34:35.063 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2023-05-11T07:34:35.064 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-11T07:34:35.064 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-11T07:34:35.064 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2023-05-11T07:34:35.064 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.065 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-11T07:34:35.065 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.065 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2023-05-11T07:34:35.066 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.066 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2023-05-11T07:34:35.066 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.066 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2023-05-11T07:34:35.067 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2023-05-11T07:34:35.067 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2023-05-11T07:34:35.067 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.144,172.21.15.145,[v2:172.21.15.145:3301,v1:172.21.15.145:6790]" 2023-05-11T07:34:35.067 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on skipped message = False 2023-05-11T07:34:35.068 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 424d6242-b269-485d-aca8-83f4424787ea 2023-05-11T07:34:35.068 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.068 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2023-05-11T07:34:35.068 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2023-05-11T07:34:35.069 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.069 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2023-05-11T07:34:35.069 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2023-05-11T07:34:35.070 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.070 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2023-05-11T07:34:35.070 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2023-05-11T07:34:35.071 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.071 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2023-05-11T07:34:35.071 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2023-05-11T07:34:35.071 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2023-05-11T07:34:35.072 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.072 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2023-05-11T07:34:35.072 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2023-05-11T07:34:35.073 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.073 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2023-05-11T07:34:35.073 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.073 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2023-05-11T07:34:35.074 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.074 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2023-05-11T07:34:35.074 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.074 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2023-05-11T07:34:35.074 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2023-05-11T07:34:35.075 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.075 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2023-05-11T07:34:35.075 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2023-05-11T07:34:35.076 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2023-05-11T07:34:35.076 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2023-05-11T07:34:35.076 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2023-05-11T07:34:35.076 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2023-05-11T07:34:35.077 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2023-05-11T07:34:35.078 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-05-11T07:34:35.079 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2023-05-11T07:34:35.080 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2023-05-11T07:34:35.081 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2023-05-11T07:34:35.082 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2023-05-11T07:34:35.083 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = "" 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2023-05-11T07:34:35.084 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds balancer = 20 2023-05-11T07:34:35.085 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2023-05-11T07:34:35.086 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 900 2023-05-11T07:34:35.087 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 900 2023-05-11T07:34:35.088 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-11T07:34:35.088 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-11T07:34:35.197 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-11T07:34:35.198 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:35.198 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-11T07:34:35.238 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:35.239 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-11T07:34:35.318 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:34:35.318 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:35.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-11T07:34:35.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T07:34:35.442 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:34:35.442 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:35.522 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:34:35.522 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:35.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-11T07:34:35.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T07:34:35.610 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:34:35.610 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:35.691 INFO:tasks.ceph:Setting up mon nodes... 2023-05-11T07:34:35.691 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-11T07:34:35.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-11T07:34:35.803 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-11T07:34:35.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-11T07:34:35.933 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-11T07:34:35.939 INFO:tasks.ceph:Setting up mds nodes... 2023-05-11T07:34:35.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-11T07:34:36.049 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-11T07:34:36.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-11T07:34:36.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-11T07:34:36.228 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-11T07:34:36.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-11T07:34:36.295 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-11T07:34:36.407 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-11T07:34:36.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-11T07:34:36.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-11T07:34:36.585 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-11T07:34:36.590 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-11T07:34:36.651 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-11T07:34:36.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-11T07:34:36.740 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-11T07:34:36.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-11T07:34:36.855 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-11T07:34:36.882 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-11T07:34:36.972 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-11T07:34:36.999 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-11T07:34:37.086 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-11T07:34:37.114 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-11T07:34:37.114 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-11T07:34:37.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-11T07:34:37.176 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:37.177 INFO:tasks.ceph:role: osd.0 2023-05-11T07:34:37.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:34:37.177 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-11T07:34:37.246 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:37.246 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:37.246 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:37.247 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:37.669 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-05-11T07:34:37.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-05-11T07:34:37.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-11T07:34:37.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-11T07:34:37.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-11T07:34:37.996 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:37.997 INFO:tasks.ceph:role: osd.1 2023-05-11T07:34:37.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:34:37.997 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-11T07:34:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:38.474 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-05-11T07:34:38.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-05-11T07:34:38.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-11T07:34:38.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-11T07:34:38.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-11T07:34:38.731 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:38.732 INFO:tasks.ceph:role: osd.2 2023-05-11T07:34:38.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:34:38.732 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-11T07:34:38.800 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:38.801 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:38.802 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:38.802 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:38.802 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:39.250 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-05-11T07:34:39.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-05-11T07:34:39.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-11T07:34:39.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-11T07:34:39.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-11T07:34:39.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:39.543 INFO:tasks.ceph:role: osd.3 2023-05-11T07:34:39.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:34:39.543 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-11T07:34:39.613 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:39.613 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:39.613 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:39.613 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:39.614 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:40.054 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-05-11T07:34:40.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-05-11T07:34:40.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-11T07:34:40.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-11T07:34:40.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:40.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.436+0000 7fdb1325e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-11T07:34:40.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.437+0000 7fdb1325e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-11T07:34:40.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.437+0000 7fdb1325e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T07:34:40.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.437+0000 7fdb1325e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T07:34:40.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.437+0000 7fdb1325e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T07:34:40.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:40.439+0000 7fdb1325e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-11T07:34:43.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-11T07:34:43.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:43.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.482+0000 7f79f6ccf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-11T07:34:43.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.483+0000 7f79f6ccf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-11T07:34:43.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.483+0000 7f79f6ccf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T07:34:43.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.483+0000 7f79f6ccf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T07:34:43.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.483+0000 7f79f6ccf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T07:34:43.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:43.484+0000 7f79f6ccf640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-11T07:34:46.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-11T07:34:46.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:46.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.530+0000 7fb2e9e18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-11T07:34:46.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.531+0000 7fb2e9e18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-11T07:34:46.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.531+0000 7fb2e9e18640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T07:34:46.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.531+0000 7fb2e9e18640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T07:34:46.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.531+0000 7fb2e9e18640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T07:34:46.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:46.533+0000 7fb2e9e18640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-11T07:34:49.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-11T07:34:49.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.587+0000 7f07f3c01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-11T07:34:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.587+0000 7f07f3c01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-11T07:34:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.587+0000 7f07f3c01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T07:34:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.587+0000 7f07f3c01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T07:34:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.587+0000 7f07f3c01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T07:34:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:34:49.589+0000 7f07f3c01640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-11T07:34:52.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-11T07:34:52.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-11T07:34:52.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:52.606 INFO:tasks.ceph:role: osd.4 2023-05-11T07:34:52.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:34:52.607 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-11T07:34:52.678 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:52.678 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:52.678 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:52.678 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:52.679 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:53.108 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2023-05-11T07:34:53.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-05-11T07:34:53.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-11T07:34:53.288 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-11T07:34:53.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-11T07:34:53.422 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:53.423 INFO:tasks.ceph:role: osd.5 2023-05-11T07:34:53.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:34:53.423 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-11T07:34:53.492 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:53.492 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:53.492 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:53.492 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:53.493 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:53.900 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2023-05-11T07:34:53.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-05-11T07:34:53.904 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-11T07:34:54.029 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-11T07:34:54.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-11T07:34:54.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:54.159 INFO:tasks.ceph:role: osd.6 2023-05-11T07:34:54.160 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:34:54.160 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-11T07:34:54.228 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:54.229 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:54.230 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:54.230 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:54.230 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:54.671 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2023-05-11T07:34:54.675 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-05-11T07:34:54.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-11T07:34:54.832 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-11T07:34:54.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-11T07:34:54.964 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T07:34:54.964 INFO:tasks.ceph:role: osd.7 2023-05-11T07:34:54.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:34:54.965 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-11T07:34:55.034 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T07:34:55.035 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T07:34:55.035 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T07:34:55.035 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T07:34:55.036 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T07:34:55.036 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2023-05-11T07:34:55.036 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T07:34:55.036 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T07:34:55.037 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T07:34:55.037 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T07:34:55.470 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2023-05-11T07:34:55.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2023-05-11T07:34:55.473 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-11T07:34:55.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-11T07:34:55.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:55.821 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.818+0000 7fc810e59640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-11T07:34:55.822 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.818+0000 7fc810e59640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-11T07:34:55.822 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.818+0000 7fc810e59640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T07:34:55.822 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.818+0000 7fc810e59640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T07:34:55.822 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.818+0000 7fc810e59640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T07:34:55.823 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:55.820+0000 7fc810e59640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-11T07:34:58.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-11T07:34:58.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:34:58.861 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.856+0000 7fe14db3f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-11T07:34:58.861 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.857+0000 7fe14db3f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-11T07:34:58.861 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.857+0000 7fe14db3f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T07:34:58.861 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.857+0000 7fe14db3f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T07:34:58.862 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.857+0000 7fe14db3f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T07:34:58.862 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:34:58.858+0000 7fe14db3f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-11T07:35:01.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-11T07:35:01.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:35:01.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.911+0000 7f73c0be8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-11T07:35:01.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.912+0000 7f73c0be8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-11T07:35:01.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.912+0000 7f73c0be8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T07:35:01.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.912+0000 7f73c0be8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T07:35:01.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.912+0000 7f73c0be8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T07:35:01.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:01.913+0000 7f73c0be8640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-11T07:35:02.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:35:02.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:35:04.797 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-11T07:35:04.860 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:35:04.957 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.953+0000 7f8c82a8d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-11T07:35:04.957 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.953+0000 7f8c82a8d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-11T07:35:04.957 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.953+0000 7f8c82a8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T07:35:04.957 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.953+0000 7f8c82a8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T07:35:04.958 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.953+0000 7f8c82a8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T07:35:04.958 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:04.955+0000 7f8c82a8d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-11T07:35:07.831 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-11T07:35:07.894 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-11T07:35:07.895 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:07.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-11T07:35:07.964 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:07.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-11T07:35:08.068 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:08.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-11T07:35:08.171 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:08.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-11T07:35:08.271 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:08.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-11T07:35:08.373 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:08.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-11T07:35:08.474 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:08.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-11T07:35:08.577 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:08.577 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-11T07:35:08.643 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:08.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-11T07:35:08.748 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:08.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-11T07:35:08.849 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:08.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-11T07:35:08.950 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:08.951 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-11T07:35:09.052 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:09.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-11T07:35:09.153 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:09.154 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-11T07:35:09.254 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:09.254 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-11T07:35:09.296 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:09.297 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-11T07:35:09.377 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:09.377 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-11T07:35:09.417 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:09.418 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-11T07:35:09.498 INFO:tasks.ceph:Adding keys to all mons... 2023-05-11T07:35:09.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-11T07:35:09.502 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-11T07:35:09.557 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCLmlxkC8zALxAANIK/NFIBgjNBUfJp0ngOXQ== 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkfkDcAhAA91Vpr22kB+XW9/2J5htf+Q== 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkRY99DRAAyKD3JPJAYq4iOxaAOeXZng== 2023-05-11T07:35:09.558 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCQmlxkKkAPGhAAMA4ZjlqSUC0unvFDt+r4sg== 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCTmlxkeLzQHBAAkT2yaRU8rjcMwkrCt8ZfFA== 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCWmlxkpbetHxAAREQ9bdYsNSYxZ7yDRNPFLw== 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2023-05-11T07:35:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZmlxk304JIxAAUQPloZFgbnYcOadQrva8mg== 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCLmlxkeeyGNxAA4x7O4iT7WGR7zKrWcTVovQ== 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkGmIqGBAAXMQe715J4UOVXuCIEPK1Ow== 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkCXDHIhAAwJXEP7y9MvqCK7svXzcT2Q== 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2023-05-11T07:35:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCfmlxkI1rYMBAA3aqv/jBnoSM0L/COnBKPdQ== 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCimlxkjS8pMxAAuQl8VUOGeOi1ic7IeagDpA== 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQClmlxkH+FwNhAAxBhCd8bHDSbIAUTUDpIMPA== 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQComlxka1jsOBAApuNcTCjkMDrqK3i3GbyuzQ== 2023-05-11T07:35:09.561 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkS28MLBAAPJKGvz9gDu4/TOZZQtaAwg== 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkSurfMhAAjANT8HT//tiOCLqvVrOomw== 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCMmlxkre/WORAAXSl2kvjbZherxg9dG42wmw== 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2023-05-11T07:35:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCNmlxkkHUOBRAA+s14BPlmofpdRDmPI51X5g== 2023-05-11T07:35:09.596 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2023-05-11T07:35:09.596 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCLmlxkC8zALxAANIK/NFIBgjNBUfJp0ngOXQ== 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkfkDcAhAA91Vpr22kB+XW9/2J5htf+Q== 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkRY99DRAAyKD3JPJAYq4iOxaAOeXZng== 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCQmlxkKkAPGhAAMA4ZjlqSUC0unvFDt+r4sg== 2023-05-11T07:35:09.597 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCTmlxkeLzQHBAAkT2yaRU8rjcMwkrCt8ZfFA== 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCWmlxkpbetHxAAREQ9bdYsNSYxZ7yDRNPFLw== 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCZmlxk304JIxAAUQPloZFgbnYcOadQrva8mg== 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2023-05-11T07:35:09.598 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCLmlxkeeyGNxAA4x7O4iT7WGR7zKrWcTVovQ== 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkGmIqGBAAXMQe715J4UOVXuCIEPK1Ow== 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkCXDHIhAAwJXEP7y9MvqCK7svXzcT2Q== 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCfmlxkI1rYMBAA3aqv/jBnoSM0L/COnBKPdQ== 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2023-05-11T07:35:09.599 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCimlxkjS8pMxAAuQl8VUOGeOi1ic7IeagDpA== 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQClmlxkH+FwNhAAxBhCd8bHDSbIAUTUDpIMPA== 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQComlxka1jsOBAApuNcTCjkMDrqK3i3GbyuzQ== 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkS28MLBAAPJKGvz9gDu4/TOZZQtaAwg== 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout:[client.2] 2023-05-11T07:35:09.600 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkSurfMhAAjANT8HT//tiOCLqvVrOomw== 2023-05-11T07:35:09.601 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2023-05-11T07:35:09.601 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCMmlxkre/WORAAXSl2kvjbZherxg9dG42wmw== 2023-05-11T07:35:09.601 INFO:teuthology.orchestra.run.smithi145.stdout:[client.3] 2023-05-11T07:35:09.601 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCNmlxkkHUOBRAA+s14BPlmofpdRDmPI51X5g== 2023-05-11T07:35:09.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T07:35:09.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T07:35:09.741 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:09.745 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:09.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:09.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:09.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:09.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.061 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T07:35:10.369 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T07:35:10.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:10.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:10.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:10.580 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T07:35:10.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.688 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:10.998 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T07:35:11.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.102 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.316 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T07:35:11.525 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-11T07:35:11.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-11T07:35:11.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T07:35:11.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-11T07:35:11.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-11T07:35:11.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T07:35:11.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-11T07:35:12.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-11T07:35:12.067 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T07:35:12.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-11T07:35:12.242 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:35:12.247 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-11T07:35:12.287 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-11T07:35:12.288 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-11T07:35:12.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-11T07:35:12.328 INFO:tasks.ceph.mon.a:Started 2023-05-11T07:35:12.329 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-11T07:35:12.329 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-11T07:35:12.333 INFO:tasks.ceph.mon.b:Started 2023-05-11T07:35:12.333 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-11T07:35:12.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-11T07:35:12.337 INFO:tasks.ceph.mon.c:Started 2023-05-11T07:35:12.337 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-11T07:35:12.337 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-11T07:35:12.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-11T07:35:12.341 INFO:tasks.ceph.mgr.y:Started 2023-05-11T07:35:12.342 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-11T07:35:12.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-11T07:35:12.345 INFO:tasks.ceph.mgr.x:Started 2023-05-11T07:35:12.346 INFO:tasks.ceph:Setting crush tunables to default 2023-05-11T07:35:12.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd crush tunables default 2023-05-11T07:35:12.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.528+0000 7f4b791ff700 1 Processor -- start 2023-05-11T07:35:12.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.528+0000 7f4b791ff700 1 -- start start 2023-05-11T07:35:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.529+0000 7f4b791ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b74160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.529+0000 7f4b791ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740d0e80 con 0x7f4b7406b350 2023-05-11T07:35:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.529+0000 7f4b791ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740cdb00 con 0x7f4b740b5fd0 2023-05-11T07:35:12.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.529+0000 7f4b791ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74161420 con 0x7f4b7415c940 2023-05-11T07:35:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b7359e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b7406b350 0x7f4b740d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41334/0 (socket says 172.21.15.144:41334) 2023-05-11T07:35:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b7359e700 1 -- 172.21.15.144:0/2243649383 learned_addr learned my addr 172.21.15.144:0/2243649383 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b74160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b72d9d700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 msgr2=0x7f4b74160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-11T07:35:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b72d9d700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 msgr2=0x7f4b74160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-11T07:35:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b74160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-11T07:35:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.530+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b74160ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-11T07:35:12.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.726+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014313115 0 0) 0x7f4b740d0e80 con 0x7f4b7406b350 2023-05-11T07:35:12.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.726+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c0035b0 con 0x7f4b7406b350 2023-05-11T07:35:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120897282 0 0) 0x7f4b5c0035b0 con 0x7f4b7406b350 2023-05-11T07:35:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 msgr2=0x7f4b74160ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T07:35:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b74160ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 >> v1:172.21.15.145:6789/0 conn(0x7f4b740b5fd0 legacy=0x7f4b7406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740cdde0 con 0x7f4b7406b350 2023-05-11T07:35:12.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f4b6c0019f0 con 0x7f4b7406b350 2023-05-11T07:35:12.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 >> v1:172.21.15.144:6789/0 conn(0x7f4b7406b350 legacy=0x7f4b740d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c003a30 0x7f4b5c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c004850 0x7f4b5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b5c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74161420 con 0x7f4b5c003a30 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00bba0 con 0x7f4b5c004850 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.727+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00bd60 con 0x7f4b7415c940 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c003a30 0x7f4b5c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b7259c700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c004850 0x7f4b5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b7359e700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b5c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 msgr2=0x7f4b5c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b7415c940 0x7f4b5c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c004850 msgr2=0x7f4b5c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c004850 0x7f4b5c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 -- 172.21.15.144:0/2243649383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0035b0 con 0x7f4b5c003a30 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b72d9d700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c003a30 0x7f4b5c003e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009890 tx=0x7f4b5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9d26950e2d1064 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.728+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400c070 con 0x7f4b5c003a30 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64004020 con 0x7f4b5c003a30 2023-05-11T07:35:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b71d9b700 1 -- 172.21.15.144:0/2243649383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640043d0 con 0x7f4b5c003a30 2023-05-11T07:35:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 -- 172.21.15.144:0/2243649383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c003a30 msgr2=0x7f4b5c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 --2- 172.21.15.144:0/2243649383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b5c003a30 0x7f4b5c003e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009890 tx=0x7f4b5c005880 comp rx=0 tx=0).stop 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b7359e700 1 -- 172.21.15.144:0/2243649383 reap_dead start 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 -- 172.21.15.144:0/2243649383 shutdown_connections 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 -- 172.21.15.144:0/2243649383 >> 172.21.15.144:0/2243649383 conn(0x7f4b740d3180 msgr2=0x7f4b740d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 -- 172.21.15.144:0/2243649383 shutdown_connections 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.729+0000 7f4b791ff700 1 -- 172.21.15.144:0/2243649383 wait complete. 2023-05-11T07:35:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.731+0000 7f4b791ff700 1 Processor -- start 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.732+0000 7f4b791ff700 1 -- start start 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c003a30 0x7f4b741f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 0x7f4b740b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741f2b10 con 0x7f4b74153c60 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740b8f00 con 0x7f4b5c003a30 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b791ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741f35a0 con 0x7f4b740b8570 2023-05-11T07:35:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b72d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c003a30 0x7f4b741f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48272/0 (socket says 172.21.15.144:48272) 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 -- 172.21.15.144:0/3532965480 learned_addr learned my addr 172.21.15.144:0/3532965480 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7359e700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 0x7f4b740b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 -- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 msgr2=0x7f4b740b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 0x7f4b740b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 -- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c003a30 msgr2=0x7f4b741f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c003a30 0x7f4b741f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 -- 172.21.15.144:0/3532965480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740d1400 con 0x7f4b74153c60 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7359e700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 0x7f4b740b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.733+0000 7f4b7259c700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800f7f0 tx=0x7f4b6800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680052e0 con 0x7f4b74153c60 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68005440 con 0x7f4b74153c60 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680038c0 con 0x7f4b74153c60 2023-05-11T07:35:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740d1120 con 0x7f4b74153c60 2023-05-11T07:35:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7415cd10 con 0x7f4b74153c60 2023-05-11T07:35:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b68003d20 con 0x7f4b74153c60 2023-05-11T07:35:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.734+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4b6801dd60 con 0x7f4b74153c60 2023-05-11T07:35:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.735+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b740744c0 con 0x7f4b74153c60 2023-05-11T07:35:12.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.738+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4b6801d460 con 0x7f4b74153c60 2023-05-11T07:35:12.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.817+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4b7406cf30 con 0x7f4b74153c60 2023-05-11T07:35:12.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.820+0000 7f4b5b7fe700 1 -- 172.21.15.144:0/3532965480 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4b6801d600 con 0x7f4b74153c60 2023-05-11T07:35:12.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 msgr2=0x7f4b7414d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:12.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800f7f0 tx=0x7f4b6800fb00 comp rx=0 tx=0).stop 2023-05-11T07:35:12.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 shutdown_connections 2023-05-11T07:35:12.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b740b8570 0x7f4b740b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b5c003a30 0x7f4b741f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 --2- 172.21.15.144:0/3532965480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b74153c60 0x7f4b7414d650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 >> 172.21.15.144:0/3532965480 conn(0x7f4b740d3180 msgr2=0x7f4b7406ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 shutdown_connections 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:12.822+0000 7f4b791ff700 1 -- 172.21.15.144:0/3532965480 wait complete. 2023-05-11T07:35:12.827 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2023-05-11T07:35:12.847 INFO:tasks.ceph:check_enable_crimson: False 2023-05-11T07:35:12.847 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-11T07:35:12.847 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:12.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-11T07:35:12.890 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:12.888+0000 7f6ef7b6b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-11T07:35:12.910 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:12.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-11T07:35:12.920 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:12.917+0000 7fb912074200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-11T07:35:12.982 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:12.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-11T07:35:13.100 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:13.098+0000 7f6ef7b6b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-11T07:35:13.121 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:13.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-11T07:35:13.131 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:13.128+0000 7fb912074200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-11T07:35:13.184 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:13.184 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-11T07:35:13.246 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:13.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-11T07:35:13.347 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:13.348 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-11T07:35:13.449 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:35:13.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-11T07:35:13.510 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:13.508+0000 7f6ef7b6b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-11T07:35:13.544 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:13.541+0000 7fb912074200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-11T07:35:13.552 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 60ee9243-ae06-4e4e-8cde-64fcdc4a4651 0 2023-05-11T07:35:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.772+0000 7fdb35fff700 1 Processor -- start 2023-05-11T07:35:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.772+0000 7fdb35fff700 1 -- start start 2023-05-11T07:35:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb35fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdb300d14c0 0x7fdb30167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb35fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb300cf640 con 0x7fdb300cfe00 2023-05-11T07:35:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb35fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3015cd00 con 0x7fdb3015c930 2023-05-11T07:35:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb35fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300cd940 con 0x7fdb300d14c0 2023-05-11T07:35:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2f7fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fdb3015c930 0x7fdb3015d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55468/0 (socket says 172.21.15.145:55468) 2023-05-11T07:35:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2f7fe700 1 -- 172.21.15.145:0/3297474757 learned_addr learned my addr 172.21.15.145:0/3297474757 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-05-11T07:35:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2ffff700 1 --2- 172.21.15.145:0/3297474757 >> v2:172.21.15.145:3300/0 conn(0x7fdb300d14c0 0x7fdb30167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344906715 0 0) 0x7fdb3015cd00 con 0x7fdb3015c930 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1c0035b0 con 0x7fdb3015c930 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193416939 0 0) 0x7fdb300cf640 con 0x7fdb300cfe00 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.774+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb3015cd00 con 0x7fdb300cfe00 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2ffff700 1 -- 172.21.15.145:0/3297474757 >> v1:172.21.15.145:6789/0 conn(0x7fdb3015c930 legacy=0x7fdb3015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2ffff700 1 -- 172.21.15.145:0/3297474757 >> v1:172.21.15.144:6789/0 conn(0x7fdb300cfe00 legacy=0x7fdb300d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2ffff700 1 -- 172.21.15.145:0/3297474757 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300cdc20 con 0x7fdb300d14c0 2023-05-11T07:35:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2ffff700 1 --2- 172.21.15.145:0/3297474757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300d14c0 0x7fdb30167840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea34673e8401a9c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800e070 con 0x7fdb300d14c0 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800bae0 con 0x7fdb300d14c0 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.775+0000 7fdb2effd700 1 -- 172.21.15.145:0/3297474757 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800be90 con 0x7fdb300d14c0 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 -- 172.21.15.145:0/3297474757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300d14c0 msgr2=0x7fdb30167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3297474757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300d14c0 0x7fdb30167840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 -- 172.21.15.145:0/3297474757 shutdown_connections 2023-05-11T07:35:13.780 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3297474757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300d14c0 0x7fdb30167840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 -- 172.21.15.145:0/3297474757 >> 172.21.15.145:0/3297474757 conn(0x7fdb30072650 msgr2=0x7fdb3006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 -- 172.21.15.145:0/3297474757 shutdown_connections 2023-05-11T07:35:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.776+0000 7fdb35fff700 1 -- 172.21.15.145:0/3297474757 wait complete. 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.778+0000 7fdb35fff700 1 Processor -- start 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.778+0000 7fdb35fff700 1 -- start start 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.779+0000 7fdb35fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.779+0000 7fdb35fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb3015c930 0x7fdb300cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb35fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300c9a20 0x7fdb300cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb35fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3014f1a0 con 0x7fdb3015c930 2023-05-11T07:35:13.783 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb35fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300b54b0 con 0x7fdb300c9a20 2023-05-11T07:35:13.783 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb35fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300cb200 con 0x7fdb300d14c0 2023-05-11T07:35:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300c9a20 0x7fdb300cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:36312/0 (socket says 172.21.15.145:36312) 2023-05-11T07:35:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 -- 172.21.15.145:0/3515260394 learned_addr learned my addr 172.21.15.145:0/3515260394 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb27fff700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb3015c930 0x7fdb300cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 -- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300c9a20 msgr2=0x7fdb300cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300c9a20 0x7fdb300cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 -- 172.21.15.145:0/3515260394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb3015c930 msgr2=0x7fdb300cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb3015c930 0x7fdb300cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 -- 172.21.15.145:0/3515260394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009a70 con 0x7fdb300d14c0 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.780+0000 7fdb2f7fe700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001eb0 tx=0x7fdb2000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20005d70 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb200070d0 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb300cdf00 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007440 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb300cf8e0 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdb2001c440 con 0x7fdb300d14c0 2023-05-11T07:35:13.786 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.781+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdb20012740 con 0x7fdb300d14c0 2023-05-11T07:35:13.787 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.782+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb300ce090 con 0x7fdb300d14c0 2023-05-11T07:35:13.787 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.785+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fdb20021060 con 0x7fdb300d14c0 2023-05-11T07:35:13.872 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.870+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60ee9243-ae06-4e4e-8cde-64fcdc4a4651", "id": 0} v 0) v1 -- 0x7fdb300ce500 con 0x7fdb300d14c0 2023-05-11T07:35:13.878 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.876+0000 7fdb2cff9700 1 -- 172.21.15.145:0/3515260394 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60ee9243-ae06-4e4e-8cde-64fcdc4a4651", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb20017070 con 0x7fdb300d14c0 2023-05-11T07:35:13.879 INFO:teuthology.orchestra.run.smithi145.stdout:0 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 msgr2=0x7fdb300b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001eb0 tx=0x7fdb2000c7b0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 shutdown_connections 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdb300d14c0 0x7fdb300b4f70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb300c9a20 0x7fdb300cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 --2- 172.21.15.145:0/3515260394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb3015c930 0x7fdb300cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:13.880 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 >> 172.21.15.145:0/3515260394 conn(0x7fdb300cfe00 msgr2=0x7fdb300d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:13.881 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 shutdown_connections 2023-05-11T07:35:13.881 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:13.877+0000 7fdb35fff700 1 -- 172.21.15.145:0/3515260394 wait complete. 2023-05-11T07:35:13.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 1a6ccfee-d06b-4e0a-835b-2c1b5a20a890 1 2023-05-11T07:35:14.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.078+0000 7fb2389ff700 1 Processor -- start 2023-05-11T07:35:14.081 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.078+0000 7fb2389ff700 1 -- start start 2023-05-11T07:35:14.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.079+0000 7fb2389ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 0x7fb2340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.079+0000 7fb2389ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340d0e80 con 0x7fb234160ee0 2023-05-11T07:35:14.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.079+0000 7fb2389ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340cdb00 con 0x7fb23415c940 2023-05-11T07:35:14.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb2389ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340cdde0 con 0x7fb23406b350 2023-05-11T07:35:14.082 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb23259c700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fb23415c940 0x7fb2340b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55482/0 (socket says 172.21.15.145:55482) 2023-05-11T07:35:14.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb23259c700 1 -- 172.21.15.145:0/2766215684 learned_addr learned my addr 172.21.15.145:0/2766215684 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-05-11T07:35:14.083 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb232d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 0x7fb2340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.084 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb231d9b700 1 -- 172.21.15.145:0/2766215684 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345521057 0 0) 0x7fb2340cdb00 con 0x7fb23415c940 2023-05-11T07:35:14.084 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb231d9b700 1 -- 172.21.15.145:0/2766215684 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2200035b0 con 0x7fb23415c940 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb232d9d700 1 -- 172.21.15.145:0/2766215684 >> v1:172.21.15.145:6789/0 conn(0x7fb23415c940 legacy=0x7fb2340b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb232d9d700 1 -- 172.21.15.145:0/2766215684 >> v1:172.21.15.144:6789/0 conn(0x7fb234160ee0 legacy=0x7fb23406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.080+0000 7fb232d9d700 1 -- 172.21.15.145:0/2766215684 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340d1120 con 0x7fb23406b350 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb232d9d700 1 --2- 172.21.15.145:0/2766215684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 0x7fb2340d1920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009dc0 tx=0x7fb22c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9db7b7689a21f96 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb231d9b700 1 -- 172.21.15.145:0/2766215684 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00e070 con 0x7fb23406b350 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb231d9b700 1 -- 172.21.15.145:0/2766215684 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00bae0 con 0x7fb23406b350 2023-05-11T07:35:14.085 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb231d9b700 1 -- 172.21.15.145:0/2766215684 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00be90 con 0x7fb23406b350 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 -- 172.21.15.145:0/2766215684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 msgr2=0x7fb2340d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 --2- 172.21.15.145:0/2766215684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 0x7fb2340d1920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009dc0 tx=0x7fb22c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 -- 172.21.15.145:0/2766215684 shutdown_connections 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 --2- 172.21.15.145:0/2766215684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb23406b350 0x7fb2340d1920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 -- 172.21.15.145:0/2766215684 >> 172.21.15.145:0/2766215684 conn(0x7fb2340d3180 msgr2=0x7fb2340d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 -- 172.21.15.145:0/2766215684 shutdown_connections 2023-05-11T07:35:14.086 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.081+0000 7fb2389ff700 1 -- 172.21.15.145:0/2766215684 wait complete. 2023-05-11T07:35:14.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.083+0000 7fb2389ff700 1 Processor -- start 2023-05-11T07:35:14.088 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.083+0000 7fb2389ff700 1 -- start start 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23406b350 0x7fb2340caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 0x7fb2341f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23415e770 con 0x7fb23406b350 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23415e9c0 con 0x7fb23415c940 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb2389ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23415eca0 con 0x7fb234160ee0 2023-05-11T07:35:14.089 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.084+0000 7fb232d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 0x7fb2341f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51810/0 (socket says 172.21.15.145:51810) 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 -- 172.21.15.145:0/1317955814 learned_addr learned my addr 172.21.15.145:0/1317955814 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb23259c700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23406b350 0x7fb2340caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 -- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 msgr2=0x7fb2341f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 0x7fb2341f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 -- 172.21.15.145:0/1317955814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23406b350 msgr2=0x7fb2340caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.090 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23406b350 0x7fb2340caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 -- 172.21.15.145:0/1317955814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c009a70 con 0x7fb23415c940 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb232d9d700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 0x7fb2341f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22bfff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c4a0 tx=0x7fb21c00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0054e0 con 0x7fb23415c940 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c003680 con 0x7fb23415c940 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.085+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c003a30 con 0x7fb23415c940 2023-05-11T07:35:14.091 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.086+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2340b66e0 con 0x7fb23415c940 2023-05-11T07:35:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.086+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2340d1400 con 0x7fb23415c940 2023-05-11T07:35:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.086+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb21c006820 con 0x7fb23415c940 2023-05-11T07:35:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.086+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb21c012400 con 0x7fb23415c940 2023-05-11T07:35:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.087+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb234161330 con 0x7fb23415c940 2023-05-11T07:35:14.092 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.089+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb21c017070 con 0x7fb23415c940 2023-05-11T07:35:14.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:14.145+0000 7fb912074200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-11T07:35:14.161 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:14.159+0000 7f6ef7b6b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-11T07:35:14.177 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.175+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a6ccfee-d06b-4e0a-835b-2c1b5a20a890", "id": 1} v 0) v1 -- 0x7fb23415f590 con 0x7fb23415c940 2023-05-11T07:35:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.181+0000 7fb22affd700 1 -- 172.21.15.145:0/1317955814 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a6ccfee-d06b-4e0a-835b-2c1b5a20a890", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb21c006ad0 con 0x7fb23415c940 2023-05-11T07:35:14.184 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-05-11T07:35:14.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 msgr2=0x7fb2341f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c4a0 tx=0x7fb21c00c7b0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.185 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 shutdown_connections 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234160ee0 0x7fb2341f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23406b350 0x7fb2340caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 --2- 172.21.15.145:0/1317955814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb23415c940 0x7fb2341f25c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 >> 172.21.15.145:0/1317955814 conn(0x7fb2340d3180 msgr2=0x7fb234159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.182+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 shutdown_connections 2023-05-11T07:35:14.186 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.183+0000 7fb2389ff700 1 -- 172.21.15.145:0/1317955814 wait complete. 2023-05-11T07:35:14.201 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 313743fd-9ef8-4880-a410-47b53adda1bb 2 2023-05-11T07:35:14.376 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:14.373+0000 7fb912074200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-11T07:35:14.385 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.383+0000 7f0f4b9ff700 1 Processor -- start 2023-05-11T07:35:14.385 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.383+0000 7f0f4b9ff700 1 -- start start 2023-05-11T07:35:14.386 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f4b9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0f4406b350 0x7f0f440d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.386 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f4b9ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f440d0e80 con 0x7f0f4415c940 2023-05-11T07:35:14.386 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f4b9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f440cdb00 con 0x7f0f44160ee0 2023-05-11T07:35:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f4b9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f440cdde0 con 0x7f0f4406b350 2023-05-11T07:35:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f49f9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0f4406b350 0x7f0f440d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f48f9a700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f0f44160ee0 0x7f0f4406ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55496/0 (socket says 172.21.15.145:55496) 2023-05-11T07:35:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.384+0000 7f0f48f9a700 1 -- 172.21.15.145:0/1119589580 learned_addr learned my addr 172.21.15.145:0/1119589580 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-05-11T07:35:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f49f9c700 1 -- 172.21.15.145:0/1119589580 >> v1:172.21.15.145:6789/0 conn(0x7f0f44160ee0 legacy=0x7f0f4406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f49f9c700 1 -- 172.21.15.145:0/1119589580 >> v1:172.21.15.144:6789/0 conn(0x7f0f4415c940 legacy=0x7f0f440b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f3bfff700 1 -- 172.21.15.145:0/1119589580 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606768335 0 0) 0x7f0f440cdb00 con 0x7f0f44160ee0 2023-05-11T07:35:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f49f9c700 1 -- 172.21.15.145:0/1119589580 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440d1120 con 0x7f0f4406b350 2023-05-11T07:35:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f49f9c700 1 --2- 172.21.15.145:0/1119589580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4406b350 0x7f0f440d1920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7792104a4ec35e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f3bfff700 1 -- 172.21.15.145:0/1119589580 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00e070 con 0x7f0f4406b350 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f3bfff700 1 -- 172.21.15.145:0/1119589580 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c00bad0 con 0x7f0f4406b350 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.385+0000 7f0f3bfff700 1 -- 172.21.15.145:0/1119589580 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00be80 con 0x7f0f4406b350 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/1119589580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4406b350 msgr2=0x7f0f440d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/1119589580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4406b350 0x7f0f440d1920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/1119589580 shutdown_connections 2023-05-11T07:35:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/1119589580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4406b350 0x7f0f440d1920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/1119589580 >> 172.21.15.145:0/1119589580 conn(0x7f0f440d3180 msgr2=0x7f0f440d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/1119589580 shutdown_connections 2023-05-11T07:35:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.386+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/1119589580 wait complete. 2023-05-11T07:35:14.393 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.388+0000 7f0f4b9ff700 1 Processor -- start 2023-05-11T07:35:14.393 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.388+0000 7f0f4b9ff700 1 -- start start 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f4406b350 0x7f0f4415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f44160ee0 0x7f0f4415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f44154b90 con 0x7f0f44160ee0 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4415e780 con 0x7f0f4415c940 2023-05-11T07:35:14.394 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4b9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4415d1a0 con 0x7f0f4406b350 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51830/0 (socket says 172.21.15.145:51830) 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 -- 172.21.15.145:0/3315876505 learned_addr learned my addr 172.21.15.145:0/3315876505 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f4979b700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f4406b350 0x7f0f4415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f49f9c700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f44160ee0 0x7f0f4415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 -- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f4406b350 msgr2=0x7f0f4415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.395 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f4406b350 0x7f0f4415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 -- 172.21.15.145:0/3315876505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f44160ee0 msgr2=0x7f0f4415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f44160ee0 0x7f0f4415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.389+0000 7f0f48f9a700 1 -- 172.21.15.145:0/3315876505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c009a70 con 0x7f0f4415c940 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f48f9a700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c550 tx=0x7f0f3400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34004c80 con 0x7f0f4415c940 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34004e00 con 0x7f0f4415c940 2023-05-11T07:35:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f440b66e0 con 0x7f0f4415c940 2023-05-11T07:35:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34007310 con 0x7f0f4415c940 2023-05-11T07:35:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f440d1400 con 0x7f0f4415c940 2023-05-11T07:35:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f3401d3f0 con 0x7f0f4415c940 2023-05-11T07:35:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.390+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0f340137e0 con 0x7f0f4415c940 2023-05-11T07:35:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.391+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f44161330 con 0x7f0f4415c940 2023-05-11T07:35:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.393+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f0f340133c0 con 0x7f0f4415c940 2023-05-11T07:35:14.406 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:14.404+0000 7f6ef7b6b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-11T07:35:14.481 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.479+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "313743fd-9ef8-4880-a410-47b53adda1bb", "id": 2} v 0) v1 -- 0x7f0f4406cf30 con 0x7f0f4415c940 2023-05-11T07:35:14.487 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.484+0000 7f0f39ffb700 1 -- 172.21.15.145:0/3315876505 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "313743fd-9ef8-4880-a410-47b53adda1bb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f340139f0 con 0x7f0f4415c940 2023-05-11T07:35:14.487 INFO:teuthology.orchestra.run.smithi145.stdout:2 2023-05-11T07:35:14.488 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 msgr2=0x7f0f440c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.488 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c550 tx=0x7f0f3400c860 comp rx=0 tx=0).stop 2023-05-11T07:35:14.488 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 shutdown_connections 2023-05-11T07:35:14.489 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f4406b350 0x7f0f4415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.489 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f44160ee0 0x7f0f4415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.489 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 --2- 172.21.15.145:0/3315876505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f4415c940 0x7f0f440c8fa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.489 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 >> 172.21.15.145:0/3315876505 conn(0x7f0f440d3180 msgr2=0x7f0f4406ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.489 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 shutdown_connections 2023-05-11T07:35:14.490 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.486+0000 7f0f4b9ff700 1 -- 172.21.15.145:0/3315876505 wait complete. 2023-05-11T07:35:14.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 90651a93-f858-43bf-81ac-d50e100ac497 3 2023-05-11T07:35:14.690 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.688+0000 7fc74c5ff700 1 Processor -- start 2023-05-11T07:35:14.691 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.688+0000 7fc74c5ff700 1 -- start start 2023-05-11T07:35:14.692 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.689+0000 7fc74c5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc74415c930 0x7fc74415d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.692 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.689+0000 7fc74c5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc7440d14c0 0x7fc7441604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.692 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.689+0000 7fc74c5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74415de80 con 0x7fc7440cfe00 2023-05-11T07:35:14.692 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.689+0000 7fc74c5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7440cf640 con 0x7fc74415c930 2023-05-11T07:35:14.693 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.689+0000 7fc74c5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74415cd00 con 0x7fc7440d14c0 2023-05-11T07:35:14.693 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc7440d14c0 0x7fc7441604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.693 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc7440d14c0 0x7fc7441604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51844/0 (socket says 172.21.15.145:51844) 2023-05-11T07:35:14.693 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 -- 172.21.15.145:0/3197064577 learned_addr learned my addr 172.21.15.145:0/3197064577 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:14.693 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74a39b700 1 --2- 172.21.15.145:0/3197064577 >> v2:172.21.15.144:3300/0 conn(0x7fc74415c930 0x7fc74415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.694 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 -- 172.21.15.145:0/3197064577 >> v2:172.21.15.144:3300/0 conn(0x7fc74415c930 msgr2=0x7fc74415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 --2- 172.21.15.145:0/3197064577 >> v2:172.21.15.144:3300/0 conn(0x7fc74415c930 0x7fc74415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 -- 172.21.15.145:0/3197064577 >> v1:172.21.15.144:6789/0 conn(0x7fc7440cfe00 legacy=0x7fc7440d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 -- 172.21.15.145:0/3197064577 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440cd940 con 0x7fc7440d14c0 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.690+0000 7fc74ab9c700 1 --2- 172.21.15.145:0/3197064577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440d14c0 0x7fc7441604b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ba4d874b893014 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc749399700 1 -- 172.21.15.145:0/3197064577 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00e070 con 0x7fc7440d14c0 2023-05-11T07:35:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc749399700 1 -- 172.21.15.145:0/3197064577 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b8d0 con 0x7fc7440d14c0 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc749399700 1 -- 172.21.15.145:0/3197064577 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00bc80 con 0x7fc7440d14c0 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 -- 172.21.15.145:0/3197064577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440d14c0 msgr2=0x7fc7441604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/3197064577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440d14c0 0x7fc7441604b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 -- 172.21.15.145:0/3197064577 shutdown_connections 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/3197064577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7440d14c0 0x7fc7441604b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/3197064577 >> v2:172.21.15.144:3300/0 conn(0x7fc74415c930 0x7fc74415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 -- 172.21.15.145:0/3197064577 >> 172.21.15.145:0/3197064577 conn(0x7fc744072650 msgr2=0x7fc74406acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 -- 172.21.15.145:0/3197064577 shutdown_connections 2023-05-11T07:35:14.697 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.691+0000 7fc74c5ff700 1 -- 172.21.15.145:0/3197064577 wait complete. 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.693+0000 7fc74c5ff700 1 Processor -- start 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.693+0000 7fc74c5ff700 1 -- start start 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7440d14c0 0x7fc744157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c9420 0x7fc7441f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441e4c90 con 0x7fc7440c9420 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440c98a0 con 0x7fc74415c930 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74c5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f3270 con 0x7fc7440d14c0 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc749b9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74a39b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7440d14c0 0x7fc744157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc749b9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51856/0 (socket says 172.21.15.145:51856) 2023-05-11T07:35:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc749b9a700 1 -- 172.21.15.145:0/1409083759 learned_addr learned my addr 172.21.15.145:0/1409083759 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.694+0000 7fc74ab9c700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c9420 0x7fc7441f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 -- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7440d14c0 msgr2=0x7fc744157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7440d14c0 0x7fc744157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 -- 172.21.15.145:0/1409083759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c9420 msgr2=0x7fc7441f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c9420 0x7fc7441f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 -- 172.21.15.145:0/1409083759 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009b30 con 0x7fc74415c930 2023-05-11T07:35:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc749b9a700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c490 tx=0x7fc73400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400cea0 con 0x7fc74415c930 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7340052f0 con 0x7fc74415c930 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7440cf8e0 con 0x7fc74415c930 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734006860 con 0x7fc74415c930 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.695+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7440cdc20 con 0x7fc74415c930 2023-05-11T07:35:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.696+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc734003980 con 0x7fc74415c930 2023-05-11T07:35:14.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.696+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc734003c30 con 0x7fc74415c930 2023-05-11T07:35:14.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.696+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440cdf00 con 0x7fc74415c930 2023-05-11T07:35:14.703 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.699+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc734020060 con 0x7fc74415c930 2023-05-11T07:35:14.788 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.786+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90651a93-f858-43bf-81ac-d50e100ac497", "id": 3} v 0) v1 -- 0x7fc7440744c0 con 0x7fc74415c930 2023-05-11T07:35:14.796 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.794+0000 7fc73affd700 1 -- 172.21.15.145:0/1409083759 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90651a93-f858-43bf-81ac-d50e100ac497", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc734011590 con 0x7fc74415c930 2023-05-11T07:35:14.796 INFO:teuthology.orchestra.run.smithi145.stdout:3 2023-05-11T07:35:14.797 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 msgr2=0x7fc7440c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:14.797 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c490 tx=0x7fc73400c7a0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 shutdown_connections 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc7440d14c0 0x7fc744157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7440c9420 0x7fc7441f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 --2- 172.21.15.145:0/1409083759 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc74415c930 0x7fc7440c8ee0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 >> 172.21.15.145:0/1409083759 conn(0x7fc7440cfe00 msgr2=0x7fc7440d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 shutdown_connections 2023-05-11T07:35:14.798 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.795+0000 7fc74c5ff700 1 -- 172.21.15.145:0/1409083759 wait complete. 2023-05-11T07:35:14.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775 4 2023-05-11T07:35:14.817 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:14.814+0000 7fb912074200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-11T07:35:14.866 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:14.863+0000 7f6ef7b6b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-11T07:35:15.001 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.998+0000 7f4ada3ff700 1 Processor -- start 2023-05-11T07:35:15.002 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:14.999+0000 7f4ada3ff700 1 -- start start 2023-05-11T07:35:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ada3ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4ad406b350 0x7f4ad40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ada3ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40d0e80 con 0x7f4ad415c940 2023-05-11T07:35:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ada3ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40cdb00 con 0x7f4ad4160ee0 2023-05-11T07:35:15.005 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ada3ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40cdde0 con 0x7f4ad406b350 2023-05-11T07:35:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ad899c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4ad406b350 0x7f4ad40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ad899c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4ad406b350 0x7f4ad40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51862/0 (socket says 172.21.15.145:51862) 2023-05-11T07:35:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ad899c700 1 -- 172.21.15.145:0/188113955 learned_addr learned my addr 172.21.15.145:0/188113955 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.006 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.000+0000 7f4ad37fe700 1 --1- 172.21.15.145:0/188113955 >> v1:172.21.15.145:6789/0 conn(0x7f4ad4160ee0 0x7f4ad406ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55504/0 (socket says 172.21.15.145:55504) 2023-05-11T07:35:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad899c700 1 -- 172.21.15.145:0/188113955 >> v1:172.21.15.145:6789/0 conn(0x7f4ad4160ee0 legacy=0x7f4ad406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad899c700 1 -- 172.21.15.145:0/188113955 >> v1:172.21.15.144:6789/0 conn(0x7f4ad415c940 legacy=0x7f4ad40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad899c700 1 -- 172.21.15.145:0/188113955 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40d1120 con 0x7f4ad406b350 2023-05-11T07:35:15.007 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad899c700 1 --2- 172.21.15.145:0/188113955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40d1920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009e50 tx=0x7f4acc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205c156ff996e538 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad2ffd700 1 -- 172.21.15.145:0/188113955 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00e070 con 0x7f4ad406b350 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad2ffd700 1 -- 172.21.15.145:0/188113955 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc00b9c0 con 0x7f4ad406b350 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.001+0000 7f4ad2ffd700 1 -- 172.21.15.145:0/188113955 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00bd70 con 0x7f4ad406b350 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 -- 172.21.15.145:0/188113955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 msgr2=0x7f4ad40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/188113955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40d1920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009e50 tx=0x7f4acc00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:15.008 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 -- 172.21.15.145:0/188113955 shutdown_connections 2023-05-11T07:35:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/188113955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40d1920 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 -- 172.21.15.145:0/188113955 >> 172.21.15.145:0/188113955 conn(0x7f4ad40d3180 msgr2=0x7f4ad40d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 -- 172.21.15.145:0/188113955 shutdown_connections 2023-05-11T07:35:15.009 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.002+0000 7f4ada3ff700 1 -- 172.21.15.145:0/188113955 wait complete. 2023-05-11T07:35:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.004+0000 7f4ada3ff700 1 Processor -- start 2023-05-11T07:35:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.004+0000 7f4ada3ff700 1 -- start start 2023-05-11T07:35:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.011 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ad415c940 0x7f4ad41461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ad4160ee0 0x7f4ad4156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4146c00 con 0x7f4ad4160ee0 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4146ee0 con 0x7f4ad406b350 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ada3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad41471c0 con 0x7f4ad415c940 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad37fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ad415c940 0x7f4ad41461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.012 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51870/0 (socket says 172.21.15.145:51870) 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 -- 172.21.15.145:0/706784077 learned_addr learned my addr 172.21.15.145:0/706784077 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad899c700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ad4160ee0 0x7f4ad4156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 -- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ad415c940 msgr2=0x7f4ad41461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ad415c940 0x7f4ad41461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 -- 172.21.15.145:0/706784077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ad4160ee0 msgr2=0x7f4ad4156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.013 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ad4160ee0 0x7f4ad4156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.005+0000 7f4ad3fff700 1 -- 172.21.15.145:0/706784077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009b30 con 0x7f4ad406b350 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ad3fff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4e0 tx=0x7f4ac400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40052d0 con 0x7f4ad406b350 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4005430 con 0x7f4ad406b350 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad40b66e0 con 0x7f4ad406b350 2023-05-11T07:35:15.014 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40038c0 con 0x7f4ad406b350 2023-05-11T07:35:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40d1400 con 0x7f4ad406b350 2023-05-11T07:35:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.006+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ac4003d20 con 0x7f4ad406b350 2023-05-11T07:35:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.007+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4ac4011d60 con 0x7f4ad406b350 2023-05-11T07:35:15.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.007+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4161330 con 0x7f4ad406b350 2023-05-11T07:35:15.016 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.010+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4ac4017070 con 0x7f4ad406b350 2023-05-11T07:35:15.096 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.094+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775", "id": 4} v 0) v1 -- 0x7f4ad40744c0 con 0x7f4ad406b350 2023-05-11T07:35:15.104 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.102+0000 7f4ad0ff9700 1 -- 172.21.15.145:0/706784077 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ac4011590 con 0x7f4ad406b350 2023-05-11T07:35:15.104 INFO:teuthology.orchestra.run.smithi145.stdout:4 2023-05-11T07:35:15.105 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 msgr2=0x7f4ad40c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.105 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400c4e0 tx=0x7f4ac400c7f0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.105 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 shutdown_connections 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ad4160ee0 0x7f4ad4156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ad406b350 0x7f4ad40c8ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 --2- 172.21.15.145:0/706784077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4ad415c940 0x7f4ad41461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 >> 172.21.15.145:0/706784077 conn(0x7f4ad40d3180 msgr2=0x7f4ad4073940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 shutdown_connections 2023-05-11T07:35:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.103+0000 7f4ada3ff700 1 -- 172.21.15.145:0/706784077 wait complete. 2023-05-11T07:35:15.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new f7d6ea3e-cf94-478b-bf85-ed6156acdf38 5 2023-05-11T07:35:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.305+0000 7f703adff700 1 Processor -- start 2023-05-11T07:35:15.307 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.305+0000 7f703adff700 1 -- start start 2023-05-11T07:35:15.308 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703adff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f703415c940 0x7f7034160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.308 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703adff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 0x7f70340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.309 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703adff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340d0e80 con 0x7f70340b5fd0 2023-05-11T07:35:15.309 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703adff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7034161420 con 0x7f703415c940 2023-05-11T07:35:15.309 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703adff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340cdb00 con 0x7f703406b350 2023-05-11T07:35:15.310 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f7038b9b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f703415c940 0x7f7034160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.310 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f7033fff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f70340b5fd0 0x7f703406ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55520/0 (socket says 172.21.15.145:55520) 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f703939c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 0x7f70340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.306+0000 7f7033fff700 1 -- 172.21.15.145:0/862776704 learned_addr learned my addr 172.21.15.145:0/862776704 (peer_addr_for_me v1:172.21.15.145:0/0) 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f703939c700 1 -- 172.21.15.145:0/862776704 >> v2:172.21.15.145:3300/0 conn(0x7f703415c940 msgr2=0x7f7034160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f703939c700 1 --2- 172.21.15.145:0/862776704 >> v2:172.21.15.145:3300/0 conn(0x7f703415c940 0x7f7034160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f703939c700 1 -- 172.21.15.145:0/862776704 >> v1:172.21.15.145:6789/0 conn(0x7f70340b5fd0 legacy=0x7f703406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f70337fe700 1 -- 172.21.15.145:0/862776704 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382961880 0 0) 0x7f70340d0e80 con 0x7f70340b5fd0 2023-05-11T07:35:15.311 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f703939c700 1 -- 172.21.15.145:0/862776704 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340cdde0 con 0x7f703406b350 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f703939c700 1 --2- 172.21.15.145:0/862776704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 0x7f70340d1920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d90 tx=0x7f702c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a4195df86cc6e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f70337fe700 1 -- 172.21.15.145:0/862776704 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00e070 con 0x7f703406b350 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f70337fe700 1 -- 172.21.15.145:0/862776704 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00bb20 con 0x7f703406b350 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.307+0000 7f70337fe700 1 -- 172.21.15.145:0/862776704 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c012430 con 0x7f703406b350 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 -- 172.21.15.145:0/862776704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 msgr2=0x7f70340d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 --2- 172.21.15.145:0/862776704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 0x7f70340d1920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d90 tx=0x7f702c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:15.312 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 -- 172.21.15.145:0/862776704 shutdown_connections 2023-05-11T07:35:15.313 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 --2- 172.21.15.145:0/862776704 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f703406b350 0x7f70340d1920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.313 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 --2- 172.21.15.145:0/862776704 >> v2:172.21.15.145:3300/0 conn(0x7f703415c940 0x7f7034160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.313 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 -- 172.21.15.145:0/862776704 >> 172.21.15.145:0/862776704 conn(0x7f70340d3180 msgr2=0x7f70340d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.313 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 -- 172.21.15.145:0/862776704 shutdown_connections 2023-05-11T07:35:15.313 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.308+0000 7f703adff700 1 -- 172.21.15.145:0/862776704 wait complete. 2023-05-11T07:35:15.314 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.310+0000 7f703adff700 1 Processor -- start 2023-05-11T07:35:15.314 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.311+0000 7f703adff700 1 -- start start 2023-05-11T07:35:15.315 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f703406b350 0x7f70341e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.315 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703415c940 0x7f70340ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340ccf50 con 0x7f703406b350 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70341e6f50 con 0x7f703415c940 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703adff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70341e7200 con 0x7f70340b5fd0 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f7033fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f703939c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703415c940 0x7f70340ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.316 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f7033fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:36378/0 (socket says 172.21.15.145:36378) 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f7033fff700 1 -- 172.21.15.145:0/923032845 learned_addr learned my addr 172.21.15.145:0/923032845 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.312+0000 7f7038b9b700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f703406b350 0x7f70341e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 -- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703415c940 msgr2=0x7f70340ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703415c940 0x7f70340ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 -- 172.21.15.145:0/923032845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f703406b350 msgr2=0x7f70341e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f703406b350 0x7f70341e64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 -- 172.21.15.145:0/923032845 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009a70 con 0x7f70340b5fd0 2023-05-11T07:35:15.317 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f7033fff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70200011e0 tx=0x7f702000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.318 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004c80 con 0x7f70340b5fd0 2023-05-11T07:35:15.318 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020004e00 con 0x7f70340b5fd0 2023-05-11T07:35:15.318 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020007310 con 0x7f70340b5fd0 2023-05-11T07:35:15.318 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70340d1400 con 0x7f70340b5fd0 2023-05-11T07:35:15.319 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70340d1120 con 0x7f70340b5fd0 2023-05-11T07:35:15.319 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.313+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70200133c0 con 0x7f70340b5fd0 2023-05-11T07:35:15.319 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.314+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7020013c50 con 0x7f70340b5fd0 2023-05-11T07:35:15.319 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.314+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703415cd10 con 0x7f70340b5fd0 2023-05-11T07:35:15.319 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.317+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f70200136d0 con 0x7f70340b5fd0 2023-05-11T07:35:15.404 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.402+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f7d6ea3e-cf94-478b-bf85-ed6156acdf38", "id": 5} v 0) v1 -- 0x7f703406cf30 con 0x7f70340b5fd0 2023-05-11T07:35:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.406+0000 7f70317fa700 1 -- 172.21.15.145:0/923032845 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7d6ea3e-cf94-478b-bf85-ed6156acdf38", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7020013870 con 0x7f70340b5fd0 2023-05-11T07:35:15.409 INFO:teuthology.orchestra.run.smithi145.stdout:5 2023-05-11T07:35:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 msgr2=0x7f70341e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70200011e0 tx=0x7f702000ca30 comp rx=0 tx=0).stop 2023-05-11T07:35:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 shutdown_connections 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f703415c940 0x7f70340ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f703406b350 0x7f70341e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 --2- 172.21.15.145:0/923032845 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b5fd0 0x7f70341e6a10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.407+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 >> 172.21.15.145:0/923032845 conn(0x7f70340d3180 msgr2=0x7f703415b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.408+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 shutdown_connections 2023-05-11T07:35:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.408+0000 7f703adff700 1 -- 172.21.15.145:0/923032845 wait complete. 2023-05-11T07:35:15.427 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c7284965-f40c-490c-b741-ae0b59b1a285 6 2023-05-11T07:35:15.603 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:15.600+0000 7fb912074200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-11T07:35:15.611 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.608+0000 7fab12bff700 1 Processor -- start 2023-05-11T07:35:15.611 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.608+0000 7fab12bff700 1 -- start start 2023-05-11T07:35:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab12bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fab0c15e530 0x7fab0c0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab12bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c06b750 con 0x7fab0c15aaf0 2023-05-11T07:35:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab12bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c15eaa0 con 0x7fab0c0c92f0 2023-05-11T07:35:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab12bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c15aec0 con 0x7fab0c15e530 2023-05-11T07:35:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fab0c15e530 0x7fab0c0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fab0c15e530 0x7fab0c0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51910/0 (socket says 172.21.15.145:51910) 2023-05-11T07:35:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 -- 172.21.15.145:0/2428290106 learned_addr learned my addr 172.21.15.145:0/2428290106 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab1119c700 1 --1- 172.21.15.145:0/2428290106 >> v1:172.21.15.145:6789/0 conn(0x7fab0c0c92f0 0x7fab0c06bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:55522/0 (socket says 172.21.15.145:55522) 2023-05-11T07:35:15.614 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 -- 172.21.15.145:0/2428290106 >> v1:172.21.15.145:6789/0 conn(0x7fab0c0c92f0 legacy=0x7fab0c06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.614 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 -- 172.21.15.145:0/2428290106 >> v1:172.21.15.144:6789/0 conn(0x7fab0c15aaf0 legacy=0x7fab0c0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0bfff700 1 -- 172.21.15.145:0/2428290106 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c15ed80 con 0x7fab0c15e530 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.610+0000 7fab0b7fe700 1 -- 172.21.15.145:0/2428290106 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650021091 0 0) 0x7fab0c06b750 con 0x7fab0c15aaf0 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab0bfff700 1 --2- 172.21.15.145:0/2428290106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0b42c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009920 tx=0x7faaf8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6e33cc3a6076c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab0b7fe700 1 -- 172.21.15.145:0/2428290106 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800ba20 con 0x7fab0c15e530 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab0b7fe700 1 -- 172.21.15.145:0/2428290106 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800bb80 con 0x7fab0c15e530 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab0b7fe700 1 -- 172.21.15.145:0/2428290106 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8009e70 con 0x7fab0c15e530 2023-05-11T07:35:15.615 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab12bff700 1 -- 172.21.15.145:0/2428290106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 msgr2=0x7fab0c0b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab12bff700 1 --2- 172.21.15.145:0/2428290106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0b42c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009920 tx=0x7faaf8009c30 comp rx=0 tx=0).stop 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab12bff700 1 -- 172.21.15.145:0/2428290106 shutdown_connections 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.611+0000 7fab12bff700 1 --2- 172.21.15.145:0/2428290106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0b42c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.612+0000 7fab12bff700 1 -- 172.21.15.145:0/2428290106 >> 172.21.15.145:0/2428290106 conn(0x7fab0c0cb720 msgr2=0x7fab0c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.612+0000 7fab12bff700 1 -- 172.21.15.145:0/2428290106 shutdown_connections 2023-05-11T07:35:15.616 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.612+0000 7fab12bff700 1 -- 172.21.15.145:0/2428290106 wait complete. 2023-05-11T07:35:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.613+0000 7fab12bff700 1 Processor -- start 2023-05-11T07:35:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.613+0000 7fab12bff700 1 -- start start 2023-05-11T07:35:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0c0c92f0 0x7fab0c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 0x7fab0c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c1f3060 con 0x7fab0c0c92f0 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c15bf90 con 0x7fab0c15e530 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.614+0000 7fab12bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c151250 con 0x7fab0c15aaf0 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 0x7fab0c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab1119c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab1099b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0c0c92f0 0x7fab0c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab1119c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51918/0 (socket says 172.21.15.145:51918) 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab1119c700 1 -- 172.21.15.145:0/2981855337 learned_addr learned my addr 172.21.15.145:0/2981855337 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 -- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 msgr2=0x7fab0c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 -- 172.21.15.145:0/2981855337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0c0c92f0 msgr2=0x7fab0c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0c0c92f0 0x7fab0c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 -- 172.21.15.145:0/2981855337 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8009550 con 0x7fab0c15aaf0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab1119c700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.615+0000 7fab0bfff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 0x7fab0c150d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faaf8016000 tx=0x7faaf8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf80119f0 con 0x7fab0c15aaf0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf801f070 con 0x7fab0c15aaf0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c15f340 con 0x7fab0c15aaf0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011d90 con 0x7fab0c15aaf0 2023-05-11T07:35:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c15f060 con 0x7fab0c15aaf0 2023-05-11T07:35:15.622 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faaf8026780 con 0x7fab0c15aaf0 2023-05-11T07:35:15.622 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.616+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faaf8021070 con 0x7fab0c15aaf0 2023-05-11T07:35:15.622 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.617+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c0b4800 con 0x7fab0c15aaf0 2023-05-11T07:35:15.624 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.621+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7faaf802b020 con 0x7fab0c15aaf0 2023-05-11T07:35:15.691 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:15.688+0000 7fb912074200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-11T07:35:15.695 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:15.693+0000 7f6ef7b6b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-11T07:35:15.710 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.708+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7284965-f40c-490c-b741-ae0b59b1a285", "id": 6} v 0) v1 -- 0x7fab0c0c72b0 con 0x7fab0c15aaf0 2023-05-11T07:35:15.714 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.712+0000 7fab097fa700 1 -- 172.21.15.145:0/2981855337 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7284965-f40c-490c-b741-ae0b59b1a285", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab0c0c72b0 con 0x7fab0c15aaf0 2023-05-11T07:35:15.714 INFO:teuthology.orchestra.run.smithi145.stdout:6 2023-05-11T07:35:15.715 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 msgr2=0x7fab0c150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.715 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 0x7fab0c150d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faaf8016000 tx=0x7faaf8004750 comp rx=0 tx=0).stop 2023-05-11T07:35:15.715 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 shutdown_connections 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fab0c15e530 0x7fab0c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0c0c92f0 0x7fab0c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 --2- 172.21.15.145:0/2981855337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fab0c15aaf0 0x7fab0c150d10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 >> 172.21.15.145:0/2981855337 conn(0x7fab0c0cb720 msgr2=0x7fab0c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 shutdown_connections 2023-05-11T07:35:15.716 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.713+0000 7fab12bff700 1 -- 172.21.15.145:0/2981855337 wait complete. 2023-05-11T07:35:15.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 049753c2-dc12-439e-b556-92545c7e3da9 7 2023-05-11T07:35:15.792 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:15.789+0000 7f6ef7b6b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-11T07:35:15.855 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:15.851+0000 7fb912074200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-11T07:35:15.913 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.911+0000 7f6b28bff700 1 Processor -- start 2023-05-11T07:35:15.914 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.911+0000 7f6b28bff700 1 -- start start 2023-05-11T07:35:15.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b28bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b28bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b240d1d60 0x7f6b240d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.915 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b28bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b240d18d0 con 0x7f6b240cd940 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b28bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240d2720 con 0x7f6b240d1d60 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b28bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240d12c0 con 0x7f6b2415d1d0 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b2259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b22d9d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b240d1d60 0x7f6b240d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b2259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:36402/0 (socket says 172.21.15.145:36402) 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.912+0000 7f6b2259c700 1 -- 172.21.15.145:0/934770871 learned_addr learned my addr 172.21.15.145:0/934770871 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.916 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b22d9d700 1 -- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 msgr2=0x7f6b240b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b22d9d700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b22d9d700 1 -- 172.21.15.145:0/934770871 >> v1:172.21.15.144:6789/0 conn(0x7f6b240cd940 legacy=0x7f6b240b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b22d9d700 1 -- 172.21.15.145:0/934770871 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240ce0b0 con 0x7f6b240d1d60 2023-05-11T07:35:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b21d9b700 1 -- 172.21.15.145:0/934770871 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287732405 0 0) 0x7f6b240d18d0 con 0x7f6b240cd940 2023-05-11T07:35:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b2259c700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:15.918 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b22d9d700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b240d1d60 0x7f6b240d21e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009d90 tx=0x7f6b1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2107b5b37e360591 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.918 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b21d9b700 1 -- 172.21.15.145:0/934770871 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00e070 con 0x7f6b240d1d60 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b21d9b700 1 -- 172.21.15.145:0/934770871 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00bb20 con 0x7f6b240d1d60 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.913+0000 7f6b21d9b700 1 -- 172.21.15.145:0/934770871 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c012430 con 0x7f6b240d1d60 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 -- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b240d1d60 msgr2=0x7f6b240d21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b240d1d60 0x7f6b240d21e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009d90 tx=0x7f6b1c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 -- 172.21.15.145:0/934770871 shutdown_connections 2023-05-11T07:35:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b240d1d60 0x7f6b240d21e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 --2- 172.21.15.145:0/934770871 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b2415d1d0 0x7f6b240b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 -- 172.21.15.145:0/934770871 >> 172.21.15.145:0/934770871 conn(0x7f6b24072620 msgr2=0x7f6b240cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 -- 172.21.15.145:0/934770871 shutdown_connections 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.914+0000 7f6b28bff700 1 -- 172.21.15.145:0/934770871 wait complete. 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.916+0000 7f6b28bff700 1 Processor -- start 2023-05-11T07:35:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.916+0000 7f6b28bff700 1 -- start start 2023-05-11T07:35:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b240d1d60 0x7f6b24158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 0x7f6b2415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24159d20 con 0x7f6b240d1d60 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24159890 con 0x7f6b2415d1d0 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b28bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24158c80 con 0x7f6b240cd940 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.145:36416/0 (socket says 172.21.15.145:36416) 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 -- 172.21.15.145:0/3016960100 learned_addr learned my addr 172.21.15.145:0/3016960100 (peer_addr_for_me v2:172.21.15.145:0/0) 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b22d9d700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 0x7f6b2415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b1bfff700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b240d1d60 0x7f6b24158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 -- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 msgr2=0x7f6b2415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 0x7f6b2415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 -- 172.21.15.145:0/3016960100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b240d1d60 msgr2=0x7f6b24158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b240d1d60 0x7f6b24158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.917+0000 7f6b2259c700 1 -- 172.21.15.145:0/3016960100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14009550 con 0x7f6b240cd940 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b22d9d700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 0x7f6b2415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b2259c700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400e9e0 tx=0x7f6b1400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:15.924 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400ee80 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1400c850 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400cbc0 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c009a70 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240cddb0 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.918+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b14005a20 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.919+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6b14005cd0 con 0x7f6b240cd940 2023-05-11T07:35:15.925 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.919+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240d1560 con 0x7f6b240cd940 2023-05-11T07:35:15.926 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:15.921+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f6b14021060 con 0x7f6b240cd940 2023-05-11T07:35:15.940 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:15.937+0000 7fb912074200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-11T07:35:15.961 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:15.959+0000 7f6ef7b6b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-11T07:35:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.006+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd new", "uuid": "049753c2-dc12-439e-b556-92545c7e3da9", "id": 7} v 0) v1 -- 0x7f6b24159b70 con 0x7f6b240cd940 2023-05-11T07:35:16.015 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.012+0000 7f6b1affd700 1 -- 172.21.15.145:0/3016960100 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "049753c2-dc12-439e-b556-92545c7e3da9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b14017070 con 0x7f6b240cd940 2023-05-11T07:35:16.015 INFO:teuthology.orchestra.run.smithi145.stdout:7 2023-05-11T07:35:16.016 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 msgr2=0x7f6b2415dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.016 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400e9e0 tx=0x7f6b1400ecf0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.016 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 shutdown_connections 2023-05-11T07:35:16.016 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b240cd940 0x7f6b2415dfb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.017 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b2415d1d0 0x7f6b2415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.017 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 --2- 172.21.15.145:0/3016960100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b240d1d60 0x7f6b24158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.017 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.013+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 >> 172.21.15.145:0/3016960100 conn(0x7f6b24072620 msgr2=0x7f6b240cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:16.017 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.014+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 shutdown_connections 2023-05-11T07:35:16.017 INFO:teuthology.orchestra.run.smithi145.stderr:2023-05-11T07:35:16.014+0000 7f6b28bff700 1 -- 172.21.15.145:0/3016960100 wait complete. 2023-05-11T07:35:16.032 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-11T07:35:16.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-11T07:35:16.037 INFO:tasks.ceph.osd.0:Started 2023-05-11T07:35:16.037 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-11T07:35:16.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-11T07:35:16.041 INFO:tasks.ceph.osd.1:Started 2023-05-11T07:35:16.041 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-11T07:35:16.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-11T07:35:16.045 INFO:tasks.ceph.osd.2:Started 2023-05-11T07:35:16.046 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-11T07:35:16.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-11T07:35:16.050 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.048+0000 7f6ef7b6b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-11T07:35:16.050 INFO:tasks.ceph.osd.3:Started 2023-05-11T07:35:16.051 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-11T07:35:16.051 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-11T07:35:16.054 INFO:tasks.ceph.osd.4:Started 2023-05-11T07:35:16.055 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-11T07:35:16.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-11T07:35:16.058 INFO:tasks.ceph.osd.5:Started 2023-05-11T07:35:16.058 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-11T07:35:16.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-11T07:35:16.062 INFO:tasks.ceph.osd.6:Started 2023-05-11T07:35:16.063 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-11T07:35:16.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-11T07:35:16.067 INFO:tasks.ceph.osd.7:Started 2023-05-11T07:35:16.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:16.201 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.197+0000 7fb912074200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-11T07:35:16.295 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.292+0000 7f6ef7b6b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-11T07:35:16.325 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.321+0000 7fb912074200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-11T07:35:16.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.326+0000 7f68b4dff700 1 Processor -- start 2023-05-11T07:35:16.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.326+0000 7f68b4dff700 1 -- start start 2023-05-11T07:35:16.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68b4dff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f68b00d27a0 0x7f68b00d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68b4dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b015cef0 con 0x7f68b00b87e0 2023-05-11T07:35:16.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68b4dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00cd760 con 0x7f68b00b52a0 2023-05-11T07:35:16.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68b4dff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b5a80 con 0x7f68b00d27a0 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68ae59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f68b00b87e0 0x7f68b00b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41846/0 (socket says 172.21.15.144:41846) 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68ae59c700 1 -- 172.21.15.144:0/2051149490 learned_addr learned my addr 172.21.15.144:0/2051149490 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.327+0000 7f68aed9d700 1 --2- 172.21.15.144:0/2051149490 >> v2:172.21.15.145:3300/0 conn(0x7f68b00d27a0 0x7f68b00d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324389831 0 0) 0x7f68a0001110 con 0x7f68b00b87e0 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68980035b0 con 0x7f68b00b87e0 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850716155 0 0) 0x7f68b00cd760 con 0x7f68b00b52a0 2023-05-11T07:35:16.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a0001110 con 0x7f68b00b52a0 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374585014 0 0) 0x7f68980035b0 con 0x7f68b00b87e0 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 >> v2:172.21.15.145:3300/0 conn(0x7f68b00d27a0 msgr2=0x7f68b00d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 --2- 172.21.15.144:0/2051149490 >> v2:172.21.15.145:3300/0 conn(0x7f68b00d27a0 0x7f68b00d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 >> v1:172.21.15.145:6789/0 conn(0x7f68b00b52a0 legacy=0x7f68b00d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00d2d30 con 0x7f68b00b87e0 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f68a0001800 con 0x7f68b00b87e0 2023-05-11T07:35:16.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 >> v1:172.21.15.144:6789/0 conn(0x7f68b00b87e0 legacy=0x7f68b00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 0x7f6898003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898004850 0x7f6898004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6898005250 0x7f689800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689800c130 con 0x7f6898005250 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689800c2a0 con 0x7f6898003be0 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689800c460 con 0x7f6898004850 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.328+0000 7f68aed9d700 1 --2- 172.21.15.144:0/2051149490 >> v2:172.21.15.145:3300/0 conn(0x7f68b00d27a0 0x7f68b00d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:16.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 0x7f6898003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68aed9d700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6898005250 0x7f689800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68add9b700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898004850 0x7f6898004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 -- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898004850 msgr2=0x7f6898004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:16.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898004850 0x7f6898004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 -- 172.21.15.144:0/2051149490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6898005250 msgr2=0x7f689800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6898005250 0x7f689800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 -- 172.21.15.144:0/2051149490 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980035b0 con 0x7f6898003be0 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68aed9d700 1 -- 172.21.15.144:0/2051149490 reap_dead start 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ae59c700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 0x7f6898003fd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c0e0 tx=0x7f6898005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6bd04f8ec4ab4c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000cc80 con 0x7f6898003be0 2023-05-11T07:35:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a000cde0 con 0x7f6898003be0 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.329+0000 7f68ad59a700 1 -- 172.21.15.144:0/2051149490 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005ba0 con 0x7f6898003be0 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 -- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 msgr2=0x7f6898003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 0x7f6898003fd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c0e0 tx=0x7f6898005880 comp rx=0 tx=0).stop 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 -- 172.21.15.144:0/2051149490 shutdown_connections 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 --2- 172.21.15.144:0/2051149490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6898003be0 0x7f6898003fd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 -- 172.21.15.144:0/2051149490 >> 172.21.15.144:0/2051149490 conn(0x7f68b006acf0 msgr2=0x7f68b006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 -- 172.21.15.144:0/2051149490 shutdown_connections 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.330+0000 7f68b4dff700 1 -- 172.21.15.144:0/2051149490 wait complete. 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.332+0000 7f68b4dff700 1 Processor -- start 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.332+0000 7f68b4dff700 1 -- start start 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898003be0 0x7f68b014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 0x7f68b00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b01f21d0 con 0x7f68b00cb7f0 2023-05-11T07:35:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b014f960 con 0x7f68b00cb380 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68b4dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00ca1e0 con 0x7f6898003be0 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68aed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68aed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51970/0 (socket says 172.21.15.144:51970) 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68aed9d700 1 -- 172.21.15.144:0/4139378360 learned_addr learned my addr 172.21.15.144:0/4139378360 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68add9b700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 0x7f68b00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.333+0000 7f68ae59c700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898003be0 0x7f68b014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 -- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898003be0 msgr2=0x7f68b014f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898003be0 0x7f68b014f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 -- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 msgr2=0x7f68b00c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 0x7f68b00c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 -- 172.21.15.144:0/4139378360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00cdc90 con 0x7f68b00cb7f0 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68add9b700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 0x7f68b00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68aed9d700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68b0067700 tx=0x7f68a800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800e040 con 0x7f68b00cb7f0 2023-05-11T07:35:16.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800f040 con 0x7f68b00cb7f0 2023-05-11T07:35:16.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8015430 con 0x7f68b00cb7f0 2023-05-11T07:35:16.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b00cd9b0 con 0x7f68b00cb7f0 2023-05-11T07:35:16.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.334+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b00b8bb0 con 0x7f68b00cb7f0 2023-05-11T07:35:16.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.335+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f68a8015890 con 0x7f68b00cb7f0 2023-05-11T07:35:16.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.335+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f68a8015b40 con 0x7f68b00cb7f0 2023-05-11T07:35:16.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.335+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b00cbc00 con 0x7f68b00cb7f0 2023-05-11T07:35:16.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.338+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f68a8015dd0 con 0x7f68b00cb7f0 2023-05-11T07:35:16.392 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.389+0000 7f6ef7b6b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-11T07:35:16.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.410+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b008b830 con 0x7f68b00cb7f0 2023-05-11T07:35:16.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.411+0000 7f689effd700 1 -- 172.21.15.144:0/4139378360 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f68a80213c0 con 0x7f68b00cb7f0 2023-05-11T07:35:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:16.415 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":10,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:16.007878+0000","last_up_change":"0.000000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 msgr2=0x7f68b00c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68b0067700 tx=0x7f68a800f490 comp rx=0 tx=0).stop 2023-05-11T07:35:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 shutdown_connections 2023-05-11T07:35:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6898003be0 0x7f68b014f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68b00cb7f0 0x7f68b00c8c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 --2- 172.21.15.144:0/4139378360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68b00cb380 0x7f68b00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:16.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 >> 172.21.15.144:0/4139378360 conn(0x7f68b006acf0 msgr2=0x7f68b00d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:16.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 shutdown_connections 2023-05-11T07:35:16.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:16.412+0000 7f68b4dff700 1 -- 172.21.15.144:0/4139378360 wait complete. 2023-05-11T07:35:16.425 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.421+0000 7fb912074200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-11T07:35:16.432 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-11T07:35:16.433 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-11T07:35:16.484 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.482+0000 7f6ef7b6b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-11T07:35:16.555 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.551+0000 7fb912074200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-11T07:35:16.584 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.582+0000 7f6ef7b6b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-11T07:35:16.736 INFO:tasks.ceph.osd.1.smithi144.stderr:2023-05-11T07:35:16.733+0000 7f8defcff640 -1 Falling back to public interface 2023-05-11T07:35:16.744 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-05-11T07:35:16.742+0000 7f2fdc6c4640 -1 Falling back to public interface 2023-05-11T07:35:16.752 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-05-11T07:35:16.749+0000 7f88d2890640 -1 Falling back to public interface 2023-05-11T07:35:16.758 INFO:tasks.ceph.osd.0.smithi144.stderr:2023-05-11T07:35:16.755+0000 7f435bc40640 -1 Falling back to public interface 2023-05-11T07:35:16.761 INFO:tasks.ceph.osd.3.smithi144.stderr:2023-05-11T07:35:16.758+0000 7f339c842640 -1 Falling back to public interface 2023-05-11T07:35:16.765 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-05-11T07:35:16.763+0000 7fd64d3f6640 -1 Falling back to public interface 2023-05-11T07:35:16.778 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.775+0000 7fb912074200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-11T07:35:16.782 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-05-11T07:35:16.780+0000 7f87f8af7640 -1 Falling back to public interface 2023-05-11T07:35:16.786 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-05-11T07:35:16.784+0000 7f0970b1e640 -1 Falling back to public interface 2023-05-11T07:35:16.812 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.810+0000 7f6ef7b6b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-11T07:35:16.878 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:16.874+0000 7fb912074200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-11T07:35:16.910 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:16.908+0000 7f6ef7b6b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-11T07:35:17.222 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:17.219+0000 7fb912074200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-11T07:35:17.237 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:17.256 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:17.254+0000 7f6ef7b6b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-11T07:35:17.315 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:17.312+0000 7fb912074200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-11T07:35:17.345 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:17.342+0000 7f6ef7b6b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-11T07:35:17.405 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.401+0000 7fec295ff700 1 Processor -- start 2023-05-11T07:35:17.405 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.402+0000 7fec295ff700 1 -- start start 2023-05-11T07:35:17.406 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec295ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec2406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:17.406 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec295ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec2406b330 0x7fec24160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:17.407 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec295ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240cfa10 con 0x7fec240d2970 2023-05-11T07:35:17.407 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec295ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240cf730 con 0x7fec2406b330 2023-05-11T07:35:17.407 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec295ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240cd880 con 0x7fec2415ca70 2023-05-11T07:35:17.408 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec237fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec2406b330 0x7fec24160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec1bfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec240d2970 0x7fec2406ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41848/0 (socket says 172.21.15.144:41848) 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec1bfff700 1 -- 172.21.15.144:0/429975026 learned_addr learned my addr 172.21.15.144:0/429975026 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.403+0000 7fec22ffd700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec2406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec237fe700 1 -- 172.21.15.144:0/429975026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 msgr2=0x7fec2406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec237fe700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec2406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec237fe700 1 -- 172.21.15.144:0/429975026 >> v1:172.21.15.144:6789/0 conn(0x7fec240d2970 legacy=0x7fec2406ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:17.409 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec237fe700 1 -- 172.21.15.144:0/429975026 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240cded0 con 0x7fec2406b330 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec237fe700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24160460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009d90 tx=0x7fec1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ad342325c1c2a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec227fc700 1 -- 172.21.15.144:0/429975026 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00e070 con 0x7fec2406b330 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec227fc700 1 -- 172.21.15.144:0/429975026 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00bb20 con 0x7fec2406b330 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.404+0000 7fec227fc700 1 -- 172.21.15.144:0/429975026 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c012430 con 0x7fec2406b330 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 -- 172.21.15.144:0/429975026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 msgr2=0x7fec24160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24160460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009d90 tx=0x7fec1c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 -- 172.21.15.144:0/429975026 shutdown_connections 2023-05-11T07:35:17.410 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24160460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.411 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 --2- 172.21.15.144:0/429975026 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec2406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.411 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 -- 172.21.15.144:0/429975026 >> 172.21.15.144:0/429975026 conn(0x7fec240d3120 msgr2=0x7fec240d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:17.411 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 -- 172.21.15.144:0/429975026 shutdown_connections 2023-05-11T07:35:17.411 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.405+0000 7fec295ff700 1 -- 172.21.15.144:0/429975026 wait complete. 2023-05-11T07:35:17.411 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.408+0000 7fec295ff700 1 Processor -- start 2023-05-11T07:35:17.412 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.408+0000 7fec295ff700 1 -- start start 2023-05-11T07:35:17.413 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:17.413 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec240d2970 0x7fec240c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:17.413 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec241f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:17.413 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240c93f0 con 0x7fec2406b330 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24158d80 con 0x7fec240d2970 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.409+0000 7fec295ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24159060 con 0x7fec2415ca70 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51998/0 (socket says 172.21.15.144:51998) 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 -- 172.21.15.144:0/3353601118 learned_addr learned my addr 172.21.15.144:0/3353601118 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec237fe700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec241f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:17.414 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec1bfff700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec240d2970 0x7fec240c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:17.415 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 -- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 msgr2=0x7fec241f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec241f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 -- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec240d2970 msgr2=0x7fec240c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec240d2970 0x7fec240c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 -- 172.21.15.144:0/3353601118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c009a70 con 0x7fec2406b330 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.410+0000 7fec22ffd700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec1400e9b0 tx=0x7fec1400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14009710 con 0x7fec2406b330 2023-05-11T07:35:17.416 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1400ee50 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240d2de0 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400ca50 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec240cdb60 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec14013470 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.411+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fec14013df0 con 0x7fec2406b330 2023-05-11T07:35:17.417 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.412+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec240b25e0 con 0x7fec2406b330 2023-05-11T07:35:17.418 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.414+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fec14021060 con 0x7fec2406b330 2023-05-11T07:35:17.490 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.486+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec2408bda0 con 0x7fec2406b330 2023-05-11T07:35:17.490 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.487+0000 7fec1b7fe700 1 -- 172.21.15.144:0/3353601118 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fec1402a020 con 0x7fec2406b330 2023-05-11T07:35:17.491 INFO:teuthology.misc.health.smithi144.stdout: 2023-05-11T07:35:17.491 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":10,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:16.007878+0000","last_up_change":"0.000000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:17.492 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 msgr2=0x7fec24145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:17.492 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec1400e9b0 tx=0x7fec1400ecc0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.492 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 shutdown_connections 2023-05-11T07:35:17.492 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec2415ca70 0x7fec241f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.493 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2406b330 0x7fec24145fc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.493 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 --2- 172.21.15.144:0/3353601118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec240d2970 0x7fec240c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:17.493 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 >> 172.21.15.144:0/3353601118 conn(0x7fec240d3120 msgr2=0x7fec2415b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:17.493 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 shutdown_connections 2023-05-11T07:35:17.493 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:17.488+0000 7fec295ff700 1 -- 172.21.15.144:0/3353601118 wait complete. 2023-05-11T07:35:17.505 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-11T07:35:17.934 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:17.931+0000 7fb912074200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-11T07:35:17.952 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:17.949+0000 7f6ef7b6b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-11T07:35:18.308 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:18.304+0000 7fb912074200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-11T07:35:18.326 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:18.323+0000 7f6ef7b6b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-11T07:35:18.485 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:18.481+0000 7fb912074200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-11T07:35:18.502 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:18.499+0000 7f6ef7b6b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-11T07:35:18.920 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:18.917+0000 7fb912074200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-11T07:35:18.937 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:18.934+0000 7f6ef7b6b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-11T07:35:19.099 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:19.095+0000 7fb912074200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-11T07:35:19.115 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:19.113+0000 7f6ef7b6b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-11T07:35:19.295 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:19.292+0000 7fb912074200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-11T07:35:19.315 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:19.312+0000 7f6ef7b6b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-11T07:35:19.698 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:19.694+0000 7fb912074200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-11T07:35:19.714 INFO:tasks.ceph.mgr.x.smithi145.stderr:2023-05-11T07:35:19.711+0000 7f6ef7b6b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-11T07:35:20.264 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-05-11T07:35:20.261+0000 7f2fdc6c4640 -1 osd.4 0 log_to_monitors true 2023-05-11T07:35:20.312 INFO:tasks.ceph.osd.0.smithi144.stderr:2023-05-11T07:35:20.308+0000 7f435bc40640 -1 osd.0 0 log_to_monitors true 2023-05-11T07:35:20.350 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-05-11T07:35:20.348+0000 7f0970b1e640 -1 osd.7 0 log_to_monitors true 2023-05-11T07:35:20.364 INFO:tasks.ceph.osd.3.smithi144.stderr:2023-05-11T07:35:20.360+0000 7f339c842640 -1 osd.3 0 log_to_monitors true 2023-05-11T07:35:20.497 INFO:tasks.ceph.osd.1.smithi144.stderr:2023-05-11T07:35:20.494+0000 7f8defcff640 -1 osd.1 0 log_to_monitors true 2023-05-11T07:35:20.581 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-05-11T07:35:20.577+0000 7f88d2890640 -1 osd.2 0 log_to_monitors true 2023-05-11T07:35:20.582 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-05-11T07:35:20.580+0000 7fd64d3f6640 -1 osd.6 0 log_to_monitors true 2023-05-11T07:35:20.607 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-05-11T07:35:20.605+0000 7f87f8af7640 -1 osd.5 0 log_to_monitors true 2023-05-11T07:35:20.717 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:20.714+0000 7fb8cb9fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-11T07:35:20.720 INFO:tasks.ceph.mgr.y.smithi144.stderr:2023-05-11T07:35:20.717+0000 7fb8cb9fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-11T07:35:23.981 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-05-11T07:35:23.977+0000 7f87e79f7700 -1 osd.5 0 waiting for initial osdmap 2023-05-11T07:35:24.000 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-05-11T07:35:23.997+0000 7f09601f8700 -1 osd.7 0 waiting for initial osdmap 2023-05-11T07:35:24.006 INFO:tasks.ceph.osd.5.smithi145.stderr:2023-05-11T07:35:24.003+0000 7f87df1fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.017 INFO:tasks.ceph.osd.7.smithi145.stderr:2023-05-11T07:35:24.015+0000 7f09571fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.020 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-05-11T07:35:24.018+0000 7f2fcb5f7700 -1 osd.4 0 waiting for initial osdmap 2023-05-11T07:35:24.028 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-05-11T07:35:24.026+0000 7fd63c1f7700 -1 osd.6 0 waiting for initial osdmap 2023-05-11T07:35:24.033 INFO:tasks.ceph.osd.4.smithi145.stderr:2023-05-11T07:35:24.031+0000 7f2fc2dfa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.055 INFO:tasks.ceph.osd.6.smithi145.stderr:2023-05-11T07:35:24.053+0000 7fd6339fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.312 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:24.366 INFO:tasks.ceph.osd.3.smithi144.stderr:2023-05-11T07:35:24.359+0000 7f338b7f7700 -1 osd.3 0 waiting for initial osdmap 2023-05-11T07:35:24.384 INFO:tasks.ceph.osd.3.smithi144.stderr:2023-05-11T07:35:24.380+0000 7f3382ffa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.516 INFO:tasks.ceph.osd.1.smithi144.stderr:2023-05-11T07:35:24.512+0000 7f8ddf3f8700 -1 osd.1 0 waiting for initial osdmap 2023-05-11T07:35:24.554 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-05-11T07:35:24.550+0000 7f88c17f7700 -1 osd.2 0 waiting for initial osdmap 2023-05-11T07:35:24.586 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.582+0000 7f30f5fff700 1 Processor -- start 2023-05-11T07:35:24.586 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.583+0000 7f30f5fff700 1 -- start start 2023-05-11T07:35:24.588 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.584+0000 7f30f5fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f015ca70 0x7f30f006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.588 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.584+0000 7f30f5fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30f006b330 0x7f30f0160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.588 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.584+0000 7f30f5fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f00cfa10 con 0x7f30f00d2970 2023-05-11T07:35:24.588 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.584+0000 7f30f5fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00cf730 con 0x7f30f006b330 2023-05-11T07:35:24.588 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.584+0000 7f30f5fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cd880 con 0x7f30f015ca70 2023-05-11T07:35:24.589 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30f006b330 0x7f30f0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.589 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30f006b330 0x7f30f0160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52108/0 (socket says 172.21.15.144:52108) 2023-05-11T07:35:24.589 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 -- 172.21.15.144:0/47618276 learned_addr learned my addr 172.21.15.144:0/47618276 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:24.589 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30ef7fe700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f015ca70 0x7f30f006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.590 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 -- 172.21.15.144:0/47618276 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f015ca70 msgr2=0x7f30f006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f015ca70 0x7f30f006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 -- 172.21.15.144:0/47618276 >> v1:172.21.15.145:6789/0 conn(0x7f30f00d2970 legacy=0x7f30f006ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 -- 172.21.15.144:0/47618276 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00cded0 con 0x7f30f006b330 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.585+0000 7f30effff700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f006b330 0x7f30f0160460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009e50 tx=0x7f30e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9689cce387b00a38 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30eeffd700 1 -- 172.21.15.144:0/47618276 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800e070 con 0x7f30f006b330 2023-05-11T07:35:24.591 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30eeffd700 1 -- 172.21.15.144:0/47618276 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800b910 con 0x7f30f006b330 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30eeffd700 1 -- 172.21.15.144:0/47618276 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800bcc0 con 0x7f30f006b330 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 -- 172.21.15.144:0/47618276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f006b330 msgr2=0x7f30f0160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f006b330 0x7f30f0160460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009e50 tx=0x7f30e800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 -- 172.21.15.144:0/47618276 shutdown_connections 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f006b330 0x7f30f0160460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 --2- 172.21.15.144:0/47618276 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f015ca70 0x7f30f006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 -- 172.21.15.144:0/47618276 >> 172.21.15.144:0/47618276 conn(0x7f30f00d3120 msgr2=0x7f30f00d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:24.592 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 -- 172.21.15.144:0/47618276 shutdown_connections 2023-05-11T07:35:24.593 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.586+0000 7f30f5fff700 1 -- 172.21.15.144:0/47618276 wait complete. 2023-05-11T07:35:24.594 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.588+0000 7f30f5fff700 1 Processor -- start 2023-05-11T07:35:24.594 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.588+0000 7f30f5fff700 1 -- start start 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f006b330 0x7f30f0153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30f00d2970 0x7f30f00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0154220 con 0x7f30f015ca70 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cb8f0 con 0x7f30f00d2970 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30f5fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00cd120 con 0x7f30f006b330 2023-05-11T07:35:24.595 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52122/0 (socket says 172.21.15.144:52122) 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30effff700 1 -- 172.21.15.144:0/4201514897 learned_addr learned my addr 172.21.15.144:0/4201514897 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30e7fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30f00d2970 0x7f30f00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.589+0000 7f30ef7fe700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f006b330 0x7f30f0153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 -- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f006b330 msgr2=0x7f30f0153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f006b330 0x7f30f0153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.596 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 -- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30f00d2970 msgr2=0x7f30f00ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30f00d2970 0x7f30f00ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 -- 172.21.15.144:0/4201514897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009b30 con 0x7f30f015ca70 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30effff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30f00b5d10 tx=0x7f30e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8004800 con 0x7f30f015ca70 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8004960 con 0x7f30f015ca70 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e801b670 con 0x7f30f015ca70 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00d2de0 con 0x7f30f015ca70 2023-05-11T07:35:24.597 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.590+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00cdb60 con 0x7f30f015ca70 2023-05-11T07:35:24.598 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.591+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f00b25e0 con 0x7f30f015ca70 2023-05-11T07:35:24.598 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.592+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f30e801b7d0 con 0x7f30f015ca70 2023-05-11T07:35:24.599 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.594+0000 7f30ecff9700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 0x7f30d006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:24.599 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.594+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f30e8089cd0 con 0x7f30f015ca70 2023-05-11T07:35:24.599 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.594+0000 7f30ef7fe700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 0x7f30d006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:24.599 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.594+0000 7f30ef7fe700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 0x7f30d006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009be0 tx=0x7f30e0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:24.602 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.599+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f30e8055d40 con 0x7f30f015ca70 2023-05-11T07:35:24.629 INFO:tasks.ceph.osd.1.smithi144.stderr:2023-05-11T07:35:24.625+0000 7f8dd63fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.629 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-05-11T07:35:24.625+0000 7f88b8ffa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:24.812 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.807+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30f008bda0 con 0x7f30f015ca70 2023-05-11T07:35:24.812 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.808+0000 7f30ecff9700 1 -- 172.21.15.144:0/4201514897 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f30e8059360 con 0x7f30f015ca70 2023-05-11T07:35:24.812 INFO:teuthology.misc.health.smithi144.stdout: 2023-05-11T07:35:24.812 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":12,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:21.766941+0000","last_up_change":"0.000000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:24.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 msgr2=0x7f30d006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 0x7f30d006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009be0 tx=0x7f30e0009210 comp rx=0 tx=0).stop 2023-05-11T07:35:24.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 msgr2=0x7f30f00c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:24.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30f00b5d10 tx=0x7f30e8004ad0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 shutdown_connections 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f30d006ac50 0x7f30d006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30f006b330 0x7f30f0153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30f015ca70 0x7f30f00c98c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 --2- 172.21.15.144:0/4201514897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30f00d2970 0x7f30f00ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.810+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 >> 172.21.15.144:0/4201514897 conn(0x7f30f00d3120 msgr2=0x7f30f015f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.811+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 shutdown_connections 2023-05-11T07:35:24.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:24.811+0000 7f30f5fff700 1 -- 172.21.15.144:0/4201514897 wait complete. 2023-05-11T07:35:24.829 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-11T07:35:25.880 INFO:tasks.ceph.osd.0.smithi144.stderr:2023-05-11T07:35:25.876+0000 7f434abf7700 -1 osd.0 0 waiting for initial osdmap 2023-05-11T07:35:25.895 INFO:tasks.ceph.osd.0.smithi144.stderr:2023-05-11T07:35:25.892+0000 7f43423fa700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T07:35:31.635 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:31.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.810+0000 7f0f829ff700 1 Processor -- start 2023-05-11T07:35:31.814 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.810+0000 7f0f829ff700 1 -- start start 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.811+0000 7f0f829ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f7c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.811+0000 7f0f829ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0f7c15b490 0x7f0f7c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.811+0000 7f0f829ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c15e290 con 0x7f0f7c15efc0 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.811+0000 7f0f829ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0cb3a0 con 0x7f0f7c15b490 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.811+0000 7f0f829ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c15eb30 con 0x7f0f7c154f40 2023-05-11T07:35:31.815 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7b7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f7c15efc0 0x7f0f7c15ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45244/0 (socket says 172.21.15.144:45244) 2023-05-11T07:35:31.816 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/395314111 learned_addr learned my addr 172.21.15.144:0/395314111 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:31.818 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7bfff700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f7c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.818 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f80f9c700 1 --2- 172.21.15.144:0/395314111 >> v2:172.21.15.145:3300/0 conn(0x7f0f7c15b490 0x7f0f7c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.818 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409637154 0 0) 0x7f0f7c15e290 con 0x7f0f7c15efc0 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f640035b0 con 0x7f0f7c15efc0 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851799978 0 0) 0x7f0f640035b0 con 0x7f0f7c15efc0 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 msgr2=0x7f0f7c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f7c0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 >> v2:172.21.15.145:3300/0 conn(0x7f0f7c15b490 msgr2=0x7f0f7c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 --2- 172.21.15.144:0/395314111 >> v2:172.21.15.145:3300/0 conn(0x7f0f7c15b490 0x7f0f7c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.819 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c15bad0 con 0x7f0f7c15efc0 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f0f70001670 con 0x7f0f7c15efc0 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 >> v1:172.21.15.144:6789/0 conn(0x7f0f7c15efc0 legacy=0x7f0f7c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f64003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64003fd0 0x7f0f64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64004d90 0x7f0f64005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0cb3a0 con 0x7f0f64003fd0 2023-05-11T07:35:31.820 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c15eb30 con 0x7f0f64004d90 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.812+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6400ba90 con 0x7f0f7c154f40 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f80f9c700 1 --2- 172.21.15.144:0/395314111 >> v2:172.21.15.145:3300/0 conn(0x7f0f7c15b490 0x7f0f7c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64003fd0 0x7f0f64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7bfff700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f64003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f80f9c700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64004d90 0x7f0f64005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 msgr2=0x7f0f64003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c154f40 0x7f0f64003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.821 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64004d90 msgr2=0x7f0f64005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64004d90 0x7f0f64005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/395314111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640035b0 con 0x7f0f64003fd0 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f80f9c700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64004d90 0x7f0f64005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.813+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64003fd0 0x7f0f64004850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c160 tx=0x7f0f64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e137407e6016be1 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007b70 con 0x7f0f64003fd0 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000cd00 con 0x7f0f64003fd0 2023-05-11T07:35:31.822 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f7affd700 1 -- 172.21.15.144:0/395314111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70005ba0 con 0x7f0f64003fd0 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 -- 172.21.15.144:0/395314111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64003fd0 msgr2=0x7f0f64004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 --2- 172.21.15.144:0/395314111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64003fd0 0x7f0f64004850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c160 tx=0x7f0f64005880 comp rx=0 tx=0).stop 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f80f9c700 1 -- 172.21.15.144:0/395314111 reap_dead start 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 -- 172.21.15.144:0/395314111 shutdown_connections 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 -- 172.21.15.144:0/395314111 >> 172.21.15.144:0/395314111 conn(0x7f0f7c0cb700 msgr2=0x7f0f7c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 -- 172.21.15.144:0/395314111 shutdown_connections 2023-05-11T07:35:31.823 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.814+0000 7f0f829ff700 1 -- 172.21.15.144:0/395314111 wait complete. 2023-05-11T07:35:31.825 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.817+0000 7f0f829ff700 1 Processor -- start 2023-05-11T07:35:31.825 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.817+0000 7f0f829ff700 1 -- start start 2023-05-11T07:35:31.825 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64003fd0 0x7f0f7c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.825 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c157420 0x7f0f7c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1584d0 con 0x7f0f7c1537e0 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c154080 con 0x7f0f64003fd0 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f829ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c156660 con 0x7f0f7c157420 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f7b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52938/0 (socket says 172.21.15.144:52938) 2023-05-11T07:35:31.826 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/1405195000 learned_addr learned my addr 172.21.15.144:0/1405195000 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.818+0000 7f0f7bfff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64003fd0 0x7f0f7c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f80f9c700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c157420 0x7f0f7c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c157420 msgr2=0x7f0f7c157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c157420 0x7f0f7c157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64003fd0 msgr2=0x7f0f7c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64003fd0 0x7f0f7c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:31.827 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 -- 172.21.15.144:0/1405195000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c15e7c0 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f7b7fe700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f70005b30 tx=0x7f0f70001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000ce70 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f700070d0 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c15e4e0 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007460 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.819+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0b0700 con 0x7f0f7c1537e0 2023-05-11T07:35:31.828 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.820+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c06f3a0 con 0x7f0f7c1537e0 2023-05-11T07:35:31.829 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.821+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f70019030 con 0x7f0f7c1537e0 2023-05-11T07:35:31.829 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.822+0000 7f0f78ff9700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:31.829 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.822+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f7008a580 con 0x7f0f7c1537e0 2023-05-11T07:35:31.829 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.822+0000 7f0f7bfff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:31.830 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.823+0000 7f0f7bfff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 0x7f0f6806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009b80 tx=0x7f0f6c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:31.830 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:31.827+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0f70055b80 con 0x7f0f7c1537e0 2023-05-11T07:35:32.026 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.023+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f7c074530 con 0x7f0f7c1537e0 2023-05-11T07:35:32.027 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.024+0000 7f0f78ff9700 1 -- 172.21.15.144:0/1405195000 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f0f700591a0 con 0x7f0f7c1537e0 2023-05-11T07:35:32.028 INFO:teuthology.misc.health.smithi144.stdout: 2023-05-11T07:35:32.028 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":16,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:28.010509+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 msgr2=0x7f0f6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 0x7f0f6806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009b80 tx=0x7f0f6c009210 comp rx=0 tx=0).stop 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 msgr2=0x7f0f7c15cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f70005b30 tx=0x7f0f70001930 comp rx=0 tx=0).stop 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 shutdown_connections 2023-05-11T07:35:32.030 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.031 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f7c157420 0x7f0f7c157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.031 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f64003fd0 0x7f0f7c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.031 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 --2- 172.21.15.144:0/1405195000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7c1537e0 0x7f0f7c15cf80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.031 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 >> 172.21.15.144:0/1405195000 conn(0x7f0f7c0cb700 msgr2=0x7f0f7c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:32.031 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 shutdown_connections 2023-05-11T07:35:32.032 INFO:teuthology.misc.health.smithi144.stderr:2023-05-11T07:35:32.026+0000 7f0f829ff700 1 -- 172.21.15.144:0/1405195000 wait complete. 2023-05-11T07:35:32.045 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-11T07:35:32.045 INFO:tasks.ceph:Creating RBD pool 2023-05-11T07:35:32.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-11T07:35:32.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 Processor -- start 2023-05-11T07:35:32.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 -- start start 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c15c940 0x7f631c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f631c0b5fd0 0x7f631c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f631c0b6420 0x7f631c06b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c161420 con 0x7f631c0b5fd0 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c0d0e80 con 0x7f631c0b6420 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f6322dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0cdb00 con 0x7f631c15c940 2023-05-11T07:35:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f631bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f631c0b5fd0 0x7f631c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f631bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f631c0b5fd0 0x7f631c06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52944/0 (socket says 172.21.15.144:52944) 2023-05-11T07:35:32.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.223+0000 7f631bfff700 1 -- 172.21.15.144:0/3774492712 learned_addr learned my addr 172.21.15.144:0/3774492712 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:32.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f6320b9b700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c15c940 0x7f631c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f632139c700 1 --2- 172.21.15.144:0/3774492712 >> v2:172.21.15.145:3300/0 conn(0x7f631c0b6420 0x7f631c06b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 -- 172.21.15.144:0/3774492712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c15c940 msgr2=0x7f631c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c15c940 0x7f631c160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 -- 172.21.15.144:0/3774492712 >> v2:172.21.15.145:3300/0 conn(0x7f631c0b6420 msgr2=0x7f631c06b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 --2- 172.21.15.144:0/3774492712 >> v2:172.21.15.145:3300/0 conn(0x7f631c0b6420 0x7f631c06b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 -- 172.21.15.144:0/3774492712 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0cdde0 con 0x7f631c0b5fd0 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631bfff700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c0b5fd0 0x7f631c06ac40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f631c06bcb0 tx=0x7f6308009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c967e7f9e3c15b59 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631b7fe700 1 -- 172.21.15.144:0/3774492712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800b870 con 0x7f631c0b5fd0 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631b7fe700 1 -- 172.21.15.144:0/3774492712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800b9d0 con 0x7f631c0b5fd0 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.224+0000 7f631b7fe700 1 -- 172.21.15.144:0/3774492712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800bd60 con 0x7f631c0b5fd0 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 -- 172.21.15.144:0/3774492712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c0b5fd0 msgr2=0x7f631c06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c0b5fd0 0x7f631c06ac40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f631c06bcb0 tx=0x7f6308009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 -- 172.21.15.144:0/3774492712 shutdown_connections 2023-05-11T07:35:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 --2- 172.21.15.144:0/3774492712 >> v2:172.21.15.145:3300/0 conn(0x7f631c0b6420 0x7f631c06b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c15c940 0x7f631c160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 --2- 172.21.15.144:0/3774492712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c0b5fd0 0x7f631c06ac40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 -- 172.21.15.144:0/3774492712 >> 172.21.15.144:0/3774492712 conn(0x7f631c0d3180 msgr2=0x7f631c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:32.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 -- 172.21.15.144:0/3774492712 shutdown_connections 2023-05-11T07:35:32.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.225+0000 7f6322dff700 1 -- 172.21.15.144:0/3774492712 wait complete. 2023-05-11T07:35:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.227+0000 7f6322dff700 1 Processor -- start 2023-05-11T07:35:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.227+0000 7f6322dff700 1 -- start start 2023-05-11T07:35:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f631c0b5fd0 0x7f631c1f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 0x7f631c0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c1f32d0 con 0x7f631c15c940 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c153480 con 0x7f631c0b5fd0 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6322dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c1f20e0 con 0x7f631c0b6420 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52950/0 (socket says 172.21.15.144:52950) 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 -- 172.21.15.144:0/3593894457 learned_addr learned my addr 172.21.15.144:0/3593894457 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:32.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f6320b9b700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f631c0b5fd0 0x7f631c1f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f631bfff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 0x7f631c0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 -- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 msgr2=0x7f631c0cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 0x7f631c0cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 -- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f631c0b5fd0 msgr2=0x7f631c1f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f631c0b5fd0 0x7f631c1f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 -- 172.21.15.144:0/3593894457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308009550 con 0x7f631c15c940 2023-05-11T07:35:32.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f631bfff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 0x7f631c0cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.228+0000 7f632139c700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6314007e90 tx=0x7f631400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.229+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400ede0 con 0x7f631c15c940 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.229+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314014420 con 0x7f631c15c940 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.229+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140147d0 con 0x7f631c15c940 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.229+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c0d1400 con 0x7f631c15c940 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.229+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c0d1120 con 0x7f631c15c940 2023-05-11T07:35:32.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.230+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c15cd10 con 0x7f631c15c940 2023-05-11T07:35:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.231+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6314014930 con 0x7f631c15c940 2023-05-11T07:35:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.232+0000 7f63197fa700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 0x7f630006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.232+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6314089760 con 0x7f631c15c940 2023-05-11T07:35:32.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.232+0000 7f6320b9b700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 0x7f630006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.233+0000 7f6320b9b700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 0x7f630006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f631c0c9f60 tx=0x7f6310008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:32.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.236+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6314054c20 con 0x7f631c15c940 2023-05-11T07:35:32.434 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.430+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f631c0744c0 con 0x7f631c15c940 2023-05-11T07:35:32.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:35:32.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:35:32.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.810+0000 7f63197fa700 1 -- 172.21.15.144:0/3593894457 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6314058240 con 0x7f631c15c940 2023-05-11T07:35:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 msgr2=0x7f630006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 0x7f630006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f631c0c9f60 tx=0x7f6310008040 comp rx=0 tx=0).stop 2023-05-11T07:35:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 msgr2=0x7f631c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6314007e90 tx=0x7f631400e3c0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 shutdown_connections 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f630006ace0 0x7f630006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f631c15c940 0x7f631c0ccaf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f631c0b5fd0 0x7f631c1f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 --2- 172.21.15.144:0/3593894457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f631c0b6420 0x7f631c0cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 >> 172.21.15.144:0/3593894457 conn(0x7f631c0d3180 msgr2=0x7f631c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 shutdown_connections 2023-05-11T07:35:32.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:32.813+0000 7f6322dff700 1 -- 172.21.15.144:0/3593894457 wait complete. 2023-05-11T07:35:32.818 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'rbd' created 2023-05-11T07:35:32.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-11T07:35:33.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.013+0000 7faa78bff700 1 Processor -- start 2023-05-11T07:35:33.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.013+0000 7faa78bff700 1 -- start start 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa78bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa740ce530 0x7faa740ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa78bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7415af30 con 0x7faa740718e0 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa78bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa740cca60 con 0x7faa7415e680 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa78bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7415ebf0 con 0x7faa740ce530 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa7259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faa740718e0 0x7faa74071cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45246/0 (socket says 172.21.15.144:45246) 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa7259c700 1 -- 172.21.15.144:0/3725020721 learned_addr learned my addr 172.21.15.144:0/3725020721 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:33.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.014+0000 7faa72d9d700 1 --2- 172.21.15.144:0/3725020721 >> v2:172.21.15.144:3300/0 conn(0x7faa740ce530 0x7faa740ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa7159a700 1 -- 172.21.15.144:0/3725020721 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247164321 0 0) 0x7faa7415af30 con 0x7faa740718e0 2023-05-11T07:35:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa7159a700 1 -- 172.21.15.144:0/3725020721 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa5c0035b0 con 0x7faa740718e0 2023-05-11T07:35:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa72d9d700 1 -- 172.21.15.144:0/3725020721 >> v1:172.21.15.145:6789/0 conn(0x7faa7415e680 legacy=0x7faa7406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa72d9d700 1 -- 172.21.15.144:0/3725020721 >> v1:172.21.15.144:6789/0 conn(0x7faa740718e0 legacy=0x7faa74071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa72d9d700 1 -- 172.21.15.144:0/3725020721 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7415eed0 con 0x7faa740ce530 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa72d9d700 1 --2- 172.21.15.144:0/3725020721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740ccf40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009d90 tx=0x7faa6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1256ef0b4974504a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa7159a700 1 -- 172.21.15.144:0/3725020721 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00e070 con 0x7faa740ce530 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa7159a700 1 -- 172.21.15.144:0/3725020721 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00bb20 con 0x7faa740ce530 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.015+0000 7faa7159a700 1 -- 172.21.15.144:0/3725020721 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c012430 con 0x7faa740ce530 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 -- 172.21.15.144:0/3725020721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 msgr2=0x7faa740ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 --2- 172.21.15.144:0/3725020721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740ccf40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009d90 tx=0x7faa6c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:33.020 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 -- 172.21.15.144:0/3725020721 shutdown_connections 2023-05-11T07:35:33.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 --2- 172.21.15.144:0/3725020721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740ccf40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 -- 172.21.15.144:0/3725020721 >> 172.21.15.144:0/3725020721 conn(0x7faa740cef20 msgr2=0x7faa740cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:33.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 -- 172.21.15.144:0/3725020721 shutdown_connections 2023-05-11T07:35:33.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.016+0000 7faa78bff700 1 -- 172.21.15.144:0/3725020721 wait complete. 2023-05-11T07:35:33.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.018+0000 7faa78bff700 1 Processor -- start 2023-05-11T07:35:33.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.019+0000 7faa78bff700 1 -- start start 2023-05-11T07:35:33.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa740718e0 0x7faa74158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:33.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa7415e680 0x7faa740b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74158ea0 con 0x7faa740ce530 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa740af260 con 0x7faa740718e0 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa78bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa740af540 con 0x7faa7415e680 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52962/0 (socket says 172.21.15.144:52962) 2023-05-11T07:35:33.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 -- 172.21.15.144:0/3881714156 learned_addr learned my addr 172.21.15.144:0/3881714156 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:33.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa7259c700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa740718e0 0x7faa74158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 -- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa7415e680 msgr2=0x7faa740b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa7415e680 0x7faa740b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.020+0000 7faa71d9b700 1 -- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa740718e0 msgr2=0x7faa74158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa71d9b700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa740718e0 0x7faa74158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa71d9b700 1 -- 172.21.15.144:0/3881714156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c009a70 con 0x7faa740ce530 2023-05-11T07:35:33.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa71d9b700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c420 tx=0x7faa6800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680052d0 con 0x7faa740ce530 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68005430 con 0x7faa740ce530 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7415f490 con 0x7faa740ce530 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680038c0 con 0x7faa740ce530 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.021+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7415f1b0 con 0x7faa740ce530 2023-05-11T07:35:33.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.022+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7406d980 con 0x7faa740ce530 2023-05-11T07:35:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.023+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa68003a20 con 0x7faa740ce530 2023-05-11T07:35:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.024+0000 7faa62ffd700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 0x7faa5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.024+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7faa68088480 con 0x7faa740ce530 2023-05-11T07:35:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.024+0000 7faa7259c700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 0x7faa5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.025+0000 7faa7259c700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 0x7faa5406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa640011e0 tx=0x7faa64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:33.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.029+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faa68053920 con 0x7faa740ce530 2023-05-11T07:35:33.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.224+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faa740744c0 con 0x7faa740ce530 2023-05-11T07:35:33.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.817+0000 7faa62ffd700 1 -- 172.21.15.144:0/3881714156 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7faa68056f40 con 0x7faa740ce530 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 msgr2=0x7faa5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 0x7faa5406d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa640011e0 tx=0x7faa64009040 comp rx=0 tx=0).stop 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 msgr2=0x7faa740c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c420 tx=0x7faa6800c7e0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 shutdown_connections 2023-05-11T07:35:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7faa5406ace0 0x7faa5406d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faa7415e680 0x7faa740b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa740718e0 0x7faa74158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 --2- 172.21.15.144:0/3881714156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740ce530 0x7faa740c8650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 >> 172.21.15.144:0/3881714156 conn(0x7faa740cef20 msgr2=0x7faa740cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 shutdown_connections 2023-05-11T07:35:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:33.821+0000 7faa78bff700 1 -- 172.21.15.144:0/3881714156 wait complete. 2023-05-11T07:35:33.826 INFO:teuthology.orchestra.run.smithi144.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-11T07:35:33.844 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-11T07:35:33.844 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-11T07:35:33.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-11T07:35:33.848 INFO:tasks.ceph.mds.a:Started 2023-05-11T07:35:33.849 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-11T07:35:33.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-11T07:35:33.852 INFO:tasks.ceph.mds.c:Started 2023-05-11T07:35:33.853 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-11T07:35:33.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-11T07:35:33.857 INFO:tasks.ceph.mds.b:Started 2023-05-11T07:35:33.857 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-11T07:35:33.857 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-11T07:35:33.860 INFO:tasks.ceph.mds.d:Started 2023-05-11T07:35:33.861 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-11T07:35:33.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:33.992 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2023-05-11T07:35:33.993 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2023-05-11T07:35:34.001 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2023-05-11T07:35:34.001 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-05-11T07:35:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.058+0000 7f6b16fff700 1 Processor -- start 2023-05-11T07:35:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.058+0000 7f6b16fff700 1 -- start start 2023-05-11T07:35:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100b87e0 0x7f6b100b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b100d02c0 0x7f6b100b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b100d2090 0x7f6b100d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b100b5a80 con 0x7f6b100d02c0 2023-05-11T07:35:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b100cdf70 con 0x7f6b100d2090 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.059+0000 7f6b16fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100cfe70 con 0x7f6b100b87e0 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b100d02c0 0x7f6b100b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b100d02c0 0x7f6b100b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53004/0 (socket says 172.21.15.144:53004) 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 -- 172.21.15.144:0/4119828406 learned_addr learned my addr 172.21.15.144:0/4119828406 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b1559c700 1 --2- 172.21.15.144:0/4119828406 >> v2:172.21.15.145:3300/0 conn(0x7f6b100d2090 0x7f6b100d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b14d9b700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100b87e0 0x7f6b100b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 -- 172.21.15.144:0/4119828406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100b87e0 msgr2=0x7f6b100b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100b87e0 0x7f6b100b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 -- 172.21.15.144:0/4119828406 >> v2:172.21.15.145:3300/0 conn(0x7f6b100d2090 msgr2=0x7f6b100d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/4119828406 >> v2:172.21.15.145:3300/0 conn(0x7f6b100d2090 0x7f6b100d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 -- 172.21.15.144:0/4119828406 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1015cef0 con 0x7f6b100d02c0 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100d02c0 0x7f6b100b50d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b100cffb0 tx=0x7f6afc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e34631e29deb9f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0f7fe700 1 -- 172.21.15.144:0/4119828406 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc004230 con 0x7f6b100d02c0 2023-05-11T07:35:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0f7fe700 1 -- 172.21.15.144:0/4119828406 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc004390 con 0x7f6b100d02c0 2023-05-11T07:35:34.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.060+0000 7f6b0f7fe700 1 -- 172.21.15.144:0/4119828406 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0036a0 con 0x7f6b100d02c0 2023-05-11T07:35:34.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 -- 172.21.15.144:0/4119828406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100d02c0 msgr2=0x7f6b100b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100d02c0 0x7f6b100b50d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b100cffb0 tx=0x7f6afc009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 -- 172.21.15.144:0/4119828406 shutdown_connections 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 --2- 172.21.15.144:0/4119828406 >> v2:172.21.15.145:3300/0 conn(0x7f6b100d2090 0x7f6b100d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100b87e0 0x7f6b100b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 --2- 172.21.15.144:0/4119828406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100d02c0 0x7f6b100b50d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 -- 172.21.15.144:0/4119828406 >> 172.21.15.144:0/4119828406 conn(0x7f6b1006acf0 msgr2=0x7f6b1006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 -- 172.21.15.144:0/4119828406 shutdown_connections 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.061+0000 7f6b16fff700 1 -- 172.21.15.144:0/4119828406 wait complete. 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.063+0000 7f6b16fff700 1 Processor -- start 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.063+0000 7f6b16fff700 1 -- start start 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100d02c0 0x7f6b101f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b100d2090 0x7f6b101f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100ca380 con 0x7f6b100b87e0 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100ca660 con 0x7f6b100d2090 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b16fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100ca940 con 0x7f6b100d02c0 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b14d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b14d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53012/0 (socket says 172.21.15.144:53012) 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b14d9b700 1 -- 172.21.15.144:0/2322415250 learned_addr learned my addr 172.21.15.144:0/2322415250 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b1559c700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b100d2090 0x7f6b101f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.064+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100d02c0 0x7f6b101f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 -- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100d02c0 msgr2=0x7f6b101f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100d02c0 0x7f6b101f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 -- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b100d2090 msgr2=0x7f6b101f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b100d2090 0x7f6b101f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 -- 172.21.15.144:0/2322415250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009550 con 0x7f6b100b87e0 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b14d9b700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e930 tx=0x7f6b0400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04013680 con 0x7f6b100b87e0 2023-05-11T07:35:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b040137e0 con 0x7f6b100b87e0 2023-05-11T07:35:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b100d2d30 con 0x7f6b100b87e0 2023-05-11T07:35:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04013b70 con 0x7f6b100b87e0 2023-05-11T07:35:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.065+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b100cd760 con 0x7f6b100b87e0 2023-05-11T07:35:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.066+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b100cd9b0 con 0x7f6b100b87e0 2023-05-11T07:35:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.067+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b04013cd0 con 0x7f6b100b87e0 2023-05-11T07:35:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.068+0000 7f6b0d7fa700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.068+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b040890b0 con 0x7f6b100b87e0 2023-05-11T07:35:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.068+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.069+0000 7f6b0ffff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 0x7f6af406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009130 tx=0x7f6afc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.072+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b040544a0 con 0x7f6b100b87e0 2023-05-11T07:35:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.269+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b100cb270 con 0x7f6b100b87e0 2023-05-11T07:35:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.271+0000 7f6b0d7fa700 1 -- 172.21.15.144:0/2322415250 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14685 (secure 0 0 0) 0x7f6b04057ac0 con 0x7f6b100b87e0 2023-05-11T07:35:34.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:34.273 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:33.810143+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 msgr2=0x7f6af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 0x7f6af406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009130 tx=0x7f6afc008030 comp rx=0 tx=0).stop 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 msgr2=0x7f6b101f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e930 tx=0x7f6b0400ec40 comp rx=0 tx=0).stop 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 shutdown_connections 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6af406ace0 0x7f6af406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b100d2090 0x7f6b101f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b100b87e0 0x7f6b101f3590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 --2- 172.21.15.144:0/2322415250 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b100d02c0 0x7f6b101f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 >> 172.21.15.144:0/2322415250 conn(0x7f6b1006acf0 msgr2=0x7f6b100b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 shutdown_connections 2023-05-11T07:35:34.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.273+0000 7f6b16fff700 1 -- 172.21.15.144:0/2322415250 wait complete. 2023-05-11T07:35:34.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T07:35:34.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:35:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.477+0000 7f6a159ff700 1 Processor -- start 2023-05-11T07:35:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.477+0000 7f6a159ff700 1 -- start start 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a1015c940 0x7f6a10160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 0x7f6a1006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a1006b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a10161420 con 0x7f6a1015c940 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100d0e80 con 0x7f6a100b5fd0 2023-05-11T07:35:34.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a159ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100cdb00 con 0x7f6a100b6420 2023-05-11T07:35:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.478+0000 7f6a0effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a1015c940 0x7f6a10160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a1015c940 0x7f6a10160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53024/0 (socket says 172.21.15.144:53024) 2023-05-11T07:35:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 -- 172.21.15.144:0/2908572335 learned_addr learned my addr 172.21.15.144:0/2908572335 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:34.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0e7fc700 1 --2- 172.21.15.144:0/2908572335 >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 0x7f6a1006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0f7fe700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a1006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 -- 172.21.15.144:0/2908572335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 msgr2=0x7f6a1006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a1006b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 -- 172.21.15.144:0/2908572335 >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 msgr2=0x7f6a1006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 --2- 172.21.15.144:0/2908572335 >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 0x7f6a1006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 -- 172.21.15.144:0/2908572335 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100cdde0 con 0x7f6a1015c940 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0e7fc700 1 --2- 172.21.15.144:0/2908572335 >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 0x7f6a1006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0f7fe700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a1006b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0effd700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a1015c940 0x7f6a10160ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a100d3e60 tx=0x7f6a00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcefb9f949793d9d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0dffb700 1 -- 172.21.15.144:0/2908572335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000b870 con 0x7f6a1015c940 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0dffb700 1 -- 172.21.15.144:0/2908572335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000b9d0 con 0x7f6a1015c940 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.479+0000 7f6a0dffb700 1 -- 172.21.15.144:0/2908572335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000bd60 con 0x7f6a1015c940 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 -- 172.21.15.144:0/2908572335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a1015c940 msgr2=0x7f6a10160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a1015c940 0x7f6a10160ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a100d3e60 tx=0x7f6a00009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 -- 172.21.15.144:0/2908572335 shutdown_connections 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a1006b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 --2- 172.21.15.144:0/2908572335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a1015c940 0x7f6a10160ee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 --2- 172.21.15.144:0/2908572335 >> v2:172.21.15.145:3300/0 conn(0x7f6a100b5fd0 0x7f6a1006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 -- 172.21.15.144:0/2908572335 >> 172.21.15.144:0/2908572335 conn(0x7f6a100d3180 msgr2=0x7f6a100d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 -- 172.21.15.144:0/2908572335 shutdown_connections 2023-05-11T07:35:34.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.480+0000 7f6a159ff700 1 -- 172.21.15.144:0/2908572335 wait complete. 2023-05-11T07:35:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.482+0000 7f6a159ff700 1 Processor -- start 2023-05-11T07:35:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.483+0000 7f6a159ff700 1 -- start start 2023-05-11T07:35:34.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a10159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a1015c940 0x7f6a1015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100ca6f0 con 0x7f6a100b5fd0 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100ca9d0 con 0x7f6a1015c940 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a159ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100cacb0 con 0x7f6a100b6420 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53030/0 (socket says 172.21.15.144:53030) 2023-05-11T07:35:34.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 -- 172.21.15.144:0/3729665012 learned_addr learned my addr 172.21.15.144:0/3729665012 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 -- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 msgr2=0x7f6a10159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a10159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 -- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a1015c940 msgr2=0x7f6a1015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a1015c940 0x7f6a1015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.484+0000 7f6a0effd700 1 -- 172.21.15.144:0/3729665012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009550 con 0x7f6a100b5fd0 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f6a0effd700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a00014040 tx=0x7f6a00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00004520 con 0x7f6a100b5fd0 2023-05-11T07:35:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0001e070 con 0x7f6a100b5fd0 2023-05-11T07:35:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a100d1400 con 0x7f6a100b5fd0 2023-05-11T07:35:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000038e0 con 0x7f6a100b5fd0 2023-05-11T07:35:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.485+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a100d1120 con 0x7f6a100b5fd0 2023-05-11T07:35:34.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.486+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1015cd10 con 0x7f6a100b5fd0 2023-05-11T07:35:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.487+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a00003a40 con 0x7f6a100b5fd0 2023-05-11T07:35:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.488+0000 7f69f7fff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.488+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6a00020070 con 0x7f6a100b5fd0 2023-05-11T07:35:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.488+0000 7f6a0e7fc700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.488+0000 7f6a0e7fc700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 0x7f69fc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a04006fd0 tx=0x7f6a04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.492+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6a00055bf0 con 0x7f6a100b5fd0 2023-05-11T07:35:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.687+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a100744c0 con 0x7f6a100b5fd0 2023-05-11T07:35:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.687+0000 7f69f7fff700 1 -- 172.21.15.144:0/3729665012 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a00059210 con 0x7f6a100b5fd0 2023-05-11T07:35:34.690 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:35:34.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.689+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 msgr2=0x7f69fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.689+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 0x7f69fc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a04006fd0 tx=0x7f6a04008040 comp rx=0 tx=0).stop 2023-05-11T07:35:34.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.689+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 msgr2=0x7f6a101f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.689+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a00014040 tx=0x7f6a00004750 comp rx=0 tx=0).stop 2023-05-11T07:35:34.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 shutdown_connections 2023-05-11T07:35:34.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f69fc06ace0 0x7f69fc06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a1015c940 0x7f6a1015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a100b5fd0 0x7f6a101f1a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 --2- 172.21.15.144:0/3729665012 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6a100b6420 0x7f6a10159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 >> 172.21.15.144:0/3729665012 conn(0x7f6a100d3180 msgr2=0x7f6a100b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 shutdown_connections 2023-05-11T07:35:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.690+0000 7f6a159ff700 1 -- 172.21.15.144:0/3729665012 wait complete. 2023-05-11T07:35:34.709 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:35:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.896+0000 7ff45efff700 1 Processor -- start 2023-05-11T07:35:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.897+0000 7ff45efff700 1 -- start start 2023-05-11T07:35:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff45806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45efff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4580d0e80 con 0x7ff45815c940 2023-05-11T07:35:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45efff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4580cdb00 con 0x7ff45806b180 2023-05-11T07:35:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45806b600 con 0x7ff458160ee0 2023-05-11T07:35:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45cd9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff45815c940 0x7ff4580b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45264/0 (socket says 172.21.15.144:45264) 2023-05-11T07:35:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff45cd9b700 1 -- 172.21.15.144:0/1362756304 learned_addr learned my addr 172.21.15.144:0/1362756304 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639402499 0 0) 0x7ff4580d0e80 con 0x7ff45815c940 2023-05-11T07:35:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4480035b0 con 0x7ff45815c940 2023-05-11T07:35:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.898+0000 7ff457fff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff45806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210812370 0 0) 0x7ff4480035b0 con 0x7ff45815c940 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 msgr2=0x7ff45806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff45806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 >> v1:172.21.15.145:6789/0 conn(0x7ff45806b180 legacy=0x7ff4580d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580cdde0 con 0x7ff45815c940 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7ff44c001670 con 0x7ff45815c940 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 >> v1:172.21.15.144:6789/0 conn(0x7ff45815c940 legacy=0x7ff4580b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff448003a30 0x7ff448003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff448004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff448005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45806b600 con 0x7ff448004850 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800baf0 con 0x7ff448003a30 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800bcb0 con 0x7ff458160ee0 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff457fff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff448004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff45cd9b700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff448003a30 0x7ff448003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff45d59c700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff448005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff457fff700 1 -- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 msgr2=0x7ff448005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff457fff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458160ee0 0x7ff448005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff457fff700 1 -- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff448003a30 msgr2=0x7ff448003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.899+0000 7ff457fff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff448003a30 0x7ff448003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff457fff700 1 -- 172.21.15.144:0/1362756304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480035b0 con 0x7ff448004850 2023-05-11T07:35:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff457fff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff448004cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff444009b60 tx=0x7ff448005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f71274f5dd46391 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400e6c0 con 0x7ff448004850 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44400e820 con 0x7ff448004850 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff4577fe700 1 -- 172.21.15.144:0/1362756304 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400eb90 con 0x7ff448004850 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff45efff700 1 -- 172.21.15.144:0/1362756304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 msgr2=0x7ff448004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff45efff700 1 --2- 172.21.15.144:0/1362756304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff448004cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff444009b60 tx=0x7ff448005880 comp rx=0 tx=0).stop 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.900+0000 7ff45d59c700 1 -- 172.21.15.144:0/1362756304 reap_dead start 2023-05-11T07:35:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.901+0000 7ff45efff700 1 -- 172.21.15.144:0/1362756304 shutdown_connections 2023-05-11T07:35:34.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.901+0000 7ff45efff700 1 -- 172.21.15.144:0/1362756304 >> 172.21.15.144:0/1362756304 conn(0x7ff4580d3180 msgr2=0x7ff4580d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:34.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.901+0000 7ff45efff700 1 -- 172.21.15.144:0/1362756304 shutdown_connections 2023-05-11T07:35:34.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.901+0000 7ff45efff700 1 -- 172.21.15.144:0/1362756304 wait complete. 2023-05-11T07:35:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.902+0000 7ff45efff700 1 Processor -- start 2023-05-11T07:35:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.902+0000 7ff45efff700 1 -- start start 2023-05-11T07:35:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 0x7ff4581569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 0x7ff458158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45815e2c0 con 0x7ff448004850 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4581f2820 con 0x7ff4581585f0 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff458156f10 con 0x7ff458156560 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.903+0000 7ff45cd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53036/0 (socket says 172.21.15.144:53036) 2023-05-11T07:35:34.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 -- 172.21.15.144:0/606801093 learned_addr learned my addr 172.21.15.144:0/606801093 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff457fff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 0x7ff4581569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 -- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 msgr2=0x7ff4581569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 0x7ff4581569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 -- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 msgr2=0x7ff458158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45d59c700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 0x7ff458158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 0x7ff458158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:34.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 -- 172.21.15.144:0/606801093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580d1400 con 0x7ff448004850 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff457fff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 0x7ff4581569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45d59c700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 0x7ff458158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45cd9b700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007fd0 tx=0x7ff44c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0014a0 con 0x7ff448004850 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00f6c0 con 0x7ff448004850 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4580d1120 con 0x7ff448004850 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.904+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00fa90 con 0x7ff448004850 2023-05-11T07:35:34.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.905+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580b66e0 con 0x7ff448004850 2023-05-11T07:35:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.906+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45815e400 con 0x7ff448004850 2023-05-11T07:35:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.906+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff44c00fbf0 con 0x7ff448004850 2023-05-11T07:35:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.907+0000 7ff4557fa700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 0x7ff43c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.908+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff44c089190 con 0x7ff448004850 2023-05-11T07:35:34.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.908+0000 7ff457fff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 0x7ff43c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.908+0000 7ff457fff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 0x7ff43c06d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff458152e30 tx=0x7ff444008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:34.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:34.911+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff45815e400 con 0x7ff448004850 2023-05-11T07:35:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.106+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff45815e400 con 0x7ff448004850 2023-05-11T07:35:35.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.106+0000 7ff4557fa700 1 -- 172.21.15.144:0/606801093 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff45815e400 con 0x7ff448004850 2023-05-11T07:35:35.109 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:35:35.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 msgr2=0x7ff43c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 0x7ff43c06d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff458152e30 tx=0x7ff444008030 comp rx=0 tx=0).stop 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 msgr2=0x7ff4581ef8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007fd0 tx=0x7ff44c007620 comp rx=0 tx=0).stop 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 shutdown_connections 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff43c06ace0 0x7ff43c06d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff4581585f0 0x7ff458158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448004850 0x7ff4581ef8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 --2- 172.21.15.144:0/606801093 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff458156560 0x7ff4581569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 >> 172.21.15.144:0/606801093 conn(0x7ff4580d3180 msgr2=0x7ff4580b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 shutdown_connections 2023-05-11T07:35:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.109+0000 7ff45efff700 1 -- 172.21.15.144:0/606801093 wait complete. 2023-05-11T07:35:35.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:35:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.309+0000 7f4f42bff700 1 Processor -- start 2023-05-11T07:35:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.310+0000 7f4f42bff700 1 -- start start 2023-05-11T07:35:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f42bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f42bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4f3c0d02c0 0x7f4f3c0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f42bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c15cef0 con 0x7f4f3c0b87e0 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f42bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0b5a80 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f42bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cdf70 con 0x7f4f3c0d02c0 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53048/0 (socket says 172.21.15.144:53048) 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 -- 172.21.15.144:0/2451303037 learned_addr learned my addr 172.21.15.144:0/2451303037 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f4119c700 1 --2- 172.21.15.144:0/2451303037 >> v2:172.21.15.145:3300/0 conn(0x7f4f3c0d02c0 0x7f4f3c0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 -- 172.21.15.144:0/2451303037 >> v2:172.21.15.145:3300/0 conn(0x7f4f3c0d02c0 msgr2=0x7f4f3c0d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 --2- 172.21.15.144:0/2451303037 >> v2:172.21.15.145:3300/0 conn(0x7f4f3c0d02c0 0x7f4f3c0d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 -- 172.21.15.144:0/2451303037 >> v1:172.21.15.145:6789/0 conn(0x7f4f3c0b87e0 legacy=0x7f4f3c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.311+0000 7f4f3bfff700 1 -- 172.21.15.144:0/2451303037 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0cd760 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f3bfff700 1 --2- 172.21.15.144:0/2451303037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0d3010 tx=0x7f4f28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dd71c4773c337f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f3b7fe700 1 -- 172.21.15.144:0/2451303037 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800b870 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f3b7fe700 1 -- 172.21.15.144:0/2451303037 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800b9d0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f3b7fe700 1 -- 172.21.15.144:0/2451303037 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800bd60 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 -- 172.21.15.144:0/2451303037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 msgr2=0x7f4f3c0d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 --2- 172.21.15.144:0/2451303037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0d3010 tx=0x7f4f28009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 -- 172.21.15.144:0/2451303037 shutdown_connections 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 --2- 172.21.15.144:0/2451303037 >> v2:172.21.15.145:3300/0 conn(0x7f4f3c0d02c0 0x7f4f3c0d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 --2- 172.21.15.144:0/2451303037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0d2090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.312+0000 7f4f42bff700 1 -- 172.21.15.144:0/2451303037 >> 172.21.15.144:0/2451303037 conn(0x7f4f3c06acf0 msgr2=0x7f4f3c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.313+0000 7f4f42bff700 1 -- 172.21.15.144:0/2451303037 shutdown_connections 2023-05-11T07:35:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.313+0000 7f4f42bff700 1 -- 172.21.15.144:0/2451303037 wait complete. 2023-05-11T07:35:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.315+0000 7f4f42bff700 1 Processor -- start 2023-05-11T07:35:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.315+0000 7f4f42bff700 1 -- start start 2023-05-11T07:35:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f3c0b87e0 0x7f4f3c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f3c0d02c0 0x7f4f3c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cb0b0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0c64b0 con 0x7f4f3c0d02c0 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f42bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c15bff0 con 0x7f4f3c0b87e0 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.316+0000 7f4f4099b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53052/0 (socket says 172.21.15.144:53052) 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 -- 172.21.15.144:0/3203130663 learned_addr learned my addr 172.21.15.144:0/3203130663 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4119c700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f3c0d02c0 0x7f4f3c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f3bfff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f3c0b87e0 0x7f4f3c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 -- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f3c0b87e0 msgr2=0x7f4f3c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f3c0b87e0 0x7f4f3c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 -- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f3c0d02c0 msgr2=0x7f4f3c147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f3c0d02c0 0x7f4f3c147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 -- 172.21.15.144:0/3203130663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009550 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f4099b700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000c4e0 tx=0x7f4f3000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300052d0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30005430 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0cd9b0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300038c0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.317+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0d2d30 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.318+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0cdc90 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.319+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f30003a20 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.321+0000 7f4f397fa700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 0x7f4f2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.321+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f30088540 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.321+0000 7f4f3bfff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 0x7f4f2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.322+0000 7f4f3bfff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 0x7f4f2006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0d3010 tx=0x7f4f28008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.325+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4f300538a0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.564+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f3c15cef0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.564+0000 7f4f397fa700 1 -- 172.21.15.144:0/3203130663 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7f4f30017de0 con 0x7f4f3c0b52a0 2023-05-11T07:35:35.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:35.568 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4306,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-11T07:35:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 msgr2=0x7f4f2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 0x7f4f2006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0d3010 tx=0x7f4f28008030 comp rx=0 tx=0).stop 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 msgr2=0x7f4f3c0c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000c4e0 tx=0x7f4f3000c8a0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 shutdown_connections 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f2006ace0 0x7f4f2006d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f3c0d02c0 0x7f4f3c147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3c0b52a0 0x7f4f3c0c5f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 --2- 172.21.15.144:0/3203130663 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f3c0b87e0 0x7f4f3c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 >> 172.21.15.144:0/3203130663 conn(0x7f4f3c06acf0 msgr2=0x7f4f3c0d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 shutdown_connections 2023-05-11T07:35:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.567+0000 7f4f42bff700 1 -- 172.21.15.144:0/3203130663 wait complete. 2023-05-11T07:35:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 3 2023-05-11T07:35:35.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:35.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.770+0000 7fd0ed7ff700 1 Processor -- start 2023-05-11T07:35:35.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.770+0000 7fd0ed7ff700 1 -- start start 2023-05-11T07:35:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.771+0000 7fd0ed7ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0e80b52a0 0x7fd0e80d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.771+0000 7fd0ed7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0e80d02c0 0x7fd0e80d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.771+0000 7fd0ed7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e815cef0 con 0x7fd0e80b87e0 2023-05-11T07:35:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.771+0000 7fd0ed7ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80b5a80 con 0x7fd0e80b52a0 2023-05-11T07:35:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.771+0000 7fd0ed7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80cdf70 con 0x7fd0e80d02c0 2023-05-11T07:35:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0e80b52a0 0x7fd0e80d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0e80b52a0 0x7fd0e80d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53054/0 (socket says 172.21.15.144:53054) 2023-05-11T07:35:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 -- 172.21.15.144:0/237379719 learned_addr learned my addr 172.21.15.144:0/237379719 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:35.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0e77fe700 1 --2- 172.21.15.144:0/237379719 >> v2:172.21.15.145:3300/0 conn(0x7fd0e80d02c0 0x7fd0e80d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 -- 172.21.15.144:0/237379719 >> v2:172.21.15.145:3300/0 conn(0x7fd0e80d02c0 msgr2=0x7fd0e80d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:35.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 --2- 172.21.15.144:0/237379719 >> v2:172.21.15.145:3300/0 conn(0x7fd0e80d02c0 0x7fd0e80d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 -- 172.21.15.144:0/237379719 >> v1:172.21.15.145:6789/0 conn(0x7fd0e80b87e0 legacy=0x7fd0e80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 -- 172.21.15.144:0/237379719 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80cd760 con 0x7fd0e80b52a0 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.772+0000 7fd0de7fc700 1 --2- 172.21.15.144:0/237379719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80b52a0 0x7fd0e80d2090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80d3010 tx=0x7fd0d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8bcf46977d5789 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0e67fc700 1 -- 172.21.15.144:0/237379719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0004230 con 0x7fd0e80b52a0 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0e67fc700 1 -- 172.21.15.144:0/237379719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d0004390 con 0x7fd0e80b52a0 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0e67fc700 1 -- 172.21.15.144:0/237379719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00036a0 con 0x7fd0e80b52a0 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/237379719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80b52a0 msgr2=0x7fd0e80d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/237379719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80b52a0 0x7fd0e80d2090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80d3010 tx=0x7fd0d0009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/237379719 shutdown_connections 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/237379719 >> v2:172.21.15.145:3300/0 conn(0x7fd0e80d02c0 0x7fd0e80d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/237379719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80b52a0 0x7fd0e80d2090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/237379719 >> 172.21.15.144:0/237379719 conn(0x7fd0e806acf0 msgr2=0x7fd0e806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/237379719 shutdown_connections 2023-05-11T07:35:35.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.773+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/237379719 wait complete. 2023-05-11T07:35:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.775+0000 7fd0ed7ff700 1 Processor -- start 2023-05-11T07:35:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.775+0000 7fd0ed7ff700 1 -- start start 2023-05-11T07:35:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0e80b52a0 0x7fd0e80cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0e80b87e0 0x7fd0e8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80cc870 con 0x7fd0e80d02c0 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80cc590 con 0x7fd0e80b87e0 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0ed7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e815a540 con 0x7fd0e80b52a0 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53064/0 (socket says 172.21.15.144:53064) 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 -- 172.21.15.144:0/3224464374 learned_addr learned my addr 172.21.15.144:0/3224464374 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0de7fc700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0e80b87e0 0x7fd0e8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 -- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0e80b52a0 msgr2=0x7fd0e80cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0e80b52a0 0x7fd0e80cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 -- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0e80b87e0 msgr2=0x7fd0e8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0e80b87e0 0x7fd0e8159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.776+0000 7fd0e77fe700 1 -- 172.21.15.144:0/3224464374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0009550 con 0x7fd0e80d02c0 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0e77fe700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d5d0 tx=0x7fd0e000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00125f0 con 0x7fd0e80d02c0 2023-05-11T07:35:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0012750 con 0x7fd0e80d02c0 2023-05-11T07:35:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e80cd9b0 con 0x7fd0e80d02c0 2023-05-11T07:35:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0012b00 con 0x7fd0e80d02c0 2023-05-11T07:35:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.777+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e80d2d30 con 0x7fd0e80d02c0 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.778+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80cdc90 con 0x7fd0e80d02c0 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.779+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0e0012c60 con 0x7fd0e80d02c0 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.780+0000 7fd0dffff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 0x7fd0c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.780+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd0e00892e0 con 0x7fd0e80d02c0 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.780+0000 7fd0e6ffd700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 0x7fd0c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:35.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.781+0000 7fd0e6ffd700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 0x7fd0c806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80048f0 tx=0x7fd0d8003eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:35.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.784+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd0e00546d0 con 0x7fd0e80d02c0 2023-05-11T07:35:35.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.981+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0e808b830 con 0x7fd0e80d02c0 2023-05-11T07:35:35.984 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.982+0000 7fd0dffff700 1 -- 172.21.15.144:0/3224464374 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fd0e0057cf0 con 0x7fd0e80d02c0 2023-05-11T07:35:35.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:35.985 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":19,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:34.814976+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 msgr2=0x7fd0c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 0x7fd0c806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80048f0 tx=0x7fd0d8003eb0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 msgr2=0x7fd0e80c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000d5d0 tx=0x7fd0e000d990 comp rx=0 tx=0).stop 2023-05-11T07:35:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 shutdown_connections 2023-05-11T07:35:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0c806ace0 0x7fd0c806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0e80b52a0 0x7fd0e80cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e80d02c0 0x7fd0e80c8c00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.984+0000 7fd0ed7ff700 1 --2- 172.21.15.144:0/3224464374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0e80b87e0 0x7fd0e8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:35.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.985+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 >> 172.21.15.144:0/3224464374 conn(0x7fd0e806acf0 msgr2=0x7fd0e80d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:35.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.985+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 shutdown_connections 2023-05-11T07:35:35.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:35.985+0000 7fd0ed7ff700 1 -- 172.21.15.144:0/3224464374 wait complete. 2023-05-11T07:35:36.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T07:35:36.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:35:36.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.190+0000 7f3a261ff700 1 Processor -- start 2023-05-11T07:35:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.190+0000 7f3a261ff700 1 -- start start 2023-05-11T07:35:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.191+0000 7f3a261ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3a2015c930 0x7f3a2015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.191+0000 7f3a261ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a200cfe00 0x7f3a200d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.191+0000 7f3a261ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2015de80 con 0x7f3a200d02a0 2023-05-11T07:35:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.191+0000 7f3a261ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a200cf640 con 0x7f3a200cfe00 2023-05-11T07:35:36.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.191+0000 7f3a261ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2015cd00 con 0x7f3a2015c930 2023-05-11T07:35:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a200cfe00 0x7f3a200d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a200cfe00 0x7f3a200d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48096/0 (socket says 172.21.15.144:48096) 2023-05-11T07:35:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 -- 172.21.15.144:0/674073877 learned_addr learned my addr 172.21.15.144:0/674073877 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1f7fe700 1 --2- 172.21.15.144:0/674073877 >> v2:172.21.15.145:3300/0 conn(0x7f3a2015c930 0x7f3a2015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 -- 172.21.15.144:0/674073877 >> v2:172.21.15.145:3300/0 conn(0x7f3a2015c930 msgr2=0x7f3a2015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 --2- 172.21.15.144:0/674073877 >> v2:172.21.15.145:3300/0 conn(0x7f3a2015c930 0x7f3a2015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 -- 172.21.15.144:0/674073877 >> v1:172.21.15.145:6789/0 conn(0x7f3a200d02a0 legacy=0x7f3a200b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 -- 172.21.15.144:0/674073877 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200cd940 con 0x7f3a200cfe00 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1effd700 1 --2- 172.21.15.144:0/674073877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200cfe00 0x7f3a200d0db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a080098f0 tx=0x7f3a08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dd1ebec2a6f951 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.192+0000 7f3a1e7fc700 1 -- 172.21.15.144:0/674073877 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011830 con 0x7f3a200cfe00 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a1e7fc700 1 -- 172.21.15.144:0/674073877 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08011990 con 0x7f3a200cfe00 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a1e7fc700 1 -- 172.21.15.144:0/674073877 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011d20 con 0x7f3a200cfe00 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 -- 172.21.15.144:0/674073877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200cfe00 msgr2=0x7f3a200d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 --2- 172.21.15.144:0/674073877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200cfe00 0x7f3a200d0db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a080098f0 tx=0x7f3a08009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 -- 172.21.15.144:0/674073877 shutdown_connections 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 --2- 172.21.15.144:0/674073877 >> v2:172.21.15.145:3300/0 conn(0x7f3a2015c930 0x7f3a2015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 --2- 172.21.15.144:0/674073877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200cfe00 0x7f3a200d0db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 -- 172.21.15.144:0/674073877 >> 172.21.15.144:0/674073877 conn(0x7f3a20072650 msgr2=0x7f3a2006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 -- 172.21.15.144:0/674073877 shutdown_connections 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.193+0000 7f3a261ff700 1 -- 172.21.15.144:0/674073877 wait complete. 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.195+0000 7f3a261ff700 1 Processor -- start 2023-05-11T07:35:36.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.195+0000 7f3a261ff700 1 -- start start 2023-05-11T07:35:36.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a2015c930 0x7f3a201f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a201f5110 0x7f3a201594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2015ae90 con 0x7f3a200d02a0 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a201e4f30 con 0x7f3a201f5110 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a261ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a201f5560 con 0x7f3a2015c930 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48110/0 (socket says 172.21.15.144:48110) 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a1f7fe700 1 -- 172.21.15.144:0/3751705978 learned_addr learned my addr 172.21.15.144:0/3751705978 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:36.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a1ffff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a201f5110 0x7f3a201594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.196+0000 7f3a1effd700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a2015c930 0x7f3a201f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 -- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a2015c930 msgr2=0x7f3a201f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a2015c930 0x7f3a201f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 -- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a201f5110 msgr2=0x7f3a201594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a201f5110 0x7f3a201594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 -- 172.21.15.144:0/3751705978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009550 con 0x7f3a200d02a0 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a1f7fe700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e850 tx=0x7f3a1000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100095b0 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000ee50 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000ca70 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a200cf8e0 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.197+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a200cdc20 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.198+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a200cdf00 con 0x7f3a200d02a0 2023-05-11T07:35:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.199+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a1000cbd0 con 0x7f3a200d02a0 2023-05-11T07:35:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.200+0000 7f3a17fff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 0x7f3a0006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.200+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3a100890a0 con 0x7f3a200d02a0 2023-05-11T07:35:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.200+0000 7f3a1effd700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 0x7f3a0006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.201+0000 7f3a1effd700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 0x7f3a0006d160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a20157f00 tx=0x7f3a08008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.204+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a10057fc0 con 0x7f3a200d02a0 2023-05-11T07:35:36.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.405+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a2015afd0 con 0x7f3a200d02a0 2023-05-11T07:35:36.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.405+0000 7f3a17fff700 1 -- 172.21.15.144:0/3751705978 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a2015afd0 con 0x7f3a200d02a0 2023-05-11T07:35:36.408 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:35:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 msgr2=0x7f3a0006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 0x7f3a0006d160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a20157f00 tx=0x7f3a08008030 comp rx=0 tx=0).stop 2023-05-11T07:35:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 msgr2=0x7f3a200cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e850 tx=0x7f3a1000ec10 comp rx=0 tx=0).stop 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 shutdown_connections 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a0006acb0 0x7f3a0006d160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a201f5110 0x7f3a201594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a200d02a0 0x7f3a200cbb10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.407+0000 7f3a261ff700 1 --2- 172.21.15.144:0/3751705978 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a2015c930 0x7f3a201f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.408+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 >> 172.21.15.144:0/3751705978 conn(0x7f3a200cfe00 msgr2=0x7f3a200b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.408+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 shutdown_connections 2023-05-11T07:35:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.408+0000 7f3a261ff700 1 -- 172.21.15.144:0/3751705978 wait complete. 2023-05-11T07:35:36.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:35:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.612+0000 7f03c19ff700 1 Processor -- start 2023-05-11T07:35:36.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.612+0000 7f03c19ff700 1 -- start start 2023-05-11T07:35:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.613+0000 7f03c19ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f03bc160ee0 0x7f03bc06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.613+0000 7f03c19ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc06b180 0x7f03bc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.613+0000 7f03c19ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc0d0e80 con 0x7f03bc15c940 2023-05-11T07:35:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.613+0000 7f03c19ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc06b600 con 0x7f03bc160ee0 2023-05-11T07:35:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.613+0000 7f03c19ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cdb00 con 0x7f03bc06b180 2023-05-11T07:35:36.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f03bc160ee0 0x7f03bc06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f03bc160ee0 0x7f03bc06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:46680/0 (socket says 172.21.15.144:46680) 2023-05-11T07:35:36.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 -- 172.21.15.144:0/2967295971 learned_addr learned my addr 172.21.15.144:0/2967295971 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:36.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03bb7fe700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc06b180 0x7f03bc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 -- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc06b180 msgr2=0x7f03bc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:36.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc06b180 0x7f03bc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 -- 172.21.15.144:0/2967295971 >> v1:172.21.15.145:6789/0 conn(0x7f03bc15c940 legacy=0x7f03bc0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03ba7fc700 1 -- 172.21.15.144:0/2967295971 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0cdde0 con 0x7f03bc160ee0 2023-05-11T07:35:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.614+0000 7f03b9ffb700 1 -- 172.21.15.144:0/2967295971 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521867246 0 0) 0x7f03bc0d0e80 con 0x7f03bc15c940 2023-05-11T07:35:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03ba7fc700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc160ee0 0x7f03bc06ac40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03b00098f0 tx=0x7f03b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d76cfb890a3b3e10 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03b9ffb700 1 -- 172.21.15.144:0/2967295971 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011830 con 0x7f03bc160ee0 2023-05-11T07:35:36.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03b9ffb700 1 -- 172.21.15.144:0/2967295971 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0011990 con 0x7f03bc160ee0 2023-05-11T07:35:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03b9ffb700 1 -- 172.21.15.144:0/2967295971 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011d20 con 0x7f03bc160ee0 2023-05-11T07:35:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 -- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc160ee0 msgr2=0x7f03bc06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc160ee0 0x7f03bc06ac40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03b00098f0 tx=0x7f03b0009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 -- 172.21.15.144:0/2967295971 shutdown_connections 2023-05-11T07:35:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc06b180 0x7f03bc0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 --2- 172.21.15.144:0/2967295971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc160ee0 0x7f03bc06ac40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 -- 172.21.15.144:0/2967295971 >> 172.21.15.144:0/2967295971 conn(0x7f03bc0d3180 msgr2=0x7f03bc0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.615+0000 7f03c19ff700 1 -- 172.21.15.144:0/2967295971 shutdown_connections 2023-05-11T07:35:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.616+0000 7f03c19ff700 1 -- 172.21.15.144:0/2967295971 wait complete. 2023-05-11T07:35:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.617+0000 7f03c19ff700 1 Processor -- start 2023-05-11T07:35:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.617+0000 7f03c19ff700 1 -- start start 2023-05-11T07:35:36.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc15c940 0x7f03bc156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc160ee0 0x7f03bc1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cbc20 con 0x7f03bc06b180 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cca40 con 0x7f03bc15c940 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.618+0000 7f03c19ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cbe30 con 0x7f03bc160ee0 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48124/0 (socket says 172.21.15.144:48124) 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 -- 172.21.15.144:0/1464255378 learned_addr learned my addr 172.21.15.144:0/1464255378 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03bb7fe700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc160ee0 0x7f03bc1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03ba7fc700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc15c940 0x7f03bc156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 -- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc160ee0 msgr2=0x7f03bc1f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc160ee0 0x7f03bc1f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 -- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc15c940 msgr2=0x7f03bc156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc15c940 0x7f03bc156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 -- 172.21.15.144:0/1464255378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0009550 con 0x7f03bc06b180 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.619+0000 7f03baffd700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0011e0 tx=0x7f03ac00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.620+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0054e0 con 0x7f03bc06b180 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.620+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac003680 con 0x7f03bc06b180 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.620+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc0d1400 con 0x7f03bc06b180 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.620+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac003a30 con 0x7f03bc06b180 2023-05-11T07:35:36.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.620+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc0d1120 con 0x7f03bc06b180 2023-05-11T07:35:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.621+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc0b66e0 con 0x7f03bc06b180 2023-05-11T07:35:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.622+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03ac003b90 con 0x7f03bc06b180 2023-05-11T07:35:36.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.622+0000 7f03a3fff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 0x7f03a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:36.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.623+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f03ac088620 con 0x7f03bc06b180 2023-05-11T07:35:36.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.623+0000 7f03ba7fc700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 0x7f03a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:36.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.623+0000 7f03ba7fc700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 0x7f03a806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03b0014040 tx=0x7f03b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:36.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.627+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f03ac053980 con 0x7f03bc06b180 2023-05-11T07:35:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.821+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03bc06cc90 con 0x7f03bc06b180 2023-05-11T07:35:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.822+0000 7f03a3fff700 1 -- 172.21.15.144:0/1464255378 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03ac017020 con 0x7f03bc06b180 2023-05-11T07:35:36.825 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:35:36.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 msgr2=0x7f03a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 0x7f03a806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03b0014040 tx=0x7f03b0008030 comp rx=0 tx=0).stop 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 msgr2=0x7f03bc0aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0011e0 tx=0x7f03ac00ca30 comp rx=0 tx=0).stop 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 shutdown_connections 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f03a806ace0 0x7f03a806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f03bc160ee0 0x7f03bc1f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03bc06b180 0x7f03bc0aa440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 --2- 172.21.15.144:0/1464255378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f03bc15c940 0x7f03bc156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 >> 172.21.15.144:0/1464255378 conn(0x7f03bc0d3180 msgr2=0x7f03bc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 shutdown_connections 2023-05-11T07:35:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:36.824+0000 7f03c19ff700 1 -- 172.21.15.144:0/1464255378 wait complete. 2023-05-11T07:35:36.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-11T07:35:37.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.025+0000 7f907a7ff700 1 Processor -- start 2023-05-11T07:35:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.026+0000 7f907a7ff700 1 -- start start 2023-05-11T07:35:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907406a2d0 0x7f907408aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f907406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90740cc930 0x7f907406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907416e140 con 0x7f907406a2d0 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907408a8d0 con 0x7f90740cc930 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f907a7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740cead0 con 0x7f907416d1a0 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f9073fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907406a2d0 0x7f907408aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f9073fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907406a2d0 0x7f907408aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48136/0 (socket says 172.21.15.144:48136) 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f90737fe700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f907406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f9073fff700 1 -- 172.21.15.144:0/3469361071 learned_addr learned my addr 172.21.15.144:0/3469361071 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:37.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.027+0000 7f9078d9c700 1 --2- 172.21.15.144:0/3469361071 >> v2:172.21.15.145:3300/0 conn(0x7f90740cc930 0x7f907406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 -- 172.21.15.144:0/3469361071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 msgr2=0x7f907406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f907406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 -- 172.21.15.144:0/3469361071 >> v2:172.21.15.145:3300/0 conn(0x7f90740cc930 msgr2=0x7f907406be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 --2- 172.21.15.144:0/3469361071 >> v2:172.21.15.145:3300/0 conn(0x7f90740cc930 0x7f907406be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 -- 172.21.15.144:0/3469361071 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907406b9d0 con 0x7f907406a2d0 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9073fff700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f907408aa70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9074072360 tx=0x7f906400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4079ad1e66c3ad67 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9072ffd700 1 -- 172.21.15.144:0/3469361071 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400ca70 con 0x7f907406a2d0 2023-05-11T07:35:37.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9072ffd700 1 -- 172.21.15.144:0/3469361071 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400cbd0 con 0x7f907406a2d0 2023-05-11T07:35:37.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.040+0000 7f9072ffd700 1 -- 172.21.15.144:0/3469361071 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400f460 con 0x7f907406a2d0 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 -- 172.21.15.144:0/3469361071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 msgr2=0x7f907408aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f907408aa70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9074072360 tx=0x7f906400bc80 comp rx=0 tx=0).stop 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 -- 172.21.15.144:0/3469361071 shutdown_connections 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 --2- 172.21.15.144:0/3469361071 >> v2:172.21.15.145:3300/0 conn(0x7f90740cc930 0x7f907406be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f907408aa70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 --2- 172.21.15.144:0/3469361071 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f907406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 -- 172.21.15.144:0/3469361071 >> 172.21.15.144:0/3469361071 conn(0x7f90740cb7e0 msgr2=0x7f90740cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 -- 172.21.15.144:0/3469361071 shutdown_connections 2023-05-11T07:35:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.041+0000 7f907a7ff700 1 -- 172.21.15.144:0/3469361071 wait complete. 2023-05-11T07:35:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.044+0000 7f907a7ff700 1 Processor -- start 2023-05-11T07:35:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.044+0000 7f907a7ff700 1 -- start start 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.045+0000 7f907a7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.045+0000 7f907a7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90740cc930 0x7f90741f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.045+0000 7f907a7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f90741f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.045+0000 7f907a7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b4990 con 0x7f907406a2d0 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f907a7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b2640 con 0x7f90740cc930 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f907a7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b2920 con 0x7f907416d1a0 2023-05-11T07:35:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48144/0 (socket says 172.21.15.144:48144) 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 -- 172.21.15.144:0/1710678361 learned_addr learned my addr 172.21.15.144:0/1710678361 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9078d9c700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f90741f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f90737fe700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90740cc930 0x7f90741f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 -- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 msgr2=0x7f90741f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f90741f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 -- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90740cc930 msgr2=0x7f90741f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90740cc930 0x7f90741f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 -- 172.21.15.144:0/1710678361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906400b600 con 0x7f907406a2d0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.046+0000 7f9073fff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90640090b0 tx=0x7f9064004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.047+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906401c070 con 0x7f907406a2d0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.047+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400c870 con 0x7f907406a2d0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.047+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907406abe0 con 0x7f907406a2d0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.047+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064004270 con 0x7f907406a2d0 2023-05-11T07:35:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.047+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907416d610 con 0x7f907406a2d0 2023-05-11T07:35:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.048+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907416d8a0 con 0x7f907406a2d0 2023-05-11T07:35:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.049+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90640043d0 con 0x7f907406a2d0 2023-05-11T07:35:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.050+0000 7f9070ff9700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 0x7f906006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.050+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f906408a7b0 con 0x7f907406a2d0 2023-05-11T07:35:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.050+0000 7f90737fe700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 0x7f906006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.051+0000 7f90737fe700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 0x7f906006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90740c8d60 tx=0x7f906800f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.054+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9064055c40 con 0x7f907406a2d0 2023-05-11T07:35:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.251+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9074066bb0 con 0x7f907406a2d0 2023-05-11T07:35:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.251+0000 7f9070ff9700 1 -- 172.21.15.144:0/1710678361 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9064059260 con 0x7f907406a2d0 2023-05-11T07:35:37.254 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:37.254 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2023-05-11T07:35:37.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:35:37.254 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 2, 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": "rbd" 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:35:37.255 INFO:teuthology.orchestra.run.smithi144.stdout:] 2023-05-11T07:35:37.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 msgr2=0x7f906006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 0x7f906006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90740c8d60 tx=0x7f906800f040 comp rx=0 tx=0).stop 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 msgr2=0x7f90740b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f90640090b0 tx=0x7f9064004750 comp rx=0 tx=0).stop 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 shutdown_connections 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f906006ace0 0x7f906006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f907416d1a0 0x7f90741f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907406a2d0 0x7f90740b3a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 --2- 172.21.15.144:0/1710678361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90740cc930 0x7f90741f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 >> 172.21.15.144:0/1710678361 conn(0x7f90740cb7e0 msgr2=0x7f9074070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 shutdown_connections 2023-05-11T07:35:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.254+0000 7f907a7ff700 1 -- 172.21.15.144:0/1710678361 wait complete. 2023-05-11T07:35:37.273 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-11T07:35:37.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-11T07:35:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.460+0000 7feb039ff700 1 Processor -- start 2023-05-11T07:35:37.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.460+0000 7feb039ff700 1 -- start start 2023-05-11T07:35:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.461+0000 7feb039ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 0x7feafc06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb039ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feafc06b330 0x7feafc160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb039ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc0cfa10 con 0x7feafc0d2970 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb039ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc0cf730 con 0x7feafc06b330 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb039ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0cd880 con 0x7feafc15ca70 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb00f9a700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feafc0d2970 0x7feafc06ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34600/0 (socket says 172.21.15.144:34600) 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb00f9a700 1 -- 172.21.15.144:0/572319644 learned_addr learned my addr 172.21.15.144:0/572319644 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb01f9c700 1 --2- 172.21.15.144:0/572319644 >> v2:172.21.15.145:3300/0 conn(0x7feafc06b330 0x7feafc160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb0179b700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 0x7feafc06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feaf3fff700 1 -- 172.21.15.144:0/572319644 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402489758 0 0) 0x7feafc0cfa10 con 0x7feafc0d2970 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feaf3fff700 1 -- 172.21.15.144:0/572319644 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae80035b0 con 0x7feafc0d2970 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb01f9c700 1 -- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 msgr2=0x7feafc06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb01f9c700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 0x7feafc06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb01f9c700 1 -- 172.21.15.144:0/572319644 >> v1:172.21.15.144:6789/0 conn(0x7feafc0d2970 legacy=0x7feafc06ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb01f9c700 1 -- 172.21.15.144:0/572319644 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0cded0 con 0x7feafc06b330 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.462+0000 7feb0179b700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 0x7feafc06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.463+0000 7feb01f9c700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc06b330 0x7feafc160460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009d90 tx=0x7feaf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dffea7e40f8f4e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.463+0000 7feaf3fff700 1 -- 172.21.15.144:0/572319644 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400e070 con 0x7feafc06b330 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.463+0000 7feaf3fff700 1 -- 172.21.15.144:0/572319644 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400bb20 con 0x7feafc06b330 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.463+0000 7feaf3fff700 1 -- 172.21.15.144:0/572319644 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4012430 con 0x7feafc06b330 2023-05-11T07:35:37.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 -- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc06b330 msgr2=0x7feafc160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc06b330 0x7feafc160460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009d90 tx=0x7feaf400b330 comp rx=0 tx=0).stop 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 -- 172.21.15.144:0/572319644 shutdown_connections 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc06b330 0x7feafc160460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 --2- 172.21.15.144:0/572319644 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc15ca70 0x7feafc06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 -- 172.21.15.144:0/572319644 >> 172.21.15.144:0/572319644 conn(0x7feafc0d3120 msgr2=0x7feafc0d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 -- 172.21.15.144:0/572319644 shutdown_connections 2023-05-11T07:35:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.464+0000 7feb039ff700 1 -- 172.21.15.144:0/572319644 wait complete. 2023-05-11T07:35:37.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.466+0000 7feb039ff700 1 Processor -- start 2023-05-11T07:35:37.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.466+0000 7feb039ff700 1 -- start start 2023-05-11T07:35:37.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc06b330 0x7feafc0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc0d2970 0x7feafc0b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0ca670 con 0x7feafc15ca70 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0b6df0 con 0x7feafc0d2970 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.467+0000 7feb039ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0b70d0 con 0x7feafc06b330 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48150/0 (socket says 172.21.15.144:48150) 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 -- 172.21.15.144:0/1008318280 learned_addr learned my addr 172.21.15.144:0/1008318280 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb00f9a700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc0d2970 0x7feafc0b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb0179b700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc06b330 0x7feafc0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 -- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc06b330 msgr2=0x7feafc0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc06b330 0x7feafc0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 -- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc0d2970 msgr2=0x7feafc0b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc0d2970 0x7feafc0b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 -- 172.21.15.144:0/1008318280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80094a0 con 0x7feafc15ca70 2023-05-11T07:35:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.468+0000 7feb01f9c700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feaf4014040 tx=0x7feaf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.469+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40129f0 con 0x7feafc15ca70 2023-05-11T07:35:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.469+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4009a70 con 0x7feafc15ca70 2023-05-11T07:35:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.469+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4020070 con 0x7feafc15ca70 2023-05-11T07:35:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.469+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4012db0 con 0x7feafc15ca70 2023-05-11T07:35:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.469+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc0d2de0 con 0x7feafc15ca70 2023-05-11T07:35:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.470+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc0cdb60 con 0x7feafc15ca70 2023-05-11T07:35:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.471+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feaf4004040 con 0x7feafc15ca70 2023-05-11T07:35:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.472+0000 7feaf1ffb700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 0x7feae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.472+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feaf4022070 con 0x7feafc15ca70 2023-05-11T07:35:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.472+0000 7feb0179b700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 0x7feae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.472+0000 7feb0179b700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 0x7feae006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009d70 tx=0x7feaf8009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.476+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feaf4056130 con 0x7feafc15ca70 2023-05-11T07:35:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:37.674+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feafc0b25e0 con 0x7feafc15ca70 2023-05-11T07:35:38.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.499+0000 7feaf1ffb700 1 -- 172.21.15.144:0/1008318280 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7feaf402c0b0 con 0x7feafc15ca70 2023-05-11T07:35:38.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 msgr2=0x7feae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 0x7feae006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009d70 tx=0x7feaf8009210 comp rx=0 tx=0).stop 2023-05-11T07:35:38.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 msgr2=0x7feafc0b81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feaf4014040 tx=0x7feaf4004ad0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 shutdown_connections 2023-05-11T07:35:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feae006ace0 0x7feae006d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feafc06b330 0x7feafc0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc15ca70 0x7feafc0b81a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 --2- 172.21.15.144:0/1008318280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feafc0d2970 0x7feafc0b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 >> 172.21.15.144:0/1008318280 conn(0x7feafc0d3120 msgr2=0x7feafc15f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 shutdown_connections 2023-05-11T07:35:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.507+0000 7feb039ff700 1 -- 172.21.15.144:0/1008318280 wait complete. 2023-05-11T07:35:38.514 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2023-05-11T07:35:38.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-11T07:35:38.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.724+0000 7fe588bff700 1 Processor -- start 2023-05-11T07:35:38.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.724+0000 7fe588bff700 1 -- start start 2023-05-11T07:35:38.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe588bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe58415c940 0x7fe584160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe588bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe5840b5fd0 0x7fe58406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe588bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840d0e80 con 0x7fe5840b6420 2023-05-11T07:35:38.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe588bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe584161420 con 0x7fe58415c940 2023-05-11T07:35:38.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe588bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840cdb00 con 0x7fe5840b5fd0 2023-05-11T07:35:38.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe58259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe58415c940 0x7fe584160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe58259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe58415c940 0x7fe584160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48160/0 (socket says 172.21.15.144:48160) 2023-05-11T07:35:38.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe58259c700 1 -- 172.21.15.144:0/822878964 learned_addr learned my addr 172.21.15.144:0/822878964 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:38.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.725+0000 7fe57bfff700 1 --2- 172.21.15.144:0/822878964 >> v2:172.21.15.145:3300/0 conn(0x7fe5840b5fd0 0x7fe58406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe58259c700 1 -- 172.21.15.144:0/822878964 >> v2:172.21.15.145:3300/0 conn(0x7fe5840b5fd0 msgr2=0x7fe58406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:38.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe58259c700 1 --2- 172.21.15.144:0/822878964 >> v2:172.21.15.145:3300/0 conn(0x7fe5840b5fd0 0x7fe58406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe58259c700 1 -- 172.21.15.144:0/822878964 >> v1:172.21.15.144:6789/0 conn(0x7fe5840b6420 legacy=0x7fe5840d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe58259c700 1 -- 172.21.15.144:0/822878964 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840cdde0 con 0x7fe58415c940 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe58259c700 1 --2- 172.21.15.144:0/822878964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58415c940 0x7fe584160ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5840d3e60 tx=0x7fe574009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc83cfacf1636429 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe581d9b700 1 -- 172.21.15.144:0/822878964 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574011830 con 0x7fe58415c940 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe581d9b700 1 -- 172.21.15.144:0/822878964 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574011990 con 0x7fe58415c940 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.726+0000 7fe581d9b700 1 -- 172.21.15.144:0/822878964 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574011d20 con 0x7fe58415c940 2023-05-11T07:35:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 -- 172.21.15.144:0/822878964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58415c940 msgr2=0x7fe584160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 --2- 172.21.15.144:0/822878964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58415c940 0x7fe584160ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5840d3e60 tx=0x7fe574009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 -- 172.21.15.144:0/822878964 shutdown_connections 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 --2- 172.21.15.144:0/822878964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58415c940 0x7fe584160ee0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 --2- 172.21.15.144:0/822878964 >> v2:172.21.15.145:3300/0 conn(0x7fe5840b5fd0 0x7fe58406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 -- 172.21.15.144:0/822878964 >> 172.21.15.144:0/822878964 conn(0x7fe5840d3180 msgr2=0x7fe5840d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 -- 172.21.15.144:0/822878964 shutdown_connections 2023-05-11T07:35:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.727+0000 7fe588bff700 1 -- 172.21.15.144:0/822878964 wait complete. 2023-05-11T07:35:38.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.729+0000 7fe588bff700 1 Processor -- start 2023-05-11T07:35:38.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.729+0000 7fe588bff700 1 -- start start 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.729+0000 7fe588bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.729+0000 7fe588bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5840b6420 0x7fe5841f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe588bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe58415c940 0x7fe5841502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe588bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe584155ad0 con 0x7fe5840b5fd0 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe588bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5841f3480 con 0x7fe58415c940 2023-05-11T07:35:38.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe588bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe584154e50 con 0x7fe5840b6420 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48176/0 (socket says 172.21.15.144:48176) 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 -- 172.21.15.144:0/1976301827 learned_addr learned my addr 172.21.15.144:0/1976301827 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe57bfff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5840b6420 0x7fe5841f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe582d9d700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe58415c940 0x7fe5841502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 -- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5840b6420 msgr2=0x7fe5841f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5840b6420 0x7fe5841f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 -- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe58415c940 msgr2=0x7fe5841502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe58415c940 0x7fe5841502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 -- 172.21.15.144:0/1976301827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009550 con 0x7fe5840b5fd0 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.730+0000 7fe58259c700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe574000c00 tx=0x7fe574004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.731+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574004380 con 0x7fe5840b5fd0 2023-05-11T07:35:38.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.731+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57401f070 con 0x7fe5840b5fd0 2023-05-11T07:35:38.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.731+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5840d1400 con 0x7fe5840b5fd0 2023-05-11T07:35:38.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.731+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740036a0 con 0x7fe5840b5fd0 2023-05-11T07:35:38.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.731+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5840d1120 con 0x7fe5840b5fd0 2023-05-11T07:35:38.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.732+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58415cd10 con 0x7fe5840b5fd0 2023-05-11T07:35:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.733+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe574021030 con 0x7fe5840b5fd0 2023-05-11T07:35:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.734+0000 7fe57affd700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 0x7fe56406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.734+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe57408a780 con 0x7fe5840b5fd0 2023-05-11T07:35:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.734+0000 7fe57bfff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 0x7fe56406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:38.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.734+0000 7fe57bfff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 0x7fe56406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe58415fae0 tx=0x7fe56c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:38.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.739+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe574055bc0 con 0x7fe5840b5fd0 2023-05-11T07:35:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:38.931+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe5840744c0 con 0x7fe5840b5fd0 2023-05-11T07:35:39.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.501+0000 7fe57affd700 1 -- 172.21.15.144:0/1976301827 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe5740591e0 con 0x7fe5840b5fd0 2023-05-11T07:35:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.515+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 msgr2=0x7fe56406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.515+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 0x7fe56406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe58415fae0 tx=0x7fe56c009210 comp rx=0 tx=0).stop 2023-05-11T07:35:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.515+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 msgr2=0x7fe584154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.515+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe574000c00 tx=0x7fe574004750 comp rx=0 tx=0).stop 2023-05-11T07:35:39.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 shutdown_connections 2023-05-11T07:35:39.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe56406ace0 0x7fe56406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe58415c940 0x7fe5841502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5840b5fd0 0x7fe584154870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 --2- 172.21.15.144:0/1976301827 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5840b6420 0x7fe5841f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.517+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 >> 172.21.15.144:0/1976301827 conn(0x7fe5840d3180 msgr2=0x7fe5840b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:39.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.524+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 shutdown_connections 2023-05-11T07:35:39.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.524+0000 7fe588bff700 1 -- 172.21.15.144:0/1976301827 wait complete. 2023-05-11T07:35:39.529 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2023-05-11T07:35:39.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-11T07:35:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.732+0000 7fe5f69ff700 1 Processor -- start 2023-05-11T07:35:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.732+0000 7fe5f69ff700 1 -- start start 2023-05-11T07:35:39.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.733+0000 7fe5f69ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.733+0000 7fe5f69ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5f00cfe00 0x7fe5f00d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.733+0000 7fe5f69ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f015de80 con 0x7fe5f00d0270 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.733+0000 7fe5f69ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00cf640 con 0x7fe5f00cfe00 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.733+0000 7fe5f69ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f015cd00 con 0x7fe5f015c930 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5f00cfe00 0x7fe5f00d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5f00cfe00 0x7fe5f00d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48192/0 (socket says 172.21.15.144:48192) 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 -- 172.21.15.144:0/1809774242 learned_addr learned my addr 172.21.15.144:0/1809774242 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5effff700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 -- 172.21.15.144:0/1809774242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 msgr2=0x7fe5f015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 -- 172.21.15.144:0/1809774242 >> v1:172.21.15.145:6789/0 conn(0x7fe5f00d0270 legacy=0x7fe5f00b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 -- 172.21.15.144:0/1809774242 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00cd940 con 0x7fe5f00cfe00 2023-05-11T07:35:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5ef7fe700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00cfe00 0x7fe5f00d0db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40098f0 tx=0x7fe5e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f49155ad1101bd3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.734+0000 7fe5eeffd700 1 -- 172.21.15.144:0/1809774242 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4011830 con 0x7fe5f00cfe00 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5eeffd700 1 -- 172.21.15.144:0/1809774242 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4011990 con 0x7fe5f00cfe00 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5eeffd700 1 -- 172.21.15.144:0/1809774242 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4011d20 con 0x7fe5f00cfe00 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 -- 172.21.15.144:0/1809774242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00cfe00 msgr2=0x7fe5f00d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00cfe00 0x7fe5f00d0db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40098f0 tx=0x7fe5e4009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 -- 172.21.15.144:0/1809774242 shutdown_connections 2023-05-11T07:35:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/1809774242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00cfe00 0x7fe5f00d0db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 -- 172.21.15.144:0/1809774242 >> 172.21.15.144:0/1809774242 conn(0x7fe5f0072650 msgr2=0x7fe5f006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 -- 172.21.15.144:0/1809774242 shutdown_connections 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.735+0000 7fe5f69ff700 1 -- 172.21.15.144:0/1809774242 wait complete. 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.737+0000 7fe5f69ff700 1 Processor -- start 2023-05-11T07:35:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.737+0000 7fe5f69ff700 1 -- start start 2023-05-11T07:35:39.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f0151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 0x7fe5f0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00ccb30 con 0x7fe5f00d0270 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00d2660 con 0x7fe5f01516b0 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f69ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00ccd60 con 0x7fe5f015c930 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5effff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48200/0 (socket says 172.21.15.144:48200) 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5effff700 1 -- 172.21.15.144:0/3265618110 learned_addr learned my addr 172.21.15.144:0/3265618110 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5ef7fe700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f0151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.738+0000 7fe5f4f9c700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 0x7fe5f0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 -- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 msgr2=0x7fe5f0151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f0151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 -- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 msgr2=0x7fe5f0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 0x7fe5f0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 -- 172.21.15.144:0/3265618110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009550 con 0x7fe5f00d0270 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5f4f9c700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 0x7fe5f0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5effff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e870 tx=0x7fe5e000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0009590 con 0x7fe5f00d0270 2023-05-11T07:35:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0013680 con 0x7fe5f00d0270 2023-05-11T07:35:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00cf8e0 con 0x7fe5f00d0270 2023-05-11T07:35:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00139f0 con 0x7fe5f00d0270 2023-05-11T07:35:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.739+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f00cdc20 con 0x7fe5f00d0270 2023-05-11T07:35:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.740+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00cdf00 con 0x7fe5f00d0270 2023-05-11T07:35:39.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.741+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5e0013b50 con 0x7fe5f00d0270 2023-05-11T07:35:39.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.742+0000 7fe5ecff9700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 0x7fe5dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:39.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.742+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe5e00893b0 con 0x7fe5f00d0270 2023-05-11T07:35:39.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.742+0000 7fe5ef7fe700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 0x7fe5dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:39.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.743+0000 7fe5ef7fe700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 0x7fe5dc06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009c40 tx=0x7fe5e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.747+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe5e0054420 con 0x7fe5f00d0270 2023-05-11T07:35:39.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.988+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe5f00b4660 con 0x7fe5f00d0270 2023-05-11T07:35:39.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:39.994+0000 7fe5ecff9700 1 -- 172.21.15.144:0/3265618110 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe5e0057a40 con 0x7fe5f00d0270 2023-05-11T07:35:40.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.000+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 msgr2=0x7fe5dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.000+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 0x7fe5dc06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009c40 tx=0x7fe5e4008030 comp rx=0 tx=0).stop 2023-05-11T07:35:40.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.000+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 msgr2=0x7fe5f00cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.000+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e870 tx=0x7fe5e000eb80 comp rx=0 tx=0).stop 2023-05-11T07:35:40.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 shutdown_connections 2023-05-11T07:35:40.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe5dc06ace0 0x7fe5dc06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5f01516b0 0x7fe5f0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f00d0270 0x7fe5f00cac10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 --2- 172.21.15.144:0/3265618110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe5f015c930 0x7fe5f0151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.001+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 >> 172.21.15.144:0/3265618110 conn(0x7fe5f00cfe00 msgr2=0x7fe5f00b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:40.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.003+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 shutdown_connections 2023-05-11T07:35:40.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.003+0000 7fe5f69ff700 1 -- 172.21.15.144:0/3265618110 wait complete. 2023-05-11T07:35:40.015 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 3 and data pool 4 2023-05-11T07:35:40.038 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-11T07:35:40.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-11T07:35:40.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.223+0000 7f207d7ff700 1 Processor -- start 2023-05-11T07:35:40.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.223+0000 7f207d7ff700 1 -- start start 2023-05-11T07:35:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f207d7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 0x7f20780d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f207d7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20780cfa10 con 0x7f207806b330 2023-05-11T07:35:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f207d7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20780cded0 con 0x7f207815ca70 2023-05-11T07:35:40.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f207d7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207806d4b0 con 0x7f207806d010 2023-05-11T07:35:40.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f206ffff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f207806b330 0x7f2078160460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34608/0 (socket says 172.21.15.144:34608) 2023-05-11T07:35:40.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f206ffff700 1 -- 172.21.15.144:0/4013788832 learned_addr learned my addr 172.21.15.144:0/4013788832 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:40.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20777fe700 1 --2- 172.21.15.144:0/4013788832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 0x7f20780d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:40.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835222941 0 0) 0x7f20780cfa10 con 0x7f207806b330 2023-05-11T07:35:40.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20640035b0 con 0x7f207806b330 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778559923 0 0) 0x7f20780cded0 con 0x7f207815ca70 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20780cfa10 con 0x7f207815ca70 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20777fe700 1 -- 172.21.15.144:0/4013788832 >> v1:172.21.15.145:6789/0 conn(0x7f207815ca70 legacy=0x7f207806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20777fe700 1 -- 172.21.15.144:0/4013788832 >> v1:172.21.15.144:6789/0 conn(0x7f207806b330 legacy=0x7f2078160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.225+0000 7f20777fe700 1 -- 172.21.15.144:0/4013788832 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780d2eb0 con 0x7f207806d010 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.226+0000 7f20777fe700 1 --2- 172.21.15.144:0/4013788832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 0x7f20780d2970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dc0 tx=0x7f207000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55cc57e35e0c30de server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:40.230 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.226+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000e070 con 0x7f207806d010 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.226+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000bb20 con 0x7f207806d010 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.226+0000 7f20767fc700 1 -- 172.21.15.144:0/4013788832 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070012430 con 0x7f207806d010 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.226+0000 7f207d7ff700 1 -- 172.21.15.144:0/4013788832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 msgr2=0x7f20780d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 --2- 172.21.15.144:0/4013788832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 0x7f20780d2970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dc0 tx=0x7f207000b330 comp rx=0 tx=0).stop 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 -- 172.21.15.144:0/4013788832 shutdown_connections 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 --2- 172.21.15.144:0/4013788832 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806d010 0x7f20780d2970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 -- 172.21.15.144:0/4013788832 >> 172.21.15.144:0/4013788832 conn(0x7f20780d3120 msgr2=0x7f20780d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 -- 172.21.15.144:0/4013788832 shutdown_connections 2023-05-11T07:35:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.227+0000 7f207d7ff700 1 -- 172.21.15.144:0/4013788832 wait complete. 2023-05-11T07:35:40.233 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.228+0000 7f207d7ff700 1 Processor -- start 2023-05-11T07:35:40.233 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 -- start start 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806b330 0x7f2078150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f207815ca70 0x7f207814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780cc6c0 con 0x7f207806d010 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781e7700 con 0x7f207815ca70 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.229+0000 7f207d7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2078150330 con 0x7f207806b330 2023-05-11T07:35:40.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48210/0 (socket says 172.21.15.144:48210) 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 -- 172.21.15.144:0/2822926429 learned_addr learned my addr 172.21.15.144:0/2822926429 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f2076ffd700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806b330 0x7f2078150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f20777fe700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f207815ca70 0x7f207814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 -- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806b330 msgr2=0x7f2078150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806b330 0x7f2078150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 -- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f207815ca70 msgr2=0x7f207814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:40.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f207815ca70 0x7f207814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 -- 172.21.15.144:0/2822926429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070009a70 con 0x7f207806d010 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206ffff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f206000c730 tx=0x7f206000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.230+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060005d70 con 0x7f207806d010 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.231+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20600070d0 con 0x7f207806d010 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.231+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20780cd880 con 0x7f207806d010 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.231+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060007440 con 0x7f207806d010 2023-05-11T07:35:40.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.231+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20780cf730 con 0x7f207806d010 2023-05-11T07:35:40.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.232+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20780cdb60 con 0x7f207806d010 2023-05-11T07:35:40.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.233+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20600075a0 con 0x7f207806d010 2023-05-11T07:35:40.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.234+0000 7f206f7fe700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 0x7f205806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:40.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.234+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2060088680 con 0x7f207806d010 2023-05-11T07:35:40.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.234+0000 7f2076ffd700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 0x7f205806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:40.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.234+0000 7f2076ffd700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 0x7f205806d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20680011e0 tx=0x7f2068009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:40.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.238+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2060053870 con 0x7f207806d010 2023-05-11T07:35:40.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.441+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f20780744c0 con 0x7f207806d010 2023-05-11T07:35:41.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:40.999+0000 7f206f7fe700 1 -- 172.21.15.144:0/2822926429 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2060056e90 con 0x7f207806d010 2023-05-11T07:35:41.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 msgr2=0x7f205806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:41.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 0x7f205806d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20680011e0 tx=0x7f2068009040 comp rx=0 tx=0).stop 2023-05-11T07:35:41.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 msgr2=0x7f20781e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:41.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f206000c730 tx=0x7f206000ca40 comp rx=0 tx=0).stop 2023-05-11T07:35:41.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 shutdown_connections 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f205806ad10 0x7f205806d1c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f207806b330 0x7f2078150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f207815ca70 0x7f207814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 --2- 172.21.15.144:0/2822926429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f207806d010 0x7f20781e71c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 >> 172.21.15.144:0/2822926429 conn(0x7f20780d3120 msgr2=0x7f207815e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 shutdown_connections 2023-05-11T07:35:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.002+0000 7f207d7ff700 1 -- 172.21.15.144:0/2822926429 wait complete. 2023-05-11T07:35:41.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-11T07:35:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.213+0000 7f56993ff700 1 Processor -- start 2023-05-11T07:35:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.214+0000 7f56993ff700 1 -- start start 2023-05-11T07:35:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56993ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56940c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56993ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56940b0e30 0x7f56940ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56993ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569415e200 con 0x7f56940ca020 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56993ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569415a100 con 0x7f56940b0e30 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56993ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569415a3e0 con 0x7f56941599e0 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56937fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56940b0e30 0x7f56940ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56937fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56940b0e30 0x7f56940ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48222/0 (socket says 172.21.15.144:48222) 2023-05-11T07:35:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f56937fe700 1 -- 172.21.15.144:0/2563371826 learned_addr learned my addr 172.21.15.144:0/2563371826 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.215+0000 7f5692ffd700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56940c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56937fe700 1 -- 172.21.15.144:0/2563371826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 msgr2=0x7f56940c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56937fe700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56940c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56937fe700 1 -- 172.21.15.144:0/2563371826 >> v1:172.21.15.145:6789/0 conn(0x7f56940ca020 legacy=0x7f56940b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56937fe700 1 -- 172.21.15.144:0/2563371826 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569415a6c0 con 0x7f56940b0e30 2023-05-11T07:35:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56937fe700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f56940ccee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f568c009e50 tx=0x7f568c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff708e22734b5e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56927fc700 1 -- 172.21.15.144:0/2563371826 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00e070 con 0x7f56940b0e30 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56927fc700 1 -- 172.21.15.144:0/2563371826 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c003a20 con 0x7f56940b0e30 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.216+0000 7f56927fc700 1 -- 172.21.15.144:0/2563371826 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c003dd0 con 0x7f56940b0e30 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 -- 172.21.15.144:0/2563371826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 msgr2=0x7f56940ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f56940ccee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f568c009e50 tx=0x7f568c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 -- 172.21.15.144:0/2563371826 shutdown_connections 2023-05-11T07:35:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f56940ccee0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 --2- 172.21.15.144:0/2563371826 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56940c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 -- 172.21.15.144:0/2563371826 >> 172.21.15.144:0/2563371826 conn(0x7f56940cb720 msgr2=0x7f56940cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 -- 172.21.15.144:0/2563371826 shutdown_connections 2023-05-11T07:35:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.217+0000 7f56993ff700 1 -- 172.21.15.144:0/2563371826 wait complete. 2023-05-11T07:35:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.218+0000 7f56993ff700 1 Processor -- start 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.219+0000 7f56993ff700 1 -- start start 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.219+0000 7f56993ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56993ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56940ca020 0x7f569406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56993ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56941577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56993ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406ca70 con 0x7f56940b0e30 2023-05-11T07:35:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56993ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569406cca0 con 0x7f56940ca020 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56993ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569406b760 con 0x7f56941599e0 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48228/0 (socket says 172.21.15.144:48228) 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 -- 172.21.15.144:0/2483180059 learned_addr learned my addr 172.21.15.144:0/2483180059 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f568bfff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56940ca020 0x7f569406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56937fe700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56941577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 -- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 msgr2=0x7f56941577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:41.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56941577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 -- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56940ca020 msgr2=0x7f569406bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56940ca020 0x7f569406bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 -- 172.21.15.144:0/2483180059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c009b30 con 0x7f56940b0e30 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f56937fe700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56941577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.220+0000 7f5692ffd700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f568400d800 tx=0x7f568400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.221+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840125f0 con 0x7f56940b0e30 2023-05-11T07:35:41.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.221+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684012750 con 0x7f56940b0e30 2023-05-11T07:35:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.221+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684012b00 con 0x7f56940b0e30 2023-05-11T07:35:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.221+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5694159db0 con 0x7f56940b0e30 2023-05-11T07:35:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.221+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569415a9a0 con 0x7f56940b0e30 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.222+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56940cd420 con 0x7f56940b0e30 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.223+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5684012c60 con 0x7f56940b0e30 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.224+0000 7f568b7fe700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 0x7f567406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.224+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f56840899c0 con 0x7f56940b0e30 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.224+0000 7f568bfff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 0x7f567406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:41.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.225+0000 7f568bfff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 0x7f567406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f569415c390 tx=0x7f567c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:41.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.229+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5684054910 con 0x7f56940b0e30 2023-05-11T07:35:41.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:41.423+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f56940b1700 con 0x7f56940b0e30 2023-05-11T07:35:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.022+0000 7f568b7fe700 1 -- 172.21.15.144:0/2483180059 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f5684057f30 con 0x7f56940b0e30 2023-05-11T07:35:43.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.027+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 msgr2=0x7f567406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:43.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.027+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 0x7f567406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f569415c390 tx=0x7f567c009040 comp rx=0 tx=0).stop 2023-05-11T07:35:43.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.027+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 msgr2=0x7f569414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:43.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.027+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f568400d800 tx=0x7f568400dbc0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 shutdown_connections 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f567406ace0 0x7f567406d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f56941599e0 0x7f56941577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56940b0e30 0x7f569414fad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 --2- 172.21.15.144:0/2483180059 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f56940ca020 0x7f569406bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.028+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 >> 172.21.15.144:0/2483180059 conn(0x7f56940cb720 msgr2=0x7f5694070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:43.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.029+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 shutdown_connections 2023-05-11T07:35:43.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.030+0000 7f56993ff700 1 -- 172.21.15.144:0/2483180059 wait complete. 2023-05-11T07:35:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data_ec' created 2023-05-11T07:35:43.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-11T07:35:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.247+0000 7f3fa65ff700 1 Processor -- start 2023-05-11T07:35:43.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.247+0000 7f3fa65ff700 1 -- start start 2023-05-11T07:35:43.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 0x7f3fa006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa006ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fa006b160 0x7f3fa0160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa006b5e0 con 0x7f3fa006b160 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa00cfa10 con 0x7f3fa015ca70 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cded0 con 0x7f3fa00d2970 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fa006b160 0x7f3fa0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fa006b160 0x7f3fa0160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48242/0 (socket says 172.21.15.144:48242) 2023-05-11T07:35:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/2775221606 learned_addr learned my addr 172.21.15.144:0/2775221606 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/2775221606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 msgr2=0x7f3fa006ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/2775221606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa006ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/2775221606 >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 msgr2=0x7f3fa006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.248+0000 7f3f9ffff700 1 --2- 172.21.15.144:0/2775221606 >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 0x7f3fa006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/2775221606 >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 0x7f3fa006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/2775221606 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00cf730 con 0x7f3fa006b160 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3f9ffff700 1 --2- 172.21.15.144:0/2775221606 >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 0x7f3fa006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/2775221606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa006b160 0x7f3fa0160460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00d3e40 tx=0x7f3f9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12f9a1ff3a464b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3f9effd700 1 -- 172.21.15.144:0/2775221606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800e070 con 0x7f3fa006b160 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3f9effd700 1 -- 172.21.15.144:0/2775221606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9800b9c0 con 0x7f3fa006b160 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.249+0000 7f3f9effd700 1 -- 172.21.15.144:0/2775221606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800bd70 con 0x7f3fa006b160 2023-05-11T07:35:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 -- 172.21.15.144:0/2775221606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa006b160 msgr2=0x7f3fa0160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/2775221606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa006b160 0x7f3fa0160460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00d3e40 tx=0x7f3f9800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 -- 172.21.15.144:0/2775221606 shutdown_connections 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/2775221606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa006b160 0x7f3fa0160460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/2775221606 >> v2:172.21.15.145:3300/0 conn(0x7f3fa015ca70 0x7f3fa006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/2775221606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa006ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 -- 172.21.15.144:0/2775221606 >> 172.21.15.144:0/2775221606 conn(0x7f3fa00d3120 msgr2=0x7f3fa00d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 -- 172.21.15.144:0/2775221606 shutdown_connections 2023-05-11T07:35:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.250+0000 7f3fa65ff700 1 -- 172.21.15.144:0/2775221606 wait complete. 2023-05-11T07:35:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.251+0000 7f3fa65ff700 1 Processor -- start 2023-05-11T07:35:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.252+0000 7f3fa65ff700 1 -- start start 2023-05-11T07:35:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.252+0000 7f3fa65ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fa006b160 0x7f3fa0149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa65ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa65ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0149fb0 con 0x7f3fa015ca70 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa65ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01f6610 con 0x7f3fa006b160 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01f5a00 con 0x7f3fa00d2970 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48250/0 (socket says 172.21.15.144:48250) 2023-05-11T07:35:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/447093947 learned_addr learned my addr 172.21.15.144:0/447093947 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3f9ffff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fa006b160 0x7f3fa0149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3f9f7fe700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 msgr2=0x7f3fa00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fa006b160 msgr2=0x7f3fa0149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fa006b160 0x7f3fa0149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:43.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 -- 172.21.15.144:0/447093947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009b30 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3f9f7fe700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.253+0000 7f3fa4b9c700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b370 tx=0x7f3f98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.254+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004310 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.254+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98004470 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.254+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa00cdb60 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.254+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004820 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.254+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa00cd880 con 0x7f3fa015ca70 2023-05-11T07:35:43.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.255+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa00d2de0 con 0x7f3fa015ca70 2023-05-11T07:35:43.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.256+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f9802f480 con 0x7f3fa015ca70 2023-05-11T07:35:43.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.257+0000 7f3f9cff9700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 0x7f3f8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:43.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.257+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f3f9808b140 con 0x7f3fa015ca70 2023-05-11T07:35:43.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.257+0000 7f3f9ffff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 0x7f3f8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:43.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.258+0000 7f3f9ffff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 0x7f3f8c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f90006fd0 tx=0x7f3f90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:43.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.261+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f98055f90 con 0x7f3fa015ca70 2023-05-11T07:35:43.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:43.452+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3fa00b4450 con 0x7f3fa015ca70 2023-05-11T07:35:44.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.024+0000 7f3f9cff9700 1 -- 172.21.15.144:0/447093947 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3fa00b4450 con 0x7f3fa015ca70 2023-05-11T07:35:44.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.033+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 msgr2=0x7f3f8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.033+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 0x7f3f8c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f90006fd0 tx=0x7f3f90008040 comp rx=0 tx=0).stop 2023-05-11T07:35:44.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.033+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 msgr2=0x7f3fa01f1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.033+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b370 tx=0x7f3f98004ad0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 shutdown_connections 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f8c06ace0 0x7f3f8c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa015ca70 0x7f3fa01f1350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fa006b160 0x7f3fa0149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 --2- 172.21.15.144:0/447093947 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3fa00d2970 0x7f3fa00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.035+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 >> 172.21.15.144:0/447093947 conn(0x7f3fa00d3120 msgr2=0x7f3fa015f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:44.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.041+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 shutdown_connections 2023-05-11T07:35:44.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.041+0000 7f3fa65ff700 1 -- 172.21.15.144:0/447093947 wait complete. 2023-05-11T07:35:44.054 INFO:teuthology.orchestra.run.smithi144.stderr:set pool 5 allow_ec_overwrites to true 2023-05-11T07:35:44.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-11T07:35:44.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.257+0000 7fe1f61ff700 1 Processor -- start 2023-05-11T07:35:44.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.258+0000 7fe1f61ff700 1 -- start start 2023-05-11T07:35:44.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1f61ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 0x7fe1f006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1f61ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00d0e80 con 0x7fe1f015c940 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1f61ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00cdb00 con 0x7fe1f006b180 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1f61ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f006b600 con 0x7fe1f0160ee0 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1ef7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1f015c940 0x7fe1f00b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34624/0 (socket says 172.21.15.144:34624) 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1ef7fe700 1 -- 172.21.15.144:0/228635728 learned_addr learned my addr 172.21.15.144:0/228635728 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:44.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1eeffd700 1 --2- 172.21.15.144:0/228635728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 0x7fe1f006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079369185 0 0) 0x7fe1f00d0e80 con 0x7fe1f015c940 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.259+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d80035b0 con 0x7fe1f015c940 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474926815 0 0) 0x7fe1f00cdb00 con 0x7fe1f006b180 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f00d0e80 con 0x7fe1f006b180 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1eeffd700 1 -- 172.21.15.144:0/228635728 >> v1:172.21.15.145:6789/0 conn(0x7fe1f006b180 legacy=0x7fe1f00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1eeffd700 1 -- 172.21.15.144:0/228635728 >> v1:172.21.15.144:6789/0 conn(0x7fe1f015c940 legacy=0x7fe1f00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1eeffd700 1 -- 172.21.15.144:0/228635728 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00cdde0 con 0x7fe1f0160ee0 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1eeffd700 1 --2- 172.21.15.144:0/228635728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 0x7fe1f006ac40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009870 tx=0x7fe1e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c751b070eaea309b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011830 con 0x7fe1f0160ee0 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4011990 con 0x7fe1f0160ee0 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.260+0000 7fe1ee7fc700 1 -- 172.21.15.144:0/228635728 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4011d20 con 0x7fe1f0160ee0 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 -- 172.21.15.144:0/228635728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 msgr2=0x7fe1f006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/228635728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 0x7fe1f006ac40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009870 tx=0x7fe1e4009b80 comp rx=0 tx=0).stop 2023-05-11T07:35:44.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 -- 172.21.15.144:0/228635728 shutdown_connections 2023-05-11T07:35:44.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/228635728 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f0160ee0 0x7fe1f006ac40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 -- 172.21.15.144:0/228635728 >> 172.21.15.144:0/228635728 conn(0x7fe1f00d3180 msgr2=0x7fe1f00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:44.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 -- 172.21.15.144:0/228635728 shutdown_connections 2023-05-11T07:35:44.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.261+0000 7fe1f61ff700 1 -- 172.21.15.144:0/228635728 wait complete. 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.263+0000 7fe1f61ff700 1 Processor -- start 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.263+0000 7fe1f61ff700 1 -- start start 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f015c940 0x7fe1f01f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 0x7fe1f015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b2be0 con 0x7fe1f006b180 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b58f0 con 0x7fe1f0160ee0 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1f61ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b2e30 con 0x7fe1f015c940 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48260/0 (socket says 172.21.15.144:48260) 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 -- 172.21.15.144:0/258316695 learned_addr learned my addr 172.21.15.144:0/258316695 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1eeffd700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f015c940 0x7fe1f01f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1effff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 0x7fe1f015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 -- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f015c940 msgr2=0x7fe1f01f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f015c940 0x7fe1f01f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 -- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 msgr2=0x7fe1f015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 0x7fe1f015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 -- 172.21.15.144:0/258316695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40094a0 con 0x7fe1f006b180 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1effff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 0x7fe1f015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.264+0000 7fe1ef7fe700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c700 tx=0x7fe1e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.265+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0005d70 con 0x7fe1f006b180 2023-05-11T07:35:44.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.265+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00070d0 con 0x7fe1f006b180 2023-05-11T07:35:44.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.265+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00d1400 con 0x7fe1f006b180 2023-05-11T07:35:44.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.265+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0007460 con 0x7fe1f006b180 2023-05-11T07:35:44.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.265+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f00d1120 con 0x7fe1f006b180 2023-05-11T07:35:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.266+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f00b66e0 con 0x7fe1f006b180 2023-05-11T07:35:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.267+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1e00075c0 con 0x7fe1f006b180 2023-05-11T07:35:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.267+0000 7fe1d7fff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 0x7fe1dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.268+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fe1e0088cf0 con 0x7fe1f006b180 2023-05-11T07:35:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.268+0000 7fe1eeffd700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 0x7fe1dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.268+0000 7fe1eeffd700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 0x7fe1dc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40090b0 tx=0x7fe1e401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.272+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe1e0053ac0 con 0x7fe1f006b180 2023-05-11T07:35:44.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.511+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fe1f00744c0 con 0x7fe1f006b180 2023-05-11T07:35:44.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.515+0000 7fe1d7fff700 1 -- 172.21.15.144:0/258316695 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe1e0088070 con 0x7fe1f006b180 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 msgr2=0x7fe1dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 0x7fe1dc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40090b0 tx=0x7fe1e401c040 comp rx=0 tx=0).stop 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 msgr2=0x7fe1f00b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c700 tx=0x7fe1e000ca10 comp rx=0 tx=0).stop 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 shutdown_connections 2023-05-11T07:35:44.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1dc06ace0 0x7fe1dc06d190 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40090b0 tx=0x7fe1e401c040 comp rx=0 tx=0).stop 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1f0160ee0 0x7fe1f015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f006b180 0x7fe1f00b53b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 --2- 172.21.15.144:0/258316695 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1f015c940 0x7fe1f01f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 >> 172.21.15.144:0/258316695 conn(0x7fe1f00d3180 msgr2=0x7fe1f00d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 shutdown_connections 2023-05-11T07:35:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.519+0000 7fe1f61ff700 1 -- 172.21.15.144:0/258316695 wait complete. 2023-05-11T07:35:44.524 INFO:teuthology.orchestra.run.smithi144.stderr:added data pool 5 to fsmap 2023-05-11T07:35:44.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:35:44.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.719+0000 7f40f69ff700 1 Processor -- start 2023-05-11T07:35:44.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.719+0000 7f40f69ff700 1 -- start start 2023-05-11T07:35:44.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.720+0000 7f40f69ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f00d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.720+0000 7f40f69ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40f00d02c0 0x7f40f00d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f69ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f015cef0 con 0x7f40f00b87e0 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f69ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00b5a80 con 0x7f40f00d02c0 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f69ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00cdf70 con 0x7f40f00b52a0 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40f00d02c0 0x7f40f00d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40f00d02c0 0x7f40f00d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48264/0 (socket says 172.21.15.144:48264) 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 -- 172.21.15.144:0/3021518246 learned_addr learned my addr 172.21.15.144:0/3021518246 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40ef7fe700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f00d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 -- 172.21.15.144:0/3021518246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 msgr2=0x7f40f00d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f00d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 -- 172.21.15.144:0/3021518246 >> v1:172.21.15.145:6789/0 conn(0x7f40f00b87e0 legacy=0x7f40f00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 -- 172.21.15.144:0/3021518246 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00cd760 con 0x7f40f00d02c0 2023-05-11T07:35:44.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40ef7fe700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f00d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.721+0000 7f40f4f9c700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00d02c0 0x7f40f00d25d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009e50 tx=0x7f40e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dc123f8cf4827a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40eeffd700 1 -- 172.21.15.144:0/3021518246 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e070 con 0x7f40f00d02c0 2023-05-11T07:35:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40eeffd700 1 -- 172.21.15.144:0/3021518246 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8003a20 con 0x7f40f00d02c0 2023-05-11T07:35:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40eeffd700 1 -- 172.21.15.144:0/3021518246 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8003dd0 con 0x7f40f00d02c0 2023-05-11T07:35:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 -- 172.21.15.144:0/3021518246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00d02c0 msgr2=0x7f40f00d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00d02c0 0x7f40f00d25d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009e50 tx=0x7f40e800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 -- 172.21.15.144:0/3021518246 shutdown_connections 2023-05-11T07:35:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00d02c0 0x7f40f00d25d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 --2- 172.21.15.144:0/3021518246 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f00d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 -- 172.21.15.144:0/3021518246 >> 172.21.15.144:0/3021518246 conn(0x7f40f006acf0 msgr2=0x7f40f006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:44.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 -- 172.21.15.144:0/3021518246 shutdown_connections 2023-05-11T07:35:44.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.722+0000 7f40f69ff700 1 -- 172.21.15.144:0/3021518246 wait complete. 2023-05-11T07:35:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.724+0000 7f40f69ff700 1 Processor -- start 2023-05-11T07:35:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.724+0000 7f40f69ff700 1 -- start start 2023-05-11T07:35:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 0x7f40f0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00cb560 con 0x7f40f00b87e0 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0154c20 con 0x7f40f00d02c0 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40f69ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00ca8e0 con 0x7f40f00b52a0 2023-05-11T07:35:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40ef7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40ef7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48278/0 (socket says 172.21.15.144:48278) 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.725+0000 7f40ef7fe700 1 -- 172.21.15.144:0/2972569949 learned_addr learned my addr 172.21.15.144:0/2972569949 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40f4f9c700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 0x7f40f0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 -- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 msgr2=0x7f40f01543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40effff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f01543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 -- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 msgr2=0x7f40f0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 0x7f40f0153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 -- 172.21.15.144:0/2972569949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009b30 con 0x7f40f00b87e0 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40f4f9c700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 0x7f40f0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40effff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ef7fe700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c750 tx=0x7f40e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4011800 con 0x7f40f00b87e0 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e4011960 con 0x7f40f00b87e0 2023-05-11T07:35:44.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f00cd9b0 con 0x7f40f00b87e0 2023-05-11T07:35:44.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4011cd0 con 0x7f40f00b87e0 2023-05-11T07:35:44.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.726+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f00d2d30 con 0x7f40f00b87e0 2023-05-11T07:35:44.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.727+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f00cdc90 con 0x7f40f00b87e0 2023-05-11T07:35:44.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.728+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40e4021350 con 0x7f40f00b87e0 2023-05-11T07:35:44.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.729+0000 7f40ecff9700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 0x7f40dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:44.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.729+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f40e4089680 con 0x7f40f00b87e0 2023-05-11T07:35:44.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.729+0000 7f40effff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 0x7f40dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:44.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.730+0000 7f40effff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 0x7f40dc06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f015cab0 tx=0x7f40e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:44.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.733+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f40e4054440 con 0x7f40f00b87e0 2023-05-11T07:35:44.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.971+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40f008c1a0 con 0x7f40f00b87e0 2023-05-11T07:35:44.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.971+0000 7f40ecff9700 1 -- 172.21.15.144:0/2972569949 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f40e4057a60 con 0x7f40f00b87e0 2023-05-11T07:35:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:44.974 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:35:44.512112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-11T07:35:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 msgr2=0x7f40dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 0x7f40dc06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f015cab0 tx=0x7f40e0009040 comp rx=0 tx=0).stop 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 msgr2=0x7f40f00ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c750 tx=0x7f40e400cb10 comp rx=0 tx=0).stop 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 shutdown_connections 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f40dc06ace0 0x7f40dc06d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f40f00b52a0 0x7f40f01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40f00d02c0 0x7f40f0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 --2- 172.21.15.144:0/2972569949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f00b87e0 0x7f40f00ca1e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 >> 172.21.15.144:0/2972569949 conn(0x7f40f006acf0 msgr2=0x7f40f00b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 shutdown_connections 2023-05-11T07:35:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:44.974+0000 7f40f69ff700 1 -- 172.21.15.144:0/2972569949 wait complete. 2023-05-11T07:35:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 7 2023-05-11T07:35:44.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:45.020 INFO:tasks.ceph.mds.d.smithi145.stderr:2023-05-11T07:35:45.016+0000 7f65a79f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T07:35:45.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.176+0000 7fc3433ff700 1 Processor -- start 2023-05-11T07:35:45.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.176+0000 7fc3433ff700 1 -- start start 2023-05-11T07:35:45.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc3433ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0b52a0 0x7fc33c0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc3433ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc33c0d02c0 0x7fc33c0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc3433ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c15cef0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc3433ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c0b5a80 con 0x7fc33c0d02c0 2023-05-11T07:35:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc3433ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0cdf70 con 0x7fc33c0b52a0 2023-05-11T07:35:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc34119b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc33c0b87e0 0x7fc33c0b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34630/0 (socket says 172.21.15.144:34630) 2023-05-11T07:35:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.177+0000 7fc34119b700 1 -- 172.21.15.144:0/2988475013 learned_addr learned my addr 172.21.15.144:0/2988475013 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:45.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 --2- 172.21.15.144:0/2988475013 >> v2:172.21.15.144:3300/0 conn(0x7fc33c0d02c0 0x7fc33c0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34099a700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0b52a0 0x7fc33c0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 -- 172.21.15.144:0/2988475013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0b52a0 msgr2=0x7fc33c0d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:45.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0b52a0 0x7fc33c0d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 -- 172.21.15.144:0/2988475013 >> v1:172.21.15.144:6789/0 conn(0x7fc33c0b87e0 legacy=0x7fc33c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 -- 172.21.15.144:0/2988475013 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0cd760 con 0x7fc33c0d02c0 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc34199c700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0d02c0 0x7fc33c0d25d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc334009d90 tx=0x7fc33400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54198a97614ef328 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc333fff700 1 -- 172.21.15.144:0/2988475013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400e070 con 0x7fc33c0d02c0 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc333fff700 1 -- 172.21.15.144:0/2988475013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33400bb20 con 0x7fc33c0d02c0 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.178+0000 7fc333fff700 1 -- 172.21.15.144:0/2988475013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334012430 con 0x7fc33c0d02c0 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 -- 172.21.15.144:0/2988475013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0d02c0 msgr2=0x7fc33c0d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0d02c0 0x7fc33c0d25d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc334009d90 tx=0x7fc33400b330 comp rx=0 tx=0).stop 2023-05-11T07:35:45.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 -- 172.21.15.144:0/2988475013 shutdown_connections 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0d02c0 0x7fc33c0d25d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 --2- 172.21.15.144:0/2988475013 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0b52a0 0x7fc33c0d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 -- 172.21.15.144:0/2988475013 >> 172.21.15.144:0/2988475013 conn(0x7fc33c06acf0 msgr2=0x7fc33c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 -- 172.21.15.144:0/2988475013 shutdown_connections 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.179+0000 7fc3433ff700 1 -- 172.21.15.144:0/2988475013 wait complete. 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.181+0000 7fc3433ff700 1 Processor -- start 2023-05-11T07:35:45.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.181+0000 7fc3433ff700 1 -- start start 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 0x7fc33c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 0x7fc33c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c155350 con 0x7fc33c0b87e0 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c152460 con 0x7fc33c0b52a0 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc3433ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1f2d10 con 0x7fc33c0d02c0 2023-05-11T07:35:45.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48286/0 (socket says 172.21.15.144:48286) 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 -- 172.21.15.144:0/3775303253 learned_addr learned my addr 172.21.15.144:0/3775303253 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34199c700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 0x7fc33c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34119b700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 0x7fc33c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 -- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 msgr2=0x7fc33c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 0x7fc33c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 -- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 msgr2=0x7fc33c151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 0x7fc33c151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34099a700 1 -- 172.21.15.144:0/3775303253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc334009a70 con 0x7fc33c0b87e0 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34199c700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 0x7fc33c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.182+0000 7fc34119b700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 0x7fc33c151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc34099a700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e9e0 tx=0x7fc32c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0096b0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c00c7f0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00cb60 con 0x7fc33c0b87e0 2023-05-11T07:35:45.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c0cd9b0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.183+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c0d2d30 con 0x7fc33c0b87e0 2023-05-11T07:35:45.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.184+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c0cdc90 con 0x7fc33c0b87e0 2023-05-11T07:35:45.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.185+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc32c00ccc0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.186+0000 7fc331ffb700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 0x7fc32006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.186+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc32c089800 con 0x7fc33c0b87e0 2023-05-11T07:35:45.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.186+0000 7fc34119b700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 0x7fc32006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.187+0000 7fc34119b700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 0x7fc32006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.190+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc32c0545b0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.385+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc33c0cef40 con 0x7fc33c0b87e0 2023-05-11T07:35:45.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.386+0000 7fc331ffb700 1 -- 172.21.15.144:0/3775303253 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fc32c057bd0 con 0x7fc33c0b87e0 2023-05-11T07:35:45.389 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:45.389 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.388+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 msgr2=0x7fc32006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.388+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 0x7fc32006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009040 comp rx=0 tx=0).stop 2023-05-11T07:35:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.388+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 msgr2=0x7fc33c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.388+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e9e0 tx=0x7fc32c00eda0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 shutdown_connections 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc32006ace0 0x7fc32006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc33c0d02c0 0x7fc33c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33c0b52a0 0x7fc33c151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 --2- 172.21.15.144:0/3775303253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33c0b87e0 0x7fc33c0cc290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 >> 172.21.15.144:0/3775303253 conn(0x7fc33c06acf0 msgr2=0x7fc33c0b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 shutdown_connections 2023-05-11T07:35:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.389+0000 7fc3433ff700 1 -- 172.21.15.144:0/3775303253 wait complete. 2023-05-11T07:35:45.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.590+0000 7ff9f75ff700 1 Processor -- start 2023-05-11T07:35:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.590+0000 7ff9f75ff700 1 -- start start 2023-05-11T07:35:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.591+0000 7ff9f75ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff9f00b52a0 0x7ff9f00d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.591+0000 7ff9f75ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.591+0000 7ff9f75ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f015cef0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.591+0000 7ff9f75ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f00b5a80 con 0x7ff9f00b52a0 2023-05-11T07:35:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.591+0000 7ff9f75ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cdf70 con 0x7ff9f00d02c0 2023-05-11T07:35:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f4b9a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff9f00b52a0 0x7ff9f00d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:51970/0 (socket says 172.21.15.144:51970) 2023-05-11T07:35:45.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 -- 172.21.15.144:0/3472184756 learned_addr learned my addr 172.21.15.144:0/3472184756 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 -- 172.21.15.144:0/3472184756 >> v2:172.21.15.145:3300/0 conn(0x7ff9f00b52a0 msgr2=0x7ff9f00d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 --2- 172.21.15.144:0/3472184756 >> v2:172.21.15.145:3300/0 conn(0x7ff9f00b52a0 0x7ff9f00d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 -- 172.21.15.144:0/3472184756 >> v1:172.21.15.145:6789/0 conn(0x7ff9f00b87e0 legacy=0x7ff9f00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.592+0000 7ff9f5b9c700 1 -- 172.21.15.144:0/3472184756 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00cd760 con 0x7ff9f00d02c0 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f5b9c700 1 --2- 172.21.15.144:0/3472184756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e50 tx=0x7ff9e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47bf6fb9338346ab server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9e7fff700 1 -- 172.21.15.144:0/3472184756 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800e070 con 0x7ff9f00d02c0 2023-05-11T07:35:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9e7fff700 1 -- 172.21.15.144:0/3472184756 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e800b910 con 0x7ff9f00d02c0 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9e7fff700 1 -- 172.21.15.144:0/3472184756 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800bcc0 con 0x7ff9f00d02c0 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 -- 172.21.15.144:0/3472184756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 msgr2=0x7ff9f00d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/3472184756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009e50 tx=0x7ff9e800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 -- 172.21.15.144:0/3472184756 shutdown_connections 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/3472184756 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f00d25d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/3472184756 >> v2:172.21.15.145:3300/0 conn(0x7ff9f00b52a0 0x7ff9f00d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.593+0000 7ff9f75ff700 1 -- 172.21.15.144:0/3472184756 >> 172.21.15.144:0/3472184756 conn(0x7ff9f006acf0 msgr2=0x7ff9f006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.594+0000 7ff9f75ff700 1 -- 172.21.15.144:0/3472184756 shutdown_connections 2023-05-11T07:35:45.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.594+0000 7ff9f75ff700 1 -- 172.21.15.144:0/3472184756 wait complete. 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.595+0000 7ff9f75ff700 1 Processor -- start 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.595+0000 7ff9f75ff700 1 -- start start 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9f00b52a0 0x7ff9f01e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f01f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f01f39a0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cad90 con 0x7ff9f00b52a0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f75ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cb070 con 0x7ff9f00d02c0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f4b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f4b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48294/0 (socket says 172.21.15.144:48294) 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.596+0000 7ff9f4b9a700 1 -- 172.21.15.144:0/2123486763 learned_addr learned my addr 172.21.15.144:0/2123486763 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f5b9c700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f01f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f539b700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9f00b52a0 0x7ff9f01e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 -- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 msgr2=0x7ff9f01f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f01f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 -- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9f00b52a0 msgr2=0x7ff9f01e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9f00b52a0 0x7ff9f01e63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 -- 172.21.15.144:0/2123486763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8009b30 con 0x7ff9f00b87e0 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f4b9a700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000e9b0 tx=0x7ff9e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000c7f0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000c950 con 0x7ff9f00b87e0 2023-05-11T07:35:45.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000ccc0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f00cd9b0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.597+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f00d2d30 con 0x7ff9f00b87e0 2023-05-11T07:35:45.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.598+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f00cdc90 con 0x7ff9f00b87e0 2023-05-11T07:35:45.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.599+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9e0013470 con 0x7ff9f00b87e0 2023-05-11T07:35:45.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.600+0000 7ff9e5ffb700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 0x7ff9d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:45.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.601+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff9e0089890 con 0x7ff9f00b87e0 2023-05-11T07:35:45.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.601+0000 7ff9f539b700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 0x7ff9d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:45.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.601+0000 7ff9f539b700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 0x7ff9d406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00cc820 tx=0x7ff9ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:45.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.605+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff9e0054640 con 0x7ff9f00b87e0 2023-05-11T07:35:45.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.804+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f00cabf0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.805+0000 7ff9e5ffb700 1 -- 172.21.15.144:0/2123486763 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7ff9f00cabf0 con 0x7ff9f00b87e0 2023-05-11T07:35:45.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:45.808 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 msgr2=0x7ff9d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 0x7ff9d406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00cc820 tx=0x7ff9ec009040 comp rx=0 tx=0).stop 2023-05-11T07:35:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 msgr2=0x7ff9f01f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000e9b0 tx=0x7ff9e000ed70 comp rx=0 tx=0).stop 2023-05-11T07:35:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 shutdown_connections 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9d406ace0 0x7ff9d406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9f00d02c0 0x7ff9f01f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9f00b52a0 0x7ff9f01e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 --2- 172.21.15.144:0/2123486763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9f00b87e0 0x7ff9f01f29d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.807+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 >> 172.21.15.144:0/2123486763 conn(0x7ff9f006acf0 msgr2=0x7ff9f00b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.808+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 shutdown_connections 2023-05-11T07:35:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:45.808+0000 7ff9f75ff700 1 -- 172.21.15.144:0/2123486763 wait complete. 2023-05-11T07:35:45.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:35:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.025+0000 7fbe8e1ff700 1 Processor -- start 2023-05-11T07:35:46.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.025+0000 7fbe8e1ff700 1 -- start start 2023-05-11T07:35:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe8e1ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe880b52a0 0x7fbe880d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe8e1ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbe880d02c0 0x7fbe880d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe8e1ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8815cef0 con 0x7fbe880b87e0 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe8e1ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880b5a80 con 0x7fbe880b52a0 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe8e1ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880cdf70 con 0x7fbe880d02c0 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe86ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe880b52a0 0x7fbe880d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe86ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe880b52a0 0x7fbe880d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57624/0 (socket says 172.21.15.144:57624) 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 -- 172.21.15.144:0/1764244318 learned_addr learned my addr 172.21.15.144:0/1764244318 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.026+0000 7fbe877fe700 1 --1- 172.21.15.144:0/1764244318 >> v1:172.21.15.144:6789/0 conn(0x7fbe880b87e0 0x7fbe880b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37868/0 (socket says 172.21.15.144:37868) 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe87fff700 1 --2- 172.21.15.144:0/1764244318 >> v2:172.21.15.145:3300/0 conn(0x7fbe880d02c0 0x7fbe880d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 -- 172.21.15.144:0/1764244318 >> v2:172.21.15.145:3300/0 conn(0x7fbe880d02c0 msgr2=0x7fbe880d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 --2- 172.21.15.144:0/1764244318 >> v2:172.21.15.145:3300/0 conn(0x7fbe880d02c0 0x7fbe880d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 -- 172.21.15.144:0/1764244318 >> v1:172.21.15.144:6789/0 conn(0x7fbe880b87e0 legacy=0x7fbe880b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 -- 172.21.15.144:0/1764244318 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880cd760 con 0x7fbe880b52a0 2023-05-11T07:35:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.027+0000 7fbe86ffd700 1 --2- 172.21.15.144:0/1764244318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b52a0 0x7fbe880d2090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe880d3010 tx=0x7fbe7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843ac4604b7e85d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe867fc700 1 -- 172.21.15.144:0/1764244318 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c011830 con 0x7fbe880b52a0 2023-05-11T07:35:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe867fc700 1 -- 172.21.15.144:0/1764244318 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c011990 con 0x7fbe880b52a0 2023-05-11T07:35:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe867fc700 1 -- 172.21.15.144:0/1764244318 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c011d20 con 0x7fbe880b52a0 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/1764244318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b52a0 msgr2=0x7fbe880d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/1764244318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b52a0 0x7fbe880d2090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe880d3010 tx=0x7fbe7c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/1764244318 shutdown_connections 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/1764244318 >> v2:172.21.15.145:3300/0 conn(0x7fbe880d02c0 0x7fbe880d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/1764244318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b52a0 0x7fbe880d2090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/1764244318 >> 172.21.15.144:0/1764244318 conn(0x7fbe8806acf0 msgr2=0x7fbe8806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/1764244318 shutdown_connections 2023-05-11T07:35:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.028+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/1764244318 wait complete. 2023-05-11T07:35:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.030+0000 7fbe8e1ff700 1 Processor -- start 2023-05-11T07:35:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.030+0000 7fbe8e1ff700 1 -- start start 2023-05-11T07:35:46.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 0x7fbe880c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 0x7fbe88147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880cb0b0 con 0x7fbe880b87e0 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880c64b0 con 0x7fbe880d02c0 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.031+0000 7fbe8e1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8815bff0 con 0x7fbe880b52a0 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57628/0 (socket says 172.21.15.144:57628) 2023-05-11T07:35:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 -- 172.21.15.144:0/3912577813 learned_addr learned my addr 172.21.15.144:0/3912577813 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe87fff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 0x7fbe88147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe877fe700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 0x7fbe880c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 -- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 msgr2=0x7fbe880c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 0x7fbe880c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 -- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 msgr2=0x7fbe88147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 0x7fbe88147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 -- 172.21.15.144:0/3912577813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009550 con 0x7fbe880b87e0 2023-05-11T07:35:46.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe87fff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 0x7fbe88147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe877fe700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 0x7fbe880c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe86ffd700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c00 tx=0x7fbe7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c004570 con 0x7fbe880b87e0 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c01f070 con 0x7fbe880b87e0 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0038e0 con 0x7fbe880b87e0 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.032+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe880cd9b0 con 0x7fbe880b87e0 2023-05-11T07:35:46.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.033+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe880d2d30 con 0x7fbe880b87e0 2023-05-11T07:35:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.034+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe880cdc90 con 0x7fbe880b87e0 2023-05-11T07:35:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.034+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe7c021030 con 0x7fbe880b87e0 2023-05-11T07:35:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.035+0000 7fbe6ffff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.035+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe7c08abc0 con 0x7fbe880b87e0 2023-05-11T07:35:46.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.036+0000 7fbe877fe700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.036+0000 7fbe877fe700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 0x7fbe7406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe78007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.040+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe7c055970 con 0x7fbe880b87e0 2023-05-11T07:35:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.275+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe8808b830 con 0x7fbe880b87e0 2023-05-11T07:35:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.276+0000 7fbe6ffff700 1 -- 172.21.15.144:0/3912577813 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4679 (secure 0 0 0) 0x7fbe7c015090 con 0x7fbe880b87e0 2023-05-11T07:35:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:46.279 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:35:44.512112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-11T07:35:46.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.278+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 msgr2=0x7fbe7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.278+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 0x7fbe7406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe78007df0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.278+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 msgr2=0x7fbe88158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.278+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c00 tx=0x7fbe7c004750 comp rx=0 tx=0).stop 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 shutdown_connections 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe880b52a0 0x7fbe880c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe880d02c0 0x7fbe88147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 --2- 172.21.15.144:0/3912577813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe880b87e0 0x7fbe88158e40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 >> 172.21.15.144:0/3912577813 conn(0x7fbe8806acf0 msgr2=0x7fbe880d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:46.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 shutdown_connections 2023-05-11T07:35:46.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.279+0000 7fbe8e1ff700 1 -- 172.21.15.144:0/3912577813 wait complete. 2023-05-11T07:35:46.283 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 7 2023-05-11T07:35:46.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.479+0000 7f933d9ff700 1 Processor -- start 2023-05-11T07:35:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.479+0000 7f933d9ff700 1 -- start start 2023-05-11T07:35:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.480+0000 7f933d9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f93380b87e0 0x7f93380b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.480+0000 7f933d9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f93380b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f933d9ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933815cef0 con 0x7f93380d02c0 2023-05-11T07:35:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f933d9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93380b5a80 con 0x7f93380b87e0 2023-05-11T07:35:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f933d9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380cdf70 con 0x7f93380d27a0 2023-05-11T07:35:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f93367fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f93380d02c0 0x7f93380d2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37882/0 (socket says 172.21.15.144:37882) 2023-05-11T07:35:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f93367fc700 1 -- 172.21.15.144:0/2981731472 learned_addr learned my addr 172.21.15.144:0/2981731472 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:46.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9336ffd700 1 --2- 172.21.15.144:0/2981731472 >> v2:172.21.15.145:3300/0 conn(0x7f93380b87e0 0x7f93380b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f93377fe700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f93380b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9335ffb700 1 -- 172.21.15.144:0/2981731472 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582956950 0 0) 0x7f932c001110 con 0x7f93380d02c0 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9335ffb700 1 -- 172.21.15.144:0/2981731472 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93200035b0 con 0x7f93380d02c0 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9336ffd700 1 -- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 msgr2=0x7f93380b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9336ffd700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f93380b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9336ffd700 1 -- 172.21.15.144:0/2981731472 >> v1:172.21.15.144:6789/0 conn(0x7f93380d02c0 legacy=0x7f93380d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f9336ffd700 1 -- 172.21.15.144:0/2981731472 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380cd760 con 0x7f93380b87e0 2023-05-11T07:35:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.481+0000 7f93377fe700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f93380b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f9336ffd700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380b87e0 0x7f93380b4b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9328009840 tx=0x7f9328009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81bfd010a916f54 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f9335ffb700 1 -- 172.21.15.144:0/2981731472 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328011830 con 0x7f93380b87e0 2023-05-11T07:35:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f9335ffb700 1 -- 172.21.15.144:0/2981731472 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328011990 con 0x7f93380b87e0 2023-05-11T07:35:46.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f9335ffb700 1 -- 172.21.15.144:0/2981731472 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328011d00 con 0x7f93380b87e0 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 -- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380b87e0 msgr2=0x7f93380b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380b87e0 0x7f93380b4b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9328009840 tx=0x7f9328009b50 comp rx=0 tx=0).stop 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 -- 172.21.15.144:0/2981731472 shutdown_connections 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380b87e0 0x7f93380b4b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 --2- 172.21.15.144:0/2981731472 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f93380b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.482+0000 7f933d9ff700 1 -- 172.21.15.144:0/2981731472 >> 172.21.15.144:0/2981731472 conn(0x7f933806acf0 msgr2=0x7f933806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.483+0000 7f933d9ff700 1 -- 172.21.15.144:0/2981731472 shutdown_connections 2023-05-11T07:35:46.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.483+0000 7f933d9ff700 1 -- 172.21.15.144:0/2981731472 wait complete. 2023-05-11T07:35:46.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.484+0000 7f933d9ff700 1 Processor -- start 2023-05-11T07:35:46.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.484+0000 7f933d9ff700 1 -- start start 2023-05-11T07:35:46.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 0x7f93380ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f9338151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93380c7fc0 con 0x7f93380b87e0 2023-05-11T07:35:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338153ea0 con 0x7f93380d02c0 2023-05-11T07:35:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f933d9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93381540f0 con 0x7f93380d27a0 2023-05-11T07:35:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.485+0000 7f9336ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57644/0 (socket says 172.21.15.144:57644) 2023-05-11T07:35:46.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 -- 172.21.15.144:0/109204359 learned_addr learned my addr 172.21.15.144:0/109204359 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f93377fe700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f9338151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f93367fc700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 0x7f93380ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 -- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 msgr2=0x7f9338151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f9338151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 -- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 msgr2=0x7f93380ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 0x7f93380ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 -- 172.21.15.144:0/109204359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330009a70 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f93367fc700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 0x7f93380ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f9336ffd700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9328009fd0 tx=0x7f9328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280045d0 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932801e070 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280094a0 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.486+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280038a0 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.487+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93380cd9b0 con 0x7f93380b87e0 2023-05-11T07:35:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.488+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93380d2d30 con 0x7f93380b87e0 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.488+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9328003a00 con 0x7f93380b87e0 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.489+0000 7f931ffff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.489+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f932808a620 con 0x7f93380b87e0 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.489+0000 7f93367fc700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.490+0000 7f93367fc700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 0x7f932406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93381f5ea0 tx=0x7f932c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.493+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9328055470 con 0x7f93380b87e0 2023-05-11T07:35:46.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.686+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93380cdc90 con 0x7f93380b87e0 2023-05-11T07:35:46.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.688+0000 7f931ffff700 1 -- 172.21.15.144:0/109204359 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f9328003cb0 con 0x7f93380b87e0 2023-05-11T07:35:46.691 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:46.691 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 msgr2=0x7f932406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 0x7f932406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93381f5ea0 tx=0x7f932c009040 comp rx=0 tx=0).stop 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 msgr2=0x7f93380c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9328009fd0 tx=0x7f9328004750 comp rx=0 tx=0).stop 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 shutdown_connections 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f93380d27a0 0x7f9338151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93380b87e0 0x7f93380c8330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 --2- 172.21.15.144:0/109204359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93380d02c0 0x7f93380ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:46.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 >> 172.21.15.144:0/109204359 conn(0x7f933806acf0 msgr2=0x7f93380b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:46.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 shutdown_connections 2023-05-11T07:35:46.694 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:46.690+0000 7f933d9ff700 1 -- 172.21.15.144:0/109204359 wait complete. 2023-05-11T07:35:47.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T07:35:39.989779+0000', 'modified': '2023-05-11T07:35:44.512112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6834/3653158291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 3653158291}, {'type': 'v1', 'addr': '172.21.15.145:6834', 'nonce': 3653158291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-11T07:35:47.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T07:35:47.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-11T07:35:47.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.296+0000 7f17673ff700 1 Processor -- start 2023-05-11T07:35:47.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.296+0000 7f17673ff700 1 -- start start 2023-05-11T07:35:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.297+0000 7f17673ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176006c3b0 0x7f176006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.297+0000 7f17673ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600ce960 con 0x7f17600b0e30 2023-05-11T07:35:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.297+0000 7f17673ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176006bf20 con 0x7f176015a580 2023-05-11T07:35:47.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.297+0000 7f17673ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176006d900 con 0x7f176006c3b0 2023-05-11T07:35:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176006c3b0 0x7f176006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176006c3b0 0x7f176006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57652/0 (socket says 172.21.15.144:57652) 2023-05-11T07:35:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 -- 172.21.15.144:0/2638180776 learned_addr learned my addr 172.21.15.144:0/2638180776 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 -- 172.21.15.144:0/2638180776 >> v1:172.21.15.145:6789/0 conn(0x7f176015a580 legacy=0x7f17600b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 -- 172.21.15.144:0/2638180776 >> v1:172.21.15.144:6789/0 conn(0x7f17600b0e30 legacy=0x7f176015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 -- 172.21.15.144:0/2638180776 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600cce10 con 0x7f176006c3b0 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.298+0000 7f176599c700 1 --2- 172.21.15.144:0/2638180776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f176006d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e50 tx=0x7f175800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bc7f50b5a5b1dc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f1757fff700 1 -- 172.21.15.144:0/2638180776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f176006c3b0 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f1757fff700 1 -- 172.21.15.144:0/2638180776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800b9c0 con 0x7f176006c3b0 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f1757fff700 1 -- 172.21.15.144:0/2638180776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800bd70 con 0x7f176006c3b0 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 -- 172.21.15.144:0/2638180776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 msgr2=0x7f176006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 --2- 172.21.15.144:0/2638180776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f176006d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e50 tx=0x7f175800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:47.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 -- 172.21.15.144:0/2638180776 shutdown_connections 2023-05-11T07:35:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 --2- 172.21.15.144:0/2638180776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f176006d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 -- 172.21.15.144:0/2638180776 >> 172.21.15.144:0/2638180776 conn(0x7f17600cb720 msgr2=0x7f17600cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 -- 172.21.15.144:0/2638180776 shutdown_connections 2023-05-11T07:35:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.299+0000 7f17673ff700 1 -- 172.21.15.144:0/2638180776 wait complete. 2023-05-11T07:35:47.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.301+0000 7f17673ff700 1 Processor -- start 2023-05-11T07:35:47.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.302+0000 7f17673ff700 1 -- start start 2023-05-11T07:35:47.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17600b0e30 0x7f17600c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176015a580 0x7f1760154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c56c0 con 0x7f176006c3b0 2023-05-11T07:35:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c4d30 con 0x7f176015a580 2023-05-11T07:35:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f17673ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17600b2180 con 0x7f17600b0e30 2023-05-11T07:35:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f176519b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f176519b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57666/0 (socket says 172.21.15.144:57666) 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f176519b700 1 -- 172.21.15.144:0/4215452893 learned_addr learned my addr 172.21.15.144:0/4215452893 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f176599c700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176015a580 0x7f1760154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.303+0000 7f176499a700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17600b0e30 0x7f17600c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 -- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17600b0e30 msgr2=0x7f17600c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17600b0e30 0x7f17600c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 -- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176015a580 msgr2=0x7f1760154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176015a580 0x7f1760154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 -- 172.21.15.144:0/4215452893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009b30 con 0x7f176006c3b0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f176519b700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c450 tx=0x7f175c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f1755ffb700 1 -- 172.21.15.144:0/4215452893 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0052d0 con 0x7f176006c3b0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f1755ffb700 1 -- 172.21.15.144:0/4215452893 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c005430 con 0x7f176006c3b0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f1755ffb700 1 -- 172.21.15.144:0/4215452893 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0038c0 con 0x7f176006c3b0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176006bbb0 con 0x7f176006c3b0 2023-05-11T07:35:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.304+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176006b8d0 con 0x7f176006c3b0 2023-05-11T07:35:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.306+0000 7f1755ffb700 1 -- 172.21.15.144:0/4215452893 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f175c003a20 con 0x7f176006c3b0 2023-05-11T07:35:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.307+0000 7f1755ffb700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 0x7f174406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.307+0000 7f1755ffb700 1 -- 172.21.15.144:0/4215452893 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f175c088aa0 con 0x7f176006c3b0 2023-05-11T07:35:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.308+0000 7f176499a700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 0x7f174406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.308+0000 7f176499a700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 0x7f174406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1760155950 tx=0x7f1750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.310+0000 7f177accbb80 1 Processor -- start 2023-05-11T07:35:47.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.310+0000 7f177accbb80 1 -- start start 2023-05-11T07:35:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a3e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a23180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b178e2600 con 0x556b179f6740 2023-05-11T07:35:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b17951790 con 0x556b17a3e230 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b1794aa60 con 0x556b17a3f2d0 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f176599c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f176599c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57676/0 (socket says 172.21.15.144:57676) 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f176599c700 1 -- 172.21.15.144:0/4067606564 learned_addr learned my addr 172.21.15.144:0/4067606564 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f176499a700 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a23180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.311+0000 7f176519b700 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a3e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 -- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 msgr2=0x556b17a23180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a23180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 -- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 msgr2=0x556b17a3e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a3e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 -- 172.21.15.144:0/4067606564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b1773e790 con 0x556b179f6740 2023-05-11T07:35:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f176599c700 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f176006e0f0 tx=0x7f1758010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc943b999d72891 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f1742ffd700 1 -- 172.21.15.144:0/4067606564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800bd70 con 0x556b179f6740 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f1742ffd700 1 -- 172.21.15.144:0/4067606564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758003a20 con 0x556b179f6740 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.312+0000 7f1742ffd700 1 -- 172.21.15.144:0/4067606564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758003df0 con 0x556b179f6740 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 -- 172.21.15.144:0/4067606564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 msgr2=0x556b17a236c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f176006e0f0 tx=0x7f1758010000 comp rx=0 tx=0).stop 2023-05-11T07:35:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 -- 172.21.15.144:0/4067606564 shutdown_connections 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b179f6740 0x556b17a236c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a3e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 --2- 172.21.15.144:0/4067606564 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a23180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 -- 172.21.15.144:0/4067606564 >> 172.21.15.144:0/4067606564 conn(0x556b179edb60 msgr2=0x556b179f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 -- 172.21.15.144:0/4067606564 shutdown_connections 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.313+0000 7f177accbb80 1 -- 172.21.15.144:0/4067606564 wait complete. 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.314+0000 7f177accbb80 1 -- start start 2023-05-11T07:35:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.314+0000 7f177accbb80 1 Processor -- start 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b178e6ad0 con 0x556b17a3e230 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b178e6770 con 0x556b179f6740 2023-05-11T07:35:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b1773f390 con 0x556b17a3f2d0 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f177accbb80 10 client.0 _ll_register_callbacks cb 0x556b178e8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57688/0 (socket says 172.21.15.144:57688) 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 -- 172.21.15.144:0/567294077 learned_addr learned my addr 172.21.15.144:0/567294077 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176519b700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176599c700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 -- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 msgr2=0x556b17a1f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 -- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 msgr2=0x556b17a1f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a1f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176499a700 1 -- 172.21.15.144:0/567294077 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17600cce10 con 0x556b17a3e230 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.316+0000 7f176519b700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a1f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f176499a700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f176006fdc0 tx=0x7f1750001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b19fb41a117d1b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f173bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750014ac0 con 0x556b17a3e230 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b179eb170 con 0x556b17a3e230 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f175001c040 con 0x556b17a3e230 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1750014c20 con 0x556b17a3e230 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f177accbb80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-05-11T07:35:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556b179112e0 con 0x556b17a3e230 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.317+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556b179eb170 con 0x556b17a3e230 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f1750029350 con 0x556b17a3e230 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 20 client.4425 populate_metadata read hostname 'smithi144' 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a265f0 0x556b17a269c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 4 client.4425 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 --> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b179c82f0 con 0x556b17a265f0 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f176519b700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a265f0 0x556b17a269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f173bfff700 10 client.4425 ms_handle_connect on v2:172.21.15.145:6832/3653158291 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.318+0000 7f176519b700 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a265f0 0x556b17a269c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d012ee15d5540ad server_cookie=4125cf4fae04e4e7 in_seq=0 out_seq=0 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.319+0000 7f173bfff700 1 -- 172.21.15.144:0/567294077 <== mds.0 v2:172.21.15.145:6832/3653158291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x556b179c82f0 con 0x556b17a265f0 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.319+0000 7f173bfff700 10 client.4425 handle_command_reply: tid=0 2023-05-11T07:35:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.319+0000 7f177accbb80 1 client.4425 shutdown 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 msgr2=0x556b17a17a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f176006fdc0 tx=0x7f1750001120 comp rx=0 tx=0).stop 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 shutdown_connections 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a265f0 0x556b17a269c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a1f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 --2- 172.21.15.144:0/567294077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a17a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f173bfff700 0 client.4425 ms_handle_reset on v2:172.21.15.145:6832/3653158291 2023-05-11T07:35:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 >> 172.21.15.144:0/567294077 conn(0x556b179edb60 msgr2=0x556b17a3d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 shutdown_connections 2023-05-11T07:35:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 1 -- 172.21.15.144:0/567294077 wait complete. 2023-05-11T07:35:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.320+0000 7f177accbb80 20 client.4425 trim_cache size 0 max 16384 2023-05-11T07:35:47.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.338+0000 7f177accbb80 1 Processor -- start 2023-05-11T07:35:47.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.338+0000 7f177accbb80 1 -- start start 2023-05-11T07:35:47.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b17a17190 con 0x556b17a3e230 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b179eacb0 con 0x556b179f6740 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b17a1a060 con 0x556b17a3f2d0 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57704/0 (socket says 172.21.15.144:57704) 2023-05-11T07:35:47.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 -- 172.21.15.144:0/3306566952 learned_addr learned my addr 172.21.15.144:0/3306566952 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176519b700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176599c700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 -- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 msgr2=0x556b17a1dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 -- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 msgr2=0x556b17a231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 -- 172.21.15.144:0/3306566952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b17911030 con 0x556b17a3e230 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176599c700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.339+0000 7f176499a700 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1750001790 tx=0x7f1750020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55133ddcf03956bf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f17437fe700 1 -- 172.21.15.144:0/3306566952 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17500298b0 con 0x556b17a3e230 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f17437fe700 1 -- 172.21.15.144:0/3306566952 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750001d00 con 0x556b17a3e230 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f17437fe700 1 -- 172.21.15.144:0/3306566952 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750029350 con 0x556b17a3e230 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 -- 172.21.15.144:0/3306566952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 msgr2=0x556b17a26bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1750001790 tx=0x7f1750020000 comp rx=0 tx=0).stop 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 -- 172.21.15.144:0/3306566952 shutdown_connections 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b17a3f2d0 0x556b17a1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b179f6740 0x556b17a231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 --2- 172.21.15.144:0/3306566952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3e230 0x556b17a26bb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 -- 172.21.15.144:0/3306566952 >> 172.21.15.144:0/3306566952 conn(0x556b179edb60 msgr2=0x556b179ef0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 -- 172.21.15.144:0/3306566952 shutdown_connections 2023-05-11T07:35:47.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.340+0000 7f177accbb80 1 -- 172.21.15.144:0/3306566952 wait complete. 2023-05-11T07:35:47.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.341+0000 7f177accbb80 1 -- start start 2023-05-11T07:35:47.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.341+0000 7f177accbb80 1 Processor -- start 2023-05-11T07:35:47.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b179f6740 0x556b17aa5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a56890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b17a223e0 con 0x556b17a3f2d0 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b17aa62d0 con 0x556b17a3e230 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b17aa70a0 con 0x556b179f6740 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f177accbb80 10 client.0 _ll_register_callbacks cb 0x556b178e8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:35:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176599c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176599c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57712/0 (socket says 172.21.15.144:57712) 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176599c700 1 -- 172.21.15.144:0/16630921 learned_addr learned my addr 172.21.15.144:0/16630921 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176519b700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b179f6740 0x556b17aa5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176499a700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a56890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.343+0000 7f176599c700 1 -- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b179f6740 msgr2=0x556b17aa5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f176599c700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b179f6740 0x556b17aa5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f176599c700 1 -- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 msgr2=0x556b17a56890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f176599c700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a56890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f176599c700 1 -- 172.21.15.144:0/16630921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b179112e0 con 0x556b17a3f2d0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f176599c700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1758012000 tx=0x7f1758004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b245a6692c4c9967 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f173bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758032680 con 0x556b17a3f2d0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17580327e0 con 0x556b17a3f2d0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1758003a20 con 0x556b17a3f2d0 2023-05-11T07:35:47.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17580329e0 con 0x556b17a3f2d0 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f177accbb80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556b178f7b10 con 0x556b17a3f2d0 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.344+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758003a20 con 0x556b17a3f2d0 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f1758026d20 con 0x556b17a3f2d0 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 10 client.4431 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 20 client.4431 populate_metadata read hostname 'smithi144' 2023-05-11T07:35:47.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a18dd0 0x556b17a191a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 4 client.4431 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 --> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556b17943ba0 con 0x556b17a18dd0 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f176519b700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a18dd0 0x556b17a191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f173bfff700 10 client.4431 ms_handle_connect on v2:172.21.15.145:6832/3653158291 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.345+0000 7f176519b700 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a18dd0 0x556b17a191a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7af2c5d3c56a71a4 server_cookie=54d3d597eb89e38c in_seq=0 out_seq=0 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f173bfff700 1 -- 172.21.15.144:0/16630921 <== mds.0 v2:172.21.15.145:6832/3653158291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x556b17943ba0 con 0x556b17a18dd0 2023-05-11T07:35:47.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f173bfff700 10 client.4431 handle_command_reply: tid=0 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 client.4431 shutdown 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 msgr2=0x556b17a56dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1758012000 tx=0x7f1758004b40 comp rx=0 tx=0).stop 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 shutdown_connections 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x556b179f6740 0x556b17aa5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x556b17a18dd0 0x556b17a191a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556b17a3f2d0 0x556b17a56dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 --2- 172.21.15.144:0/16630921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b17a3e230 0x556b17a56890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f173bfff700 0 client.4431 ms_handle_reset on v2:172.21.15.145:6832/3653158291 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 >> 172.21.15.144:0/16630921 conn(0x556b179edb60 msgr2=0x556b17a1e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 shutdown_connections 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 1 -- 172.21.15.144:0/16630921 wait complete. 2023-05-11T07:35:47.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.346+0000 7f177accbb80 20 client.4431 trim_cache size 0 max 16384 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "424d6242-b269-485d-aca8-83f4424787ea", 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4306, 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2023-05-11T07:35:47.358 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 7.3525294480000003, 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 7, 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 27, 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 26, 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 13.34295056 2023-05-11T07:35:47.359 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-05-11T07:35:47.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 msgr2=0x7f174406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 0x7f174406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1760155950 tx=0x7f1750009040 comp rx=0 tx=0).stop 2023-05-11T07:35:47.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 msgr2=0x7f17600b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c450 tx=0x7f175c00c760 comp rx=0 tx=0).stop 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 shutdown_connections 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174406ace0 0x7f174406d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176015a580 0x7f1760154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176006c3b0 0x7f17600b1af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 --2- 172.21.15.144:0/4215452893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f17600b0e30 0x7f17600c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 >> 172.21.15.144:0/4215452893 conn(0x7f17600cb720 msgr2=0x7f176015ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 shutdown_connections 2023-05-11T07:35:47.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.347+0000 7f17673ff700 1 -- 172.21.15.144:0/4215452893 wait complete. 2023-05-11T07:35:47.366 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T07:35:47.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:47.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:35:47.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.551+0000 7fb7763ff700 1 Processor -- start 2023-05-11T07:35:47.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.551+0000 7fb7763ff700 1 -- start start 2023-05-11T07:35:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb7763ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015cc30 0x7fb7700b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb7763ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb77006b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb7763ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7700b3dc0 con 0x7fb7700b23f0 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb7763ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700d08d0 con 0x7fb77015cc30 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb7763ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d0bb0 con 0x7fb77015d000 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb76ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015cc30 0x7fb7700b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb76ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015cc30 0x7fb7700b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57728/0 (socket says 172.21.15.144:57728) 2023-05-11T07:35:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb76ffff700 1 -- 172.21.15.144:0/4249561748 learned_addr learned my addr 172.21.15.144:0/4249561748 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.552+0000 7fb767fff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb77006b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76ffff700 1 -- 172.21.15.144:0/4249561748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 msgr2=0x7fb77006b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76ffff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb77006b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76ffff700 1 -- 172.21.15.144:0/4249561748 >> v1:172.21.15.144:6789/0 conn(0x7fb7700b23f0 legacy=0x7fb7700ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76ffff700 1 -- 172.21.15.144:0/4249561748 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700b4010 con 0x7fb77015cc30 2023-05-11T07:35:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76ffff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015cc30 0x7fb7700b1db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7600098f0 tx=0x7fb760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5101c1af50a024ec server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76f7fe700 1 -- 172.21.15.144:0/4249561748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760011830 con 0x7fb77015cc30 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76f7fe700 1 -- 172.21.15.144:0/4249561748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760011990 con 0x7fb77015cc30 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.553+0000 7fb76f7fe700 1 -- 172.21.15.144:0/4249561748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760011d20 con 0x7fb77015cc30 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 -- 172.21.15.144:0/4249561748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015cc30 msgr2=0x7fb7700b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015cc30 0x7fb7700b1db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7600098f0 tx=0x7fb760009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 -- 172.21.15.144:0/4249561748 shutdown_connections 2023-05-11T07:35:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015cc30 0x7fb7700b1db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 --2- 172.21.15.144:0/4249561748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb77006b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 -- 172.21.15.144:0/4249561748 >> 172.21.15.144:0/4249561748 conn(0x7fb77009a2e0 msgr2=0x7fb7700d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 -- 172.21.15.144:0/4249561748 shutdown_connections 2023-05-11T07:35:47.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.554+0000 7fb7763ff700 1 -- 172.21.15.144:0/4249561748 wait complete. 2023-05-11T07:35:47.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.556+0000 7fb7763ff700 1 Processor -- start 2023-05-11T07:35:47.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.556+0000 7fb7763ff700 1 -- start start 2023-05-11T07:35:47.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb77015cc30 0x7fb7700c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb7700cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c8f90 con 0x7fb7700b23f0 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c7950 con 0x7fb77015cc30 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb7763ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c98b0 con 0x7fb77015d000 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57738/0 (socket says 172.21.15.144:57738) 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 -- 172.21.15.144:0/3212616951 learned_addr learned my addr 172.21.15.144:0/3212616951 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb767fff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb77015cc30 0x7fb7700c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb77499c700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb7700cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 -- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 msgr2=0x7fb7700cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb7700cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 -- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb77015cc30 msgr2=0x7fb7700c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb77015cc30 0x7fb7700c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb76ffff700 1 -- 172.21.15.144:0/3212616951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009550 con 0x7fb7700b23f0 2023-05-11T07:35:47.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.558+0000 7fb77499c700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb7700cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb76ffff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760004480 con 0x7fb7700b23f0 2023-05-11T07:35:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76001f070 con 0x7fb7700b23f0 2023-05-11T07:35:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700d0560 con 0x7fb7700b23f0 2023-05-11T07:35:47.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600038c0 con 0x7fb7700b23f0 2023-05-11T07:35:47.565 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.559+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700b42f0 con 0x7fb7700b23f0 2023-05-11T07:35:47.565 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.560+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700b5820 con 0x7fb7700b23f0 2023-05-11T07:35:47.565 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.563+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb760021030 con 0x7fb7700b23f0 2023-05-11T07:35:47.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.564+0000 7fb76d7fa700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 0x7fb75006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:47.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.564+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb76008ac20 con 0x7fb7700b23f0 2023-05-11T07:35:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.564+0000 7fb767fff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 0x7fb75006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.565+0000 7fb767fff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 0x7fb75006d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7701e76a0 tx=0x7fb758009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.569+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb760055a50 con 0x7fb7700b23f0 2023-05-11T07:35:47.812 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.810+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb770070180 con 0x7fb7700b23f0 2023-05-11T07:35:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.810+0000 7fb76d7fa700 1 -- 172.21.15.144:0/3212616951 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb760015070 con 0x7fb7700b23f0 2023-05-11T07:35:47.813 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T07:35:47.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 msgr2=0x7fb75006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 0x7fb75006d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7701e76a0 tx=0x7fb758009210 comp rx=0 tx=0).stop 2023-05-11T07:35:47.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 msgr2=0x7fb7700c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:47.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760004750 comp rx=0 tx=0).stop 2023-05-11T07:35:47.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 shutdown_connections 2023-05-11T07:35:47.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb75006ad10 0x7fb75006d1c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb77015d000 0x7fb7700cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b23f0 0x7fb7700c8a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 --2- 172.21.15.144:0/3212616951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb77015cc30 0x7fb7700c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:47.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.812+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 >> 172.21.15.144:0/3212616951 conn(0x7fb77009a2e0 msgr2=0x7fb77006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:47.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.813+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 shutdown_connections 2023-05-11T07:35:47.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:47.813+0000 7fb7763ff700 1 -- 172.21.15.144:0/3212616951 wait complete. 2023-05-11T07:35:47.832 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-11T07:35:47.832 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:35:47.832 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-05-11T07:35:47.833 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-11T07:35:47.833 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:47.833 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-11T07:35:47.833 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T07:35:47.833 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:35:47.834 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-11T07:35:47.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:47.834 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-05-11T07:35:47.875 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:35:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:35:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:35:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:35:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:35:47.876 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:35:47.877 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-05-11T07:35:47.878 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:35:47.879 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T07:35:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:47.880 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:35:47.880 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:35:47.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-05-11T07:35:47.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-05-11T07:35:47.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-05-11T07:35:47.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T07:35:47.882 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:35:48.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:48.333 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:35:48.438 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-05-11T07:35:48.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:48.441 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-05-11T07:35:48.499 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-05-11T07:35:48.500 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:35:48.500 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:35:48.500 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:35:48.500 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:35:48.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:48.502 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:35:48.502 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:35:48.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:35:48.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:35:48.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:35:48.503 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:35:49.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:49.161 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:35:49.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:49.204 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-05-11T07:35:49.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:49.285 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:35:49.286 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:35:49.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-11T07:35:49.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-11T07:35:49.286 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:35:49.454 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-11T07:35:49.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:49.455 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:35:49.455 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:35:49.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-11T07:35:49.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T07:35:49.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-11T07:35:49.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-11T07:35:49.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-11T07:35:49.457 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:35:49.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:49.697 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:35:49.697 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:35:49.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-05-11T07:35:49.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T07:35:49.698 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:35:49.865 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-11T07:35:49.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:35:49.865 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:49.906 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-11T07:35:49.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:35:49.907 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:49.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2023-05-11T07:35:50.090 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T07:35:50.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T07:35:50.152 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T07:35:50.154 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T07:35:50.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:50.155 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2023-05-11T07:35:50.196 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-11T07:35:50.197 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-11T07:35:50.240 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2023-05-11T07:35:50.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T07:35:50.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T07:35:50.371 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T07:35:50.373 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T07:35:50.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:50.375 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2023-05-11T07:35:50.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:2023-05-11T07:35:50.415+0000 7f70daafc5c0 -1 init, newargv = 0x563a4e572650 newargc=15 2023-05-11T07:35:50.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[112111]: starting ceph client 2023-05-11T07:35:50.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[112111]: starting fuse 2023-05-11T07:35:51.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2023-05-11T07:35:51.588 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T07:35:51.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T07:35:51.652 INFO:teuthology.orchestra.run.smithi144.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T07:35:51.653 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T07:35:51.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:51.655 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2023-05-11T07:35:51.696 INFO:teuthology.orchestra.run.smithi144.stdout:42 2023-05-11T07:35:51.697 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-11T07:35:51.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T07:35:51.698 DEBUG:teuthology.orchestra.run.smithi144:> import glob 2023-05-11T07:35:51.698 DEBUG:teuthology.orchestra.run.smithi144:> import re 2023-05-11T07:35:51.698 DEBUG:teuthology.orchestra.run.smithi144:> import os 2023-05-11T07:35:51.698 DEBUG:teuthology.orchestra.run.smithi144:> import subprocess 2023-05-11T07:35:51.699 DEBUG:teuthology.orchestra.run.smithi144:> 2023-05-11T07:35:51.699 DEBUG:teuthology.orchestra.run.smithi144:> def _find_admin_socket(client_name): 2023-05-11T07:35:51.699 DEBUG:teuthology.orchestra.run.smithi144:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-11T07:35:51.700 DEBUG:teuthology.orchestra.run.smithi144:> files = glob.glob(asok_path) 2023-05-11T07:35:51.700 DEBUG:teuthology.orchestra.run.smithi144:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-11T07:35:51.700 DEBUG:teuthology.orchestra.run.smithi144:> 2023-05-11T07:35:51.701 DEBUG:teuthology.orchestra.run.smithi144:> # Given a non-glob path, it better be there 2023-05-11T07:35:51.701 DEBUG:teuthology.orchestra.run.smithi144:> if "*" not in asok_path: 2023-05-11T07:35:51.701 DEBUG:teuthology.orchestra.run.smithi144:> assert(len(files) == 1) 2023-05-11T07:35:51.702 DEBUG:teuthology.orchestra.run.smithi144:> return files[0] 2023-05-11T07:35:51.702 DEBUG:teuthology.orchestra.run.smithi144:> 2023-05-11T07:35:51.702 DEBUG:teuthology.orchestra.run.smithi144:> for f in files: 2023-05-11T07:35:51.702 DEBUG:teuthology.orchestra.run.smithi144:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T07:35:51.703 DEBUG:teuthology.orchestra.run.smithi144:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T07:35:51.703 DEBUG:teuthology.orchestra.run.smithi144:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T07:35:51.703 DEBUG:teuthology.orchestra.run.smithi144:> contents = proc_f.read() 2023-05-11T07:35:51.703 DEBUG:teuthology.orchestra.run.smithi144:> if mountpoint in contents: 2023-05-11T07:35:51.704 DEBUG:teuthology.orchestra.run.smithi144:> return f 2023-05-11T07:35:51.704 DEBUG:teuthology.orchestra.run.smithi144:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T07:35:51.704 DEBUG:teuthology.orchestra.run.smithi144:> 2023-05-11T07:35:51.705 DEBUG:teuthology.orchestra.run.smithi144:> print(_find_admin_socket("client.admin")) 2023-05-11T07:35:51.705 DEBUG:teuthology.orchestra.run.smithi144:> ' 2023-05-11T07:35:51.871 INFO:teuthology.orchestra.run.smithi144.stdout:/var/run/ceph/ceph-client.admin.112111.asok 2023-05-11T07:35:52.050 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.112111.asok 2023-05-11T07:35:52.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:52.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.112111.asok status 2023-05-11T07:35:52.264 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-05-11T07:35:52.264 INFO:teuthology.orchestra.run.smithi144.stdout: "metadata": { 2023-05-11T07:35:52.264 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T07:35:52.264 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T07:35:52.265 INFO:teuthology.orchestra.run.smithi144.stdout: "entity_id": "admin", 2023-05-11T07:35:52.265 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": "smithi144", 2023-05-11T07:35:52.265 INFO:teuthology.orchestra.run.smithi144.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-11T07:35:52.265 INFO:teuthology.orchestra.run.smithi144.stdout: "pid": "112111", 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "root": "/" 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_count": 0, 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_pinned_count": 0, 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4361, 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "inst": { 2023-05-11T07:35:52.266 INFO:teuthology.orchestra.run.smithi144.stdout: "name": { 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "client", 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "num": 4361 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 875753908 2023-05-11T07:35:52.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 875753908 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "inst_str": "client.4361 172.21.15.144:0/875753908", 2023-05-11T07:35:52.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addr_str": "172.21.15.144:0/875753908", 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "inode_count": 1, 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_epoch": 7, 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch": 27, 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch_barrier": 0, 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "blocklisted": false, 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs" 2023-05-11T07:35:52.269 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-05-11T07:35:52.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:52.277 DEBUG:teuthology.orchestra.run.smithi144:> stat --file-system '--printf=%T 2023-05-11T07:35:52.277 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:52.319 INFO:teuthology.orchestra.run.smithi144.stdout:fuseblk 2023-05-11T07:35:52.320 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:52.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:52.320 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:52.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:52.423 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-11T07:35:52.546 INFO:teuthology.orchestra.run.smithi144.stdout:# file: . 2023-05-11T07:35:52.546 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-11T07:35:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:52.547 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:52.548 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:35:52.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:52.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.811+0000 7f20cd3ff700 1 Processor -- start 2023-05-11T07:35:52.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.812+0000 7f20cd3ff700 1 -- start start 2023-05-11T07:35:52.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20cd3ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20c80b87e0 0x7f20c80b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20cd3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20cd3ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c815cef0 con 0x7f20c80d2090 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20cd3ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c80b5a80 con 0x7f20c80b87e0 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20cd3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80cdf70 con 0x7f20c80d02c0 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20c6ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20c80b87e0 0x7f20c80b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20c6ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20c80b87e0 0x7f20c80b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57752/0 (socket says 172.21.15.144:57752) 2023-05-11T07:35:52.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3108866457 learned_addr learned my addr 172.21.15.144:0/3108866457 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:52.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20bffff700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3108866457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 msgr2=0x7f20c80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:52.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.813+0000 7f20c6ffd700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:52.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3108866457 >> v1:172.21.15.145:6789/0 conn(0x7f20c80d2090 legacy=0x7f20c80d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:52.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3108866457 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80cd760 con 0x7f20c80b87e0 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20bffff700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c6ffd700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c80b4b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098f0 tx=0x7f20b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380d1978e7d304c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c67fc700 1 -- 172.21.15.144:0/3108866457 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004230 con 0x7f20c80b87e0 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c67fc700 1 -- 172.21.15.144:0/3108866457 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8004390 con 0x7f20c80b87e0 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20c67fc700 1 -- 172.21.15.144:0/3108866457 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80036a0 con 0x7f20c80b87e0 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3108866457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 msgr2=0x7f20c80b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.814+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c80b4b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098f0 tx=0x7f20b8009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:52.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3108866457 shutdown_connections 2023-05-11T07:35:52.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c80b4b90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:52.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3108866457 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:52.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3108866457 >> 172.21.15.144:0/3108866457 conn(0x7f20c806acf0 msgr2=0x7f20c806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:52.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3108866457 shutdown_connections 2023-05-11T07:35:52.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.815+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3108866457 wait complete. 2023-05-11T07:35:52.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.816+0000 7f20cd3ff700 1 Processor -- start 2023-05-11T07:35:52.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.816+0000 7f20cd3ff700 1 -- start start 2023-05-11T07:35:52.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20c80d2090 0x7f20c80b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80cac80 con 0x7f20c80b87e0 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80caf60 con 0x7f20c80d2090 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.817+0000 7f20cd3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80cb240 con 0x7f20c80d02c0 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57760/0 (socket says 172.21.15.144:57760) 2023-05-11T07:35:52.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3989968429 learned_addr learned my addr 172.21.15.144:0/3989968429 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20bffff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c77fe700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20c80d2090 0x7f20c80b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 msgr2=0x7f20c80ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20c80d2090 msgr2=0x7f20c80b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:52.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20c80d2090 0x7f20c80b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 -- 172.21.15.144:0/3989968429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8009550 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20c6ffd700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009130 tx=0x7f20b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003e30 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b801f070 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.818+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c80cd9b0 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.819+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800b8a0 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.819+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c80d2d30 con 0x7f20c80b87e0 2023-05-11T07:35:52.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.820+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c80cdc90 con 0x7f20c80b87e0 2023-05-11T07:35:52.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.821+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20b8021030 con 0x7f20c80b87e0 2023-05-11T07:35:52.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.821+0000 7f20bf7fe700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 0x7f20a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:52.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.822+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f20b808ad40 con 0x7f20c80b87e0 2023-05-11T07:35:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.822+0000 7f20bffff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 0x7f20a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:52.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.822+0000 7f20bffff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 0x7f20a806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c80d18a0 tx=0x7f20b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:52.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:52.826+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f20b8055af0 con 0x7f20c80b87e0 2023-05-11T07:35:53.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.021+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c815ced0 con 0x7f20c80b87e0 2023-05-11T07:35:53.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.023+0000 7f20bf7fe700 1 -- 172.21.15.144:0/3989968429 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f20b8010380 con 0x7f20c80b87e0 2023-05-11T07:35:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:53.026 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 msgr2=0x7f20a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 0x7f20a806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c80d18a0 tx=0x7f20b0008040 comp rx=0 tx=0).stop 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 msgr2=0x7f20c8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009130 tx=0x7f20b8004750 comp rx=0 tx=0).stop 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 shutdown_connections 2023-05-11T07:35:53.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f20a806ace0 0x7f20a806d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20c80d2090 0x7f20c80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c80b87e0 0x7f20c8154630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 --2- 172.21.15.144:0/3989968429 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20c80d02c0 0x7f20c80ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 >> 172.21.15.144:0/3989968429 conn(0x7f20c806acf0 msgr2=0x7f20c80b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 shutdown_connections 2023-05-11T07:35:53.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.025+0000 7f20cd3ff700 1 -- 172.21.15.144:0/3989968429 wait complete. 2023-05-11T07:35:53.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:35:53.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:35:53.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.230+0000 7fc318bff700 1 Processor -- start 2023-05-11T07:35:53.233 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.230+0000 7fc318bff700 1 -- start start 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc318bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc31415c940 0x7fc314160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc318bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc3140b5fd0 0x7fc31406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc318bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3140d0e80 con 0x7fc3140b6420 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc318bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc314161420 con 0x7fc31415c940 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc318bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140cdb00 con 0x7fc3140b5fd0 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc31259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc31415c940 0x7fc314160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc31259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc31415c940 0x7fc314160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57774/0 (socket says 172.21.15.144:57774) 2023-05-11T07:35:53.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.231+0000 7fc31259c700 1 -- 172.21.15.144:0/2916750010 learned_addr learned my addr 172.21.15.144:0/2916750010 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc311d9b700 1 --2- 172.21.15.144:0/2916750010 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b5fd0 0x7fc31406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31259c700 1 -- 172.21.15.144:0/2916750010 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b5fd0 msgr2=0x7fc31406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31259c700 1 --2- 172.21.15.144:0/2916750010 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b5fd0 0x7fc31406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31259c700 1 -- 172.21.15.144:0/2916750010 >> v1:172.21.15.144:6789/0 conn(0x7fc3140b6420 legacy=0x7fc3140d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31259c700 1 -- 172.21.15.144:0/2916750010 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140cdde0 con 0x7fc31415c940 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31259c700 1 --2- 172.21.15.144:0/2916750010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31415c940 0x7fc314160ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3140d3e60 tx=0x7fc304009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b6cb1ececb1328 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31159a700 1 -- 172.21.15.144:0/2916750010 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304011830 con 0x7fc31415c940 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31159a700 1 -- 172.21.15.144:0/2916750010 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc304011990 con 0x7fc31415c940 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.232+0000 7fc31159a700 1 -- 172.21.15.144:0/2916750010 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304011d20 con 0x7fc31415c940 2023-05-11T07:35:53.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 -- 172.21.15.144:0/2916750010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31415c940 msgr2=0x7fc314160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 --2- 172.21.15.144:0/2916750010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31415c940 0x7fc314160ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3140d3e60 tx=0x7fc304009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 -- 172.21.15.144:0/2916750010 shutdown_connections 2023-05-11T07:35:53.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 --2- 172.21.15.144:0/2916750010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31415c940 0x7fc314160ee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 --2- 172.21.15.144:0/2916750010 >> v2:172.21.15.145:3300/0 conn(0x7fc3140b5fd0 0x7fc31406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 -- 172.21.15.144:0/2916750010 >> 172.21.15.144:0/2916750010 conn(0x7fc3140d3180 msgr2=0x7fc3140d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 -- 172.21.15.144:0/2916750010 shutdown_connections 2023-05-11T07:35:53.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.233+0000 7fc318bff700 1 -- 172.21.15.144:0/2916750010 wait complete. 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.235+0000 7fc318bff700 1 Processor -- start 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.235+0000 7fc318bff700 1 -- start start 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3140b6420 0x7fc3141f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 0x7fc3141502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314155ad0 con 0x7fc3140b5fd0 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141f3480 con 0x7fc3140b6420 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc318bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc314154e50 con 0x7fc31415c940 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57778/0 (socket says 172.21.15.144:57778) 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 -- 172.21.15.144:0/3344073875 learned_addr learned my addr 172.21.15.144:0/3344073875 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc311d9b700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3140b6420 0x7fc3141f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc312d9d700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 0x7fc3141502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 -- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 msgr2=0x7fc3141502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 0x7fc3141502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 -- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3140b6420 msgr2=0x7fc3141f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3140b6420 0x7fc3141f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc31259c700 1 -- 172.21.15.144:0/3344073875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009550 con 0x7fc3140b5fd0 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.236+0000 7fc312d9d700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 0x7fc3141502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc31259c700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc304000c00 tx=0x7fc304004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304004570 con 0x7fc3140b5fd0 2023-05-11T07:35:53.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30401f070 con 0x7fc3140b5fd0 2023-05-11T07:35:53.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040038e0 con 0x7fc3140b5fd0 2023-05-11T07:35:53.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3140d1400 con 0x7fc3140b5fd0 2023-05-11T07:35:53.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.237+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3140d1120 con 0x7fc3140b5fd0 2023-05-11T07:35:53.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.238+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31415cd10 con 0x7fc3140b5fd0 2023-05-11T07:35:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.239+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc304021030 con 0x7fc3140b5fd0 2023-05-11T07:35:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.240+0000 7fc302ffd700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 0x7fc2f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.240+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc30408ac10 con 0x7fc3140b5fd0 2023-05-11T07:35:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.240+0000 7fc311d9b700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 0x7fc2f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.241+0000 7fc311d9b700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 0x7fc2f406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc31415fae0 tx=0x7fc308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.244+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3040559c0 con 0x7fc3140b5fd0 2023-05-11T07:35:53.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.436+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3140744c0 con 0x7fc3140b5fd0 2023-05-11T07:35:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.436+0000 7fc302ffd700 1 -- 172.21.15.144:0/3344073875 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3040150a0 con 0x7fc3140b5fd0 2023-05-11T07:35:53.439 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:35:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.438+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 msgr2=0x7fc2f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.438+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 0x7fc2f406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc31415fae0 tx=0x7fc308008040 comp rx=0 tx=0).stop 2023-05-11T07:35:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.438+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 msgr2=0x7fc314154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.438+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc304000c00 tx=0x7fc304004750 comp rx=0 tx=0).stop 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 shutdown_connections 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc2f406ace0 0x7fc2f406d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc31415c940 0x7fc3141502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3140b5fd0 0x7fc314154870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 --2- 172.21.15.144:0/3344073875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3140b6420 0x7fc3141f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 >> 172.21.15.144:0/3344073875 conn(0x7fc3140d3180 msgr2=0x7fc3140b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 shutdown_connections 2023-05-11T07:35:53.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.439+0000 7fc318bff700 1 -- 172.21.15.144:0/3344073875 wait complete. 2023-05-11T07:35:53.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:35:53.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.655+0000 7f6fbddff700 1 Processor -- start 2023-05-11T07:35:53.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.655+0000 7f6fbddff700 1 -- start start 2023-05-11T07:35:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6fb815c940 0x7f6fb8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 0x7f6fb806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fb80b6420 0x7f6fb806b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb8161420 con 0x7f6fb80b6420 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80d0e80 con 0x7f6fb815c940 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.656+0000 7f6fbddff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80cdb00 con 0x7f6fb80b5fd0 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fb80b6420 0x7f6fb806b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fb80b6420 0x7f6fb806b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57788/0 (socket says 172.21.15.144:57788) 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 -- 172.21.15.144:0/1255439404 learned_addr learned my addr 172.21.15.144:0/1255439404 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb77fe700 1 --2- 172.21.15.144:0/1255439404 >> v2:172.21.15.145:3300/0 conn(0x7f6fb815c940 0x7f6fb8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6faffff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 0x7f6fb806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 -- 172.21.15.144:0/1255439404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 msgr2=0x7f6fb806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 0x7f6fb806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 -- 172.21.15.144:0/1255439404 >> v2:172.21.15.145:3300/0 conn(0x7f6fb815c940 msgr2=0x7f6fb8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 --2- 172.21.15.144:0/1255439404 >> v2:172.21.15.145:3300/0 conn(0x7f6fb815c940 0x7f6fb8160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 -- 172.21.15.144:0/1255439404 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80cdde0 con 0x7f6fb80b6420 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6faffff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 0x7f6fb806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb7fff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb806b180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80d0e50 tx=0x7f6fb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b8bf3eaf47f401 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.657+0000 7f6fb6ffd700 1 -- 172.21.15.144:0/1255439404 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000e070 con 0x7f6fb80b6420 2023-05-11T07:35:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fb6ffd700 1 -- 172.21.15.144:0/1255439404 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000b9c0 con 0x7f6fb80b6420 2023-05-11T07:35:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fb6ffd700 1 -- 172.21.15.144:0/1255439404 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000bd70 con 0x7f6fb80b6420 2023-05-11T07:35:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 -- 172.21.15.144:0/1255439404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 msgr2=0x7f6fb806b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb806b180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80d0e50 tx=0x7f6fb000b330 comp rx=0 tx=0).stop 2023-05-11T07:35:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 -- 172.21.15.144:0/1255439404 shutdown_connections 2023-05-11T07:35:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb806b180 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 --2- 172.21.15.144:0/1255439404 >> v2:172.21.15.145:3300/0 conn(0x7f6fb815c940 0x7f6fb8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 --2- 172.21.15.144:0/1255439404 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb80b5fd0 0x7f6fb806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 -- 172.21.15.144:0/1255439404 >> 172.21.15.144:0/1255439404 conn(0x7f6fb80d3180 msgr2=0x7f6fb80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 -- 172.21.15.144:0/1255439404 shutdown_connections 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.658+0000 7f6fbddff700 1 -- 172.21.15.144:0/1255439404 wait complete. 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.660+0000 7f6fbddff700 1 Processor -- start 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.660+0000 7f6fbddff700 1 -- start start 2023-05-11T07:35:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb80b5fd0 0x7f6fb81f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb815c940 0x7f6fb80b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81534e0 con 0x7f6fb80b6420 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80ccfb0 con 0x7f6fb80b5fd0 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fbddff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80b5ad0 con 0x7f6fb815c940 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6faffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6faffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57796/0 (socket says 172.21.15.144:57796) 2023-05-11T07:35:53.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6faffff700 1 -- 172.21.15.144:0/2194042502 learned_addr learned my addr 172.21.15.144:0/2194042502 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:53.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fb77fe700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb80b5fd0 0x7f6fb81f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.661+0000 7f6fb7fff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb815c940 0x7f6fb80b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 -- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb815c940 msgr2=0x7f6fb80b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb815c940 0x7f6fb80b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 -- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb80b5fd0 msgr2=0x7f6fb81f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb80b5fd0 0x7f6fb81f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 -- 172.21.15.144:0/2194042502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0009b30 con 0x7f6fb80b6420 2023-05-11T07:35:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6faffff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000d800 tx=0x7f6fa000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0004030 con 0x7f6fb80b6420 2023-05-11T07:35:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0004190 con 0x7f6fb80b6420 2023-05-11T07:35:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0004520 con 0x7f6fb80b6420 2023-05-11T07:35:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80d1400 con 0x7f6fb80b6420 2023-05-11T07:35:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.662+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb80d1120 con 0x7f6fb80b6420 2023-05-11T07:35:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.663+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb815cd10 con 0x7f6fb80b6420 2023-05-11T07:35:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.664+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fa00036a0 con 0x7f6fb80b6420 2023-05-11T07:35:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.665+0000 7f6fb4ff9700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 0x7f6f9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.665+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6fa0088f40 con 0x7f6fb80b6420 2023-05-11T07:35:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.665+0000 7f6fb77fe700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 0x7f6f9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.666+0000 7f6fb77fe700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 0x7f6f9806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb806b830 tx=0x7f6fa8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.669+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6fa0057830 con 0x7f6fb80b6420 2023-05-11T07:35:53.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.863+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6fb80744c0 con 0x7f6fb80b6420 2023-05-11T07:35:53.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.864+0000 7f6fb4ff9700 1 -- 172.21.15.144:0/2194042502 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6fa00190a0 con 0x7f6fb80b6420 2023-05-11T07:35:53.866 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:35:53.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 msgr2=0x7f6f9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 0x7f6f9806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb806b830 tx=0x7f6fa8008040 comp rx=0 tx=0).stop 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 msgr2=0x7f6fb8152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000d800 tx=0x7f6fa000db10 comp rx=0 tx=0).stop 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 shutdown_connections 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6f9806ace0 0x7f6f9806d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6fb815c940 0x7f6fb80b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb80b5fd0 0x7f6fb81f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 --2- 172.21.15.144:0/2194042502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fb80b6420 0x7f6fb8152fa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:53.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 >> 172.21.15.144:0/2194042502 conn(0x7f6fb80d3180 msgr2=0x7f6fb80d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:53.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 shutdown_connections 2023-05-11T07:35:53.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:53.866+0000 7f6fbddff700 1 -- 172.21.15.144:0/2194042502 wait complete. 2023-05-11T07:35:53.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:35:54.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.073+0000 7fc0697ff700 1 Processor -- start 2023-05-11T07:35:54.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.073+0000 7fc0697ff700 1 -- start start 2023-05-11T07:35:54.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0697ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0640cf880 0x7fc06415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0697ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc064161340 0x7fc06406a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0697ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640ceb70 con 0x7fc06415c960 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0697ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640af610 con 0x7fc064161340 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0697ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640af330 con 0x7fc0640cf880 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0637fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc064161340 0x7fc06406a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0637fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc064161340 0x7fc06406a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57800/0 (socket says 172.21.15.144:57800) 2023-05-11T07:35:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc0637fe700 1 -- 172.21.15.144:0/334461228 learned_addr learned my addr 172.21.15.144:0/334461228 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.074+0000 7fc05bfff700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0640cf880 0x7fc06415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0637fe700 1 -- 172.21.15.144:0/334461228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0640cf880 msgr2=0x7fc06415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0637fe700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0640cf880 0x7fc06415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0637fe700 1 -- 172.21.15.144:0/334461228 >> v1:172.21.15.145:6789/0 conn(0x7fc06415c960 legacy=0x7fc0640aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0637fe700 1 -- 172.21.15.144:0/334461228 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640ceda0 con 0x7fc064161340 2023-05-11T07:35:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0637fe700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc064161340 0x7fc06406a2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e50 tx=0x7fc05c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bc70f9f44aee11 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0627fc700 1 -- 172.21.15.144:0/334461228 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc064161340 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0627fc700 1 -- 172.21.15.144:0/334461228 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00b910 con 0x7fc064161340 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.075+0000 7fc0627fc700 1 -- 172.21.15.144:0/334461228 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00bcc0 con 0x7fc064161340 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 -- 172.21.15.144:0/334461228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc064161340 msgr2=0x7fc06406a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc064161340 0x7fc06406a2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009e50 tx=0x7fc05c00b330 comp rx=0 tx=0).stop 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 -- 172.21.15.144:0/334461228 shutdown_connections 2023-05-11T07:35:54.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc064161340 0x7fc06406a2d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 --2- 172.21.15.144:0/334461228 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc0640cf880 0x7fc06415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 -- 172.21.15.144:0/334461228 >> 172.21.15.144:0/334461228 conn(0x7fc0640cc830 msgr2=0x7fc0640ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 -- 172.21.15.144:0/334461228 shutdown_connections 2023-05-11T07:35:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.076+0000 7fc0697ff700 1 -- 172.21.15.144:0/334461228 wait complete. 2023-05-11T07:35:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.077+0000 7fc0697ff700 1 Processor -- start 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.078+0000 7fc0697ff700 1 -- start start 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.078+0000 7fc0697ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.078+0000 7fc0697ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 0x7fc0640b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.078+0000 7fc0697ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 0x7fc06406db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.078+0000 7fc0697ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640b13e0 con 0x7fc0640cf880 2023-05-11T07:35:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc0697ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415d6f0 con 0x7fc064161340 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc0697ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415d990 con 0x7fc06415c960 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57812/0 (socket says 172.21.15.144:57812) 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 -- 172.21.15.144:0/3030216543 learned_addr learned my addr 172.21.15.144:0/3030216543 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc0637fe700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 0x7fc06406db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc05bfff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 0x7fc0640b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 -- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 msgr2=0x7fc0640b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 0x7fc0640b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 -- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 msgr2=0x7fc06406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 0x7fc06406db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 -- 172.21.15.144:0/3030216543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009b30 con 0x7fc0640cf880 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc0637fe700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 0x7fc06406db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc05bfff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 0x7fc0640b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.079+0000 7fc062ffd700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c4e0 tx=0x7fc05400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.080+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540052d0 con 0x7fc0640cf880 2023-05-11T07:35:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.080+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054005430 con 0x7fc0640cf880 2023-05-11T07:35:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.080+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640cf360 con 0x7fc0640cf880 2023-05-11T07:35:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.080+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540038c0 con 0x7fc0640cf880 2023-05-11T07:35:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.080+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640cf080 con 0x7fc0640cf880 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.081+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06406a810 con 0x7fc0640cf880 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.082+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc054003a20 con 0x7fc0640cf880 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.082+0000 7fc05b7fe700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 0x7fc04406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.083+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc054088ca0 con 0x7fc0640cf880 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.083+0000 7fc05bfff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 0x7fc04406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.083+0000 7fc05bfff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 0x7fc04406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc064071c40 tx=0x7fc04c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.087+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc054053a50 con 0x7fc0640cf880 2023-05-11T07:35:54.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.279+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0640711c0 con 0x7fc0640cf880 2023-05-11T07:35:54.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.279+0000 7fc05b7fe700 1 -- 172.21.15.144:0/3030216543 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc054057070 con 0x7fc0640cf880 2023-05-11T07:35:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:35:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 msgr2=0x7fc04406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 0x7fc04406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc064071c40 tx=0x7fc04c008040 comp rx=0 tx=0).stop 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 msgr2=0x7fc064157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c4e0 tx=0x7fc05400c8a0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 shutdown_connections 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc04406ace0 0x7fc04406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064161340 0x7fc06406db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0640cf880 0x7fc064157b80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 --2- 172.21.15.144:0/3030216543 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc06415c960 0x7fc0640b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 >> 172.21.15.144:0/3030216543 conn(0x7fc0640cc830 msgr2=0x7fc064159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 shutdown_connections 2023-05-11T07:35:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.282+0000 7fc0697ff700 1 -- 172.21.15.144:0/3030216543 wait complete. 2023-05-11T07:35:54.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:35:54.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.486+0000 7f705ddff700 1 Processor -- start 2023-05-11T07:35:54.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.486+0000 7f705ddff700 1 -- start start 2023-05-11T07:35:54.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.487+0000 7f705ddff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7058160ee0 0x7f705806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.487+0000 7f705ddff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f705806b180 0x7f70580d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.487+0000 7f705ddff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70580d0e80 con 0x7f705815c940 2023-05-11T07:35:54.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.487+0000 7f705ddff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705806b600 con 0x7f705806b180 2023-05-11T07:35:54.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.487+0000 7f705ddff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70580cdb00 con 0x7f7058160ee0 2023-05-11T07:35:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f705806b180 0x7f70580d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7056ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7058160ee0 0x7f705806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f705806b180 0x7f70580d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:37280/0 (socket says 172.21.15.144:37280) 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 -- 172.21.15.144:0/1072020282 learned_addr learned my addr 172.21.15.144:0/1072020282 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 -- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7058160ee0 msgr2=0x7f705806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 --2- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7058160ee0 0x7f705806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 -- 172.21.15.144:0/1072020282 >> v1:172.21.15.145:6789/0 conn(0x7f705815c940 legacy=0x7f70580b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f7057fff700 1 -- 172.21.15.144:0/1072020282 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580cdde0 con 0x7f705806b180 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.488+0000 7f70567fc700 1 -- 172.21.15.144:0/1072020282 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735514688 0 0) 0x7f70580d0e80 con 0x7f705815c940 2023-05-11T07:35:54.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f7057fff700 1 --2- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70580d1920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7050009e50 tx=0x7f705000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392a4bd6ab09af16 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f70567fc700 1 -- 172.21.15.144:0/1072020282 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000e070 con 0x7f705806b180 2023-05-11T07:35:54.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f70567fc700 1 -- 172.21.15.144:0/1072020282 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000b910 con 0x7f705806b180 2023-05-11T07:35:54.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f70567fc700 1 -- 172.21.15.144:0/1072020282 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000bcc0 con 0x7f705806b180 2023-05-11T07:35:54.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f705ddff700 1 -- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 msgr2=0x7f70580d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f705ddff700 1 --2- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70580d1920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7050009e50 tx=0x7f705000b330 comp rx=0 tx=0).stop 2023-05-11T07:35:54.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f705ddff700 1 -- 172.21.15.144:0/1072020282 shutdown_connections 2023-05-11T07:35:54.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f705ddff700 1 --2- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70580d1920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.489+0000 7f705ddff700 1 --2- 172.21.15.144:0/1072020282 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7058160ee0 0x7f705806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.490+0000 7f705ddff700 1 -- 172.21.15.144:0/1072020282 >> 172.21.15.144:0/1072020282 conn(0x7f70580d3180 msgr2=0x7f70580d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:54.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.490+0000 7f705ddff700 1 -- 172.21.15.144:0/1072020282 shutdown_connections 2023-05-11T07:35:54.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.490+0000 7f705ddff700 1 -- 172.21.15.144:0/1072020282 wait complete. 2023-05-11T07:35:54.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.491+0000 7f705ddff700 1 Processor -- start 2023-05-11T07:35:54.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.491+0000 7f705ddff700 1 -- start start 2023-05-11T07:35:54.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.492+0000 7f705ddff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.492+0000 7f705ddff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f705815c940 0x7f70581584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.492+0000 7f705ddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 0x7f7058158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f705ddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705815f9d0 con 0x7f7058160ee0 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f705ddff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70581f3660 con 0x7f705806b180 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f705ddff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705815edc0 con 0x7f705815c940 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f7057fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 0x7f7058158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f7056ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f705815c940 0x7f70581584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:37290/0 (socket says 172.21.15.144:37290) 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 -- 172.21.15.144:0/2676066447 learned_addr learned my addr 172.21.15.144:0/2676066447 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 -- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f705815c940 msgr2=0x7f70581584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f705815c940 0x7f70581584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 -- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 msgr2=0x7f7058158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 0x7f7058158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f70577fe700 1 -- 172.21.15.144:0/2676066447 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009b30 con 0x7f705806b180 2023-05-11T07:35:54.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.493+0000 7f7057fff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 0x7f7058158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:54.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.494+0000 7f70577fe700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70480011e0 tx=0x7f704800ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.496+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480054e0 con 0x7f705806b180 2023-05-11T07:35:54.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.496+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048003680 con 0x7f705806b180 2023-05-11T07:35:54.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.496+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70580d1400 con 0x7f705806b180 2023-05-11T07:35:54.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.496+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048003a30 con 0x7f705806b180 2023-05-11T07:35:54.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.496+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70580d1120 con 0x7f705806b180 2023-05-11T07:35:54.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.498+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70580b66e0 con 0x7f705806b180 2023-05-11T07:35:54.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.499+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7048003b90 con 0x7f705806b180 2023-05-11T07:35:54.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.500+0000 7f703ffff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 0x7f704406d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.500+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7048088bf0 con 0x7f705806b180 2023-05-11T07:35:54.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.500+0000 7f7056ffd700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 0x7f704406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.500+0000 7f7056ffd700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 0x7f704406d210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f705806bc00 tx=0x7f704c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.506+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7048053990 con 0x7f705806b180 2023-05-11T07:35:54.701 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.698+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f705815fb40 con 0x7f705806b180 2023-05-11T07:35:54.701 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.699+0000 7f703ffff700 1 -- 172.21.15.144:0/2676066447 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7048017020 con 0x7f705806b180 2023-05-11T07:35:54.702 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:35:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 msgr2=0x7f704406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 0x7f704406d210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f705806bc00 tx=0x7f704c009210 comp rx=0 tx=0).stop 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 msgr2=0x7f70581f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70480011e0 tx=0x7f704800ca30 comp rx=0 tx=0).stop 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 shutdown_connections 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f704406ad60 0x7f704406d210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7058160ee0 0x7f7058158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.705 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f705806b180 0x7f70581f50a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 --2- 172.21.15.144:0/2676066447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f705815c940 0x7f70581584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 >> 172.21.15.144:0/2676066447 conn(0x7f70580d3180 msgr2=0x7f70580b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 shutdown_connections 2023-05-11T07:35:54.706 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.702+0000 7f705ddff700 1 -- 172.21.15.144:0/2676066447 wait complete. 2023-05-11T07:35:54.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:35:54.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.906+0000 7f854d5ff700 1 Processor -- start 2023-05-11T07:35:54.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.906+0000 7f854d5ff700 1 -- start start 2023-05-11T07:35:54.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f854d5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8548160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f854d5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f854806b350 0x7f85480d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f854d5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480d0e80 con 0x7f85480b5fd0 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f854d5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8548161420 con 0x7f854806b350 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f854d5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85480cdb00 con 0x7f854815c940 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f853ffff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f85480b5fd0 0x7f854806ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37936/0 (socket says 172.21.15.144:37936) 2023-05-11T07:35:54.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.907+0000 7f853ffff700 1 -- 172.21.15.144:0/1285762679 learned_addr learned my addr 172.21.15.144:0/1285762679 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:54.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85477fe700 1 --2- 172.21.15.144:0/1285762679 >> v2:172.21.15.145:3300/0 conn(0x7f854806b350 0x7f85480d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f8546ffd700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8548160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459476185 0 0) 0x7f85480d0e80 con 0x7f85480b5fd0 2023-05-11T07:35:54.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85340035b0 con 0x7f85480b5fd0 2023-05-11T07:35:54.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762194878 0 0) 0x7f85340035b0 con 0x7f85480b5fd0 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 msgr2=0x7f8548160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8548160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 >> v2:172.21.15.145:3300/0 conn(0x7f854806b350 msgr2=0x7f85480d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 --2- 172.21.15.144:0/1285762679 >> v2:172.21.15.145:3300/0 conn(0x7f854806b350 0x7f85480d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480cdde0 con 0x7f85480b5fd0 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f8530001670 con 0x7f85480b5fd0 2023-05-11T07:35:54.914 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 >> v1:172.21.15.144:6789/0 conn(0x7f85480b5fd0 legacy=0x7f854806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8534003a00 0x7f8534003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8534004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8534004d90 0x7f8534005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548161420 con 0x7f8534004d90 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480cdb00 con 0x7f8534003a00 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.908+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853400ba10 con 0x7f854815c940 2023-05-11T07:35:54.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8534003a00 0x7f8534003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f853ffff700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8534004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f85477fe700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8534004d90 0x7f8534005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 -- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 msgr2=0x7f8534004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f854815c940 0x7f8534004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 -- 172.21.15.144:0/1285762679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8534004d90 msgr2=0x7f8534005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8534004d90 0x7f8534005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 -- 172.21.15.144:0/1285762679 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340035b0 con 0x7f8534003a00 2023-05-11T07:35:54.916 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f85477fe700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8534004d90 0x7f8534005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f8546ffd700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8534003a00 0x7f8534003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8538009b60 tx=0x7f8534005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9946e87597ab957 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.909+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800e660 con 0x7f8534003a00 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800e7c0 con 0x7f8534003a00 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f85467fc700 1 -- 172.21.15.144:0/1285762679 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800eb30 con 0x7f8534003a00 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 -- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8534003a00 msgr2=0x7f8534003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 --2- 172.21.15.144:0/1285762679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8534003a00 0x7f8534003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8538009b60 tx=0x7f8534005880 comp rx=0 tx=0).stop 2023-05-11T07:35:54.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f85477fe700 1 -- 172.21.15.144:0/1285762679 reap_dead start 2023-05-11T07:35:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 -- 172.21.15.144:0/1285762679 shutdown_connections 2023-05-11T07:35:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 -- 172.21.15.144:0/1285762679 >> 172.21.15.144:0/1285762679 conn(0x7f85480d3180 msgr2=0x7f85480d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 -- 172.21.15.144:0/1285762679 shutdown_connections 2023-05-11T07:35:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.910+0000 7f854d5ff700 1 -- 172.21.15.144:0/1285762679 wait complete. 2023-05-11T07:35:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.912+0000 7f854d5ff700 1 Processor -- start 2023-05-11T07:35:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.912+0000 7f854d5ff700 1 -- start start 2023-05-11T07:35:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8534003a00 0x7f854814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8548152280 0x7f85480d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854814db50 con 0x7f85480cc1d0 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854814f1a0 con 0x7f8548152280 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f854d5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854814f480 con 0x7f8534003a00 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57830/0 (socket says 172.21.15.144:57830) 2023-05-11T07:35:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 -- 172.21.15.144:0/3814126086 learned_addr learned my addr 172.21.15.144:0/3814126086 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f85477fe700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8548152280 0x7f85480d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f8546ffd700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8534003a00 0x7f854814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 -- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8534003a00 msgr2=0x7f854814d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8534003a00 0x7f854814d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 -- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8548152280 msgr2=0x7f85480d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.913+0000 7f853ffff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8548152280 0x7f85480d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f853ffff700 1 -- 172.21.15.144:0/3814126086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480d1400 con 0x7f85480cc1d0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f853ffff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8530007310 tx=0x7f8530007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000f5e0 con 0x7f85480cc1d0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000f7a0 con 0x7f85480cc1d0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000fb50 con 0x7f85480cc1d0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85480d1120 con 0x7f85480cc1d0 2023-05-11T07:35:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.914+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854815cd10 con 0x7f85480cc1d0 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.915+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85480744c0 con 0x7f85480cc1d0 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.916+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f853000fcb0 con 0x7f85480cc1d0 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.917+0000 7f853f7fe700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 0x7f852806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.917+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85300896c0 con 0x7f85480cc1d0 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.917+0000 7f8546ffd700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 0x7f852806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.918+0000 7f8546ffd700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 0x7f852806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85380090b0 tx=0x7f8538008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:54.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:54.921+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8530054490 con 0x7f85480cc1d0 2023-05-11T07:35:55.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.118+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f854806cf30 con 0x7f85480cc1d0 2023-05-11T07:35:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.118+0000 7f853f7fe700 1 -- 172.21.15.144:0/3814126086 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8530057ab0 con 0x7f85480cc1d0 2023-05-11T07:35:55.121 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:35:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 msgr2=0x7f852806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 0x7f852806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85380090b0 tx=0x7f8538008030 comp rx=0 tx=0).stop 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 msgr2=0x7f8548151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8530007310 tx=0x7f8530007620 comp rx=0 tx=0).stop 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 shutdown_connections 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f852806ace0 0x7f852806d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8534003a00 0x7f854814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8548152280 0x7f85480d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 --2- 172.21.15.144:0/3814126086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85480cc1d0 0x7f8548151d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 >> 172.21.15.144:0/3814126086 conn(0x7f85480d3180 msgr2=0x7f854815cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 shutdown_connections 2023-05-11T07:35:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.121+0000 7f854d5ff700 1 -- 172.21.15.144:0/3814126086 wait complete. 2023-05-11T07:35:55.141 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:35:55.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.323+0000 7f41f2bff700 1 Processor -- start 2023-05-11T07:35:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.323+0000 7f41f2bff700 1 -- start start 2023-05-11T07:35:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f2bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec15c940 0x7f41ec160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f2bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41ec0b5fd0 0x7f41ec06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f2bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec0d0e80 con 0x7f41ec0b6420 2023-05-11T07:35:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f2bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec161420 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f2bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec0cdb00 con 0x7f41ec15c940 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41ebfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41ec0b5fd0 0x7f41ec06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41ebfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41ec0b5fd0 0x7f41ec06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57844/0 (socket says 172.21.15.144:57844) 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f119c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f41ec0b6420 0x7f41ec0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37946/0 (socket says 172.21.15.144:37946) 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41ebfff700 1 -- 172.21.15.144:0/652480606 learned_addr learned my addr 172.21.15.144:0/652480606 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.324+0000 7f41f099b700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec15c940 0x7f41ec160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41ebfff700 1 -- 172.21.15.144:0/652480606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec15c940 msgr2=0x7f41ec160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41ebfff700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec15c940 0x7f41ec160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41ebfff700 1 -- 172.21.15.144:0/652480606 >> v1:172.21.15.144:6789/0 conn(0x7f41ec0b6420 legacy=0x7f41ec0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41ebfff700 1 -- 172.21.15.144:0/652480606 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec0cdde0 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41ebfff700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec06ac40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41d80098f0 tx=0x7f41d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45915f898023fb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41eb7fe700 1 -- 172.21.15.144:0/652480606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8011830 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41eb7fe700 1 -- 172.21.15.144:0/652480606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8011990 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.325+0000 7f41eb7fe700 1 -- 172.21.15.144:0/652480606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8011d20 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 -- 172.21.15.144:0/652480606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec0b5fd0 msgr2=0x7f41ec06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec06ac40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41d80098f0 tx=0x7f41d8009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 -- 172.21.15.144:0/652480606 shutdown_connections 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec15c940 0x7f41ec160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 --2- 172.21.15.144:0/652480606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec06ac40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 -- 172.21.15.144:0/652480606 >> 172.21.15.144:0/652480606 conn(0x7f41ec0d3180 msgr2=0x7f41ec0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 -- 172.21.15.144:0/652480606 shutdown_connections 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.326+0000 7f41f2bff700 1 -- 172.21.15.144:0/652480606 wait complete. 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.327+0000 7f41f2bff700 1 Processor -- start 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.328+0000 7f41f2bff700 1 -- start start 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 0x7f41ec0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec14ea80 con 0x7f41ec15c940 2023-05-11T07:35:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec15c1e0 con 0x7f41ec0b5fd0 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f2bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec14de00 con 0x7f41ec0b6420 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57858/0 (socket says 172.21.15.144:57858) 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 -- 172.21.15.144:0/2172029147 learned_addr learned my addr 172.21.15.144:0/2172029147 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f099b700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41ebfff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 0x7f41ec0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 -- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 msgr2=0x7f41ec0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 0x7f41ec0cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 -- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41ec0b5fd0 msgr2=0x7f41ec15bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec15bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41f119c700 1 -- 172.21.15.144:0/2172029147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009550 con 0x7f41ec15c940 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.329+0000 7f41ebfff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 0x7f41ec0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41f119c700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41e400cbd0 tx=0x7f41e400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400ab00 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400ac60 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4007070 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec0d1400 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.330+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec0d1120 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.331+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec15cd10 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.332+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41e40071d0 con 0x7f41ec15c940 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.333+0000 7f41e97fa700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 0x7f41d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.333+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41e40894e0 con 0x7f41ec15c940 2023-05-11T07:35:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.333+0000 7f41f099b700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 0x7f41d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.334+0000 7f41f099b700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 0x7f41d006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41ec1f5ce0 tx=0x7f41e0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.337+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f41e40542b0 con 0x7f41ec15c940 2023-05-11T07:35:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.550+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41ec14ebc0 con 0x7f41ec15c940 2023-05-11T07:35:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.551+0000 7f41e97fa700 1 -- 172.21.15.144:0/2172029147 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41ec14ebc0 con 0x7f41ec15c940 2023-05-11T07:35:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 msgr2=0x7f41d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 0x7f41d006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41ec1f5ce0 tx=0x7f41e0009210 comp rx=0 tx=0).stop 2023-05-11T07:35:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 msgr2=0x7f41ec154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41e400cbd0 tx=0x7f41e400cee0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 shutdown_connections 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f41d006ace0 0x7f41d006d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41ec15c940 0x7f41ec154f70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41ec0b5fd0 0x7f41ec15bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 --2- 172.21.15.144:0/2172029147 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f41ec0b6420 0x7f41ec0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 >> 172.21.15.144:0/2172029147 conn(0x7f41ec0d3180 msgr2=0x7f41ec15f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 shutdown_connections 2023-05-11T07:35:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.553+0000 7f41f2bff700 1 -- 172.21.15.144:0/2172029147 wait complete. 2023-05-11T07:35:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:35:55.573 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:35:55.573 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:35:55.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:35:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.837+0000 7f12999ff700 1 Processor -- start 2023-05-11T07:35:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.837+0000 7f12999ff700 1 -- start start 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f12999ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f12940b87e0 0x7f12940b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f12999ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12940d02c0 0x7f12940b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f12999ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129415cef0 con 0x7f12940d2090 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f12999ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940b5a80 con 0x7f12940d02c0 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f12999ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940cdf70 con 0x7f12940b87e0 2023-05-11T07:35:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12940d02c0 0x7f12940b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12940d02c0 0x7f12940b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57860/0 (socket says 172.21.15.144:57860) 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 -- 172.21.15.144:0/2315954501 learned_addr learned my addr 172.21.15.144:0/2315954501 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f1292ffd700 1 --2- 172.21.15.144:0/2315954501 >> v2:172.21.15.145:3300/0 conn(0x7f12940b87e0 0x7f12940b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 -- 172.21.15.144:0/2315954501 >> v2:172.21.15.145:3300/0 conn(0x7f12940b87e0 msgr2=0x7f12940b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 --2- 172.21.15.144:0/2315954501 >> v2:172.21.15.145:3300/0 conn(0x7f12940b87e0 0x7f12940b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 -- 172.21.15.144:0/2315954501 >> v1:172.21.15.145:6789/0 conn(0x7f12940d2090 legacy=0x7f12940d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:55.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.839+0000 7f128bfff700 1 -- 172.21.15.144:0/2315954501 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940cd760 con 0x7f12940d02c0 2023-05-11T07:35:55.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f128bfff700 1 --2- 172.21.15.144:0/2315954501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d02c0 0x7f12940b50d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12940b5cb0 tx=0x7f127c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f88f767d432701f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f12927fc700 1 -- 172.21.15.144:0/2315954501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c00b870 con 0x7f12940d02c0 2023-05-11T07:35:55.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f12927fc700 1 -- 172.21.15.144:0/2315954501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c00b9d0 con 0x7f12940d02c0 2023-05-11T07:35:55.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f12927fc700 1 -- 172.21.15.144:0/2315954501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c00bd60 con 0x7f12940d02c0 2023-05-11T07:35:55.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f12999ff700 1 -- 172.21.15.144:0/2315954501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d02c0 msgr2=0x7f12940b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.840+0000 7f12999ff700 1 --2- 172.21.15.144:0/2315954501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d02c0 0x7f12940b50d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12940b5cb0 tx=0x7f127c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 -- 172.21.15.144:0/2315954501 shutdown_connections 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 --2- 172.21.15.144:0/2315954501 >> v2:172.21.15.145:3300/0 conn(0x7f12940b87e0 0x7f12940b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 --2- 172.21.15.144:0/2315954501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d02c0 0x7f12940b50d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 -- 172.21.15.144:0/2315954501 >> 172.21.15.144:0/2315954501 conn(0x7f129406acf0 msgr2=0x7f129406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 -- 172.21.15.144:0/2315954501 shutdown_connections 2023-05-11T07:35:55.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.841+0000 7f12999ff700 1 -- 172.21.15.144:0/2315954501 wait complete. 2023-05-11T07:35:55.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.842+0000 7f12999ff700 1 Processor -- start 2023-05-11T07:35:55.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.842+0000 7f12999ff700 1 -- start start 2023-05-11T07:35:55.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 0x7f1294144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 0x7f12940c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c6a50 con 0x7f12940d2090 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c7420 con 0x7f12940b87e0 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.843+0000 7f12999ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940cc6a0 con 0x7f12940d02c0 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57862/0 (socket says 172.21.15.144:57862) 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 -- 172.21.15.144:0/1776950917 learned_addr learned my addr 172.21.15.144:0/1776950917 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f1292ffd700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 0x7f1294144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f128bfff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 0x7f12940c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 -- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 msgr2=0x7f12940c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 0x7f12940c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 -- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 msgr2=0x7f1294144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:55.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 0x7f1294144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 -- 172.21.15.144:0/1776950917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c009550 con 0x7f12940d2090 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f1292ffd700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 0x7f1294144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f128bfff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 0x7f12940c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f12937fe700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f128c00cb80 tx=0x7f128c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.844+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c003c00 con 0x7f12940d2090 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.845+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c003d60 con 0x7f12940d2090 2023-05-11T07:35:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.845+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12940cd9b0 con 0x7f12940d2090 2023-05-11T07:35:55.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.845+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00abb0 con 0x7f12940d2090 2023-05-11T07:35:55.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.845+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12940d2d30 con 0x7f12940d2090 2023-05-11T07:35:55.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.846+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12940cdc90 con 0x7f12940d2090 2023-05-11T07:35:55.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.847+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f128c00ad10 con 0x7f12940d2090 2023-05-11T07:35:55.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.848+0000 7f1290ff9700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 0x7f127406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:55.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.848+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f128c0896a0 con 0x7f12940d2090 2023-05-11T07:35:55.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.848+0000 7f1292ffd700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 0x7f127406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:55.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.848+0000 7f1292ffd700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 0x7f127406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1284009a00 tx=0x7f1284008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:55.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:55.852+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f128c0543c0 con 0x7f12940d2090 2023-05-11T07:35:56.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.052+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f129415cef0 con 0x7f12940d2090 2023-05-11T07:35:56.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.054+0000 7f1290ff9700 1 -- 172.21.15.144:0/1776950917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f129415cef0 con 0x7f12940d2090 2023-05-11T07:35:56.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:35:56.057 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:35:56.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 msgr2=0x7f127406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 0x7f127406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1284009a00 tx=0x7f1284008040 comp rx=0 tx=0).stop 2023-05-11T07:35:56.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 msgr2=0x7f12941f1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f128c00cb80 tx=0x7f128c00cf40 comp rx=0 tx=0).stop 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 shutdown_connections 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f127406ace0 0x7f127406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12940d2090 0x7f12941f1ca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12940b87e0 0x7f1294144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 --2- 172.21.15.144:0/1776950917 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f12940d02c0 0x7f12940c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.056+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 >> 172.21.15.144:0/1776950917 conn(0x7f129406acf0 msgr2=0x7f129415c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:56.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.057+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 shutdown_connections 2023-05-11T07:35:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.057+0000 7f12999ff700 1 -- 172.21.15.144:0/1776950917 wait complete. 2023-05-11T07:35:56.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:35:56.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:35:56.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.261+0000 7fa0befff700 1 Processor -- start 2023-05-11T07:35:56.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.261+0000 7fa0befff700 1 -- start start 2023-05-11T07:35:56.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.262+0000 7fa0befff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0b80d14c0 0x7fa0b8167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.262+0000 7fa0befff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80cf640 con 0x7fa0b80cfe00 2023-05-11T07:35:56.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.262+0000 7fa0befff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b815cd00 con 0x7fa0b815c930 2023-05-11T07:35:56.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.262+0000 7fa0befff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80cd940 con 0x7fa0b80d14c0 2023-05-11T07:35:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.262+0000 7fa0bd59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0b80d14c0 0x7fa0b8167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b7fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa0b80cfe00 0x7fa0b80d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48966/0 (socket says 172.21.15.144:48966) 2023-05-11T07:35:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bd59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0b80d14c0 0x7fa0b8167840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60770/0 (socket says 172.21.15.144:60770) 2023-05-11T07:35:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b7fff700 1 -- 172.21.15.144:0/1482838660 learned_addr learned my addr 172.21.15.144:0/1482838660 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:56.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bcd9b700 1 --1- 172.21.15.144:0/1482838660 >> v1:172.21.15.145:6789/0 conn(0x7fa0b815c930 0x7fa0b815d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:46146/0 (socket says 172.21.15.144:46146) 2023-05-11T07:35:56.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bd59c700 1 -- 172.21.15.144:0/1482838660 >> v1:172.21.15.145:6789/0 conn(0x7fa0b815c930 legacy=0x7fa0b815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b77fe700 1 -- 172.21.15.144:0/1482838660 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096155220 0 0) 0x7fa0b815cd00 con 0x7fa0b815c930 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bd59c700 1 -- 172.21.15.144:0/1482838660 >> v1:172.21.15.144:6789/0 conn(0x7fa0b80cfe00 legacy=0x7fa0b80d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bd59c700 1 -- 172.21.15.144:0/1482838660 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80cdc20 con 0x7fa0b80d14c0 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0bd59c700 1 --2- 172.21.15.144:0/1482838660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b8167840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009dc0 tx=0x7fa0b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc8e45468e99e21 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b77fe700 1 -- 172.21.15.144:0/1482838660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000e070 con 0x7fa0b80d14c0 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b77fe700 1 -- 172.21.15.144:0/1482838660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000bb90 con 0x7fa0b80d14c0 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.263+0000 7fa0b77fe700 1 -- 172.21.15.144:0/1482838660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0012430 con 0x7fa0b80d14c0 2023-05-11T07:35:56.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 -- 172.21.15.144:0/1482838660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 msgr2=0x7fa0b8167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 --2- 172.21.15.144:0/1482838660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b8167840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009dc0 tx=0x7fa0b000b330 comp rx=0 tx=0).stop 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 -- 172.21.15.144:0/1482838660 shutdown_connections 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 --2- 172.21.15.144:0/1482838660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b8167840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 -- 172.21.15.144:0/1482838660 >> 172.21.15.144:0/1482838660 conn(0x7fa0b8072650 msgr2=0x7fa0b806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 -- 172.21.15.144:0/1482838660 shutdown_connections 2023-05-11T07:35:56.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.264+0000 7fa0befff700 1 -- 172.21.15.144:0/1482838660 wait complete. 2023-05-11T07:35:56.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.266+0000 7fa0befff700 1 Processor -- start 2023-05-11T07:35:56.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.266+0000 7fa0befff700 1 -- start start 2023-05-11T07:35:56.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 0x7fa0b81f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 0x7fa0b81f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80b2b10 con 0x7fa0b80d14c0 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80c94b0 con 0x7fa0b815c930 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0befff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80c9790 con 0x7fa0b80c9020 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60772/0 (socket says 172.21.15.144:60772) 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 -- 172.21.15.144:0/1877065684 learned_addr learned my addr 172.21.15.144:0/1877065684 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:56.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0b7fff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 0x7fa0b81f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bd59c700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 0x7fa0b81f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 -- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 msgr2=0x7fa0b81f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 0x7fa0b81f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 -- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 msgr2=0x7fa0b81f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 0x7fa0b81f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bcd9b700 1 -- 172.21.15.144:0/1877065684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0009a70 con 0x7fa0b80d14c0 2023-05-11T07:35:56.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0b7fff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 0x7fa0b81f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.267+0000 7fa0bd59c700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 0x7fa0b81f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0bcd9b700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c550 tx=0x7fa0ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac004c80 con 0x7fa0b80d14c0 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac004e00 con 0x7fa0b80d14c0 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b80cdf00 con 0x7fa0b80d14c0 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac007310 con 0x7fa0b80d14c0 2023-05-11T07:35:56.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.268+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b80cf8e0 con 0x7fa0b80d14c0 2023-05-11T07:35:56.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.269+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80ce090 con 0x7fa0b80d14c0 2023-05-11T07:35:56.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.270+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0ac007470 con 0x7fa0b80d14c0 2023-05-11T07:35:56.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.272+0000 7fa0b57fa700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 0x7fa09c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.272+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0ac089420 con 0x7fa0b80d14c0 2023-05-11T07:35:56.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.272+0000 7fa0b7fff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 0x7fa09c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.272+0000 7fa0b7fff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 0x7fa09c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0b814a510 tx=0x7fa0a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.276+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa0ac054270 con 0x7fa0b80d14c0 2023-05-11T07:35:56.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.467+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0b80ce280 con 0x7fa0b80d14c0 2023-05-11T07:35:56.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.467+0000 7fa0b57fa700 1 -- 172.21.15.144:0/1877065684 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0ac057890 con 0x7fa0b80d14c0 2023-05-11T07:35:56.470 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:35:56.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.469+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 msgr2=0x7fa09c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.469+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 0x7fa09c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0b814a510 tx=0x7fa0a4009040 comp rx=0 tx=0).stop 2023-05-11T07:35:56.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.469+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 msgr2=0x7fa0b80c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.469+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c550 tx=0x7fa0ac00c910 comp rx=0 tx=0).stop 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 shutdown_connections 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa09c06ace0 0x7fa09c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0b80c9020 0x7fa0b81f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b80d14c0 0x7fa0b80c8ae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 --2- 172.21.15.144:0/1877065684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0b815c930 0x7fa0b81f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 >> 172.21.15.144:0/1877065684 conn(0x7fa0b80cfe00 msgr2=0x7fa0b80b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:56.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 shutdown_connections 2023-05-11T07:35:56.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.470+0000 7fa0befff700 1 -- 172.21.15.144:0/1877065684 wait complete. 2023-05-11T07:35:56.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:35:56.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.674+0000 7f5e94dff700 1 Processor -- start 2023-05-11T07:35:56.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.675+0000 7f5e94dff700 1 -- start start 2023-05-11T07:35:56.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e94dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e9006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e94dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900d0e80 con 0x7f5e9006b180 2023-05-11T07:35:56.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e94dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900cdb00 con 0x7f5e9015c940 2023-05-11T07:35:56.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e94dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9006b600 con 0x7f5e90160ee0 2023-05-11T07:35:56.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e8ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5e9006b180 0x7f5e900d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48970/0 (socket says 172.21.15.144:48970) 2023-05-11T07:35:56.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e8ed9d700 1 -- 172.21.15.144:0/3894532861 learned_addr learned my addr 172.21.15.144:0/3894532861 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:35:56.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e87fff700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e9006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756514343 0 0) 0x7f5e900d0e80 con 0x7f5e9006b180 2023-05-11T07:35:56.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.676+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e7c0035b0 con 0x7f5e9006b180 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827484378 0 0) 0x7f5e900cdb00 con 0x7f5e9015c940 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e900d0e80 con 0x7f5e9015c940 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283361059 0 0) 0x7f5e7c0035b0 con 0x7f5e9006b180 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 msgr2=0x7f5e9006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e9006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 >> v1:172.21.15.145:6789/0 conn(0x7f5e9015c940 legacy=0x7f5e900b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900cdde0 con 0x7f5e9006b180 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f5e880019f0 con 0x7f5e9006b180 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 >> v1:172.21.15.144:6789/0 conn(0x7f5e9006b180 legacy=0x7f5e900d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e7c003bc0 0x7f5e7c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c004d90 0x7f5e7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9006b600 con 0x7f5e7c003bc0 2023-05-11T07:35:56.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c00bac0 con 0x7f5e7c004d90 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c00bc30 con 0x7f5e90160ee0 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e7c003bc0 0x7f5e7c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e87fff700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8ed9d700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c004d90 0x7f5e7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8e59c700 1 -- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 msgr2=0x7f5e7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.677+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e90160ee0 0x7f5e7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8e59c700 1 -- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c004d90 msgr2=0x7f5e7c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:56.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c004d90 0x7f5e7c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8e59c700 1 -- 172.21.15.144:0/3894532861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0035b0 con 0x7f5e7c003bc0 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8ed9d700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c004d90 0x7f5e7c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e7c003bc0 0x7f5e7c003fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e80001940 tx=0x7f5e7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916097a17385d9d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80001430 con 0x7f5e7c003bc0 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80001d70 con 0x7f5e7c003bc0 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8dd9b700 1 -- 172.21.15.144:0/3894532861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80005510 con 0x7f5e7c003bc0 2023-05-11T07:35:56.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e94dff700 1 -- 172.21.15.144:0/3894532861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e7c003bc0 msgr2=0x7f5e7c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e94dff700 1 --2- 172.21.15.144:0/3894532861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e7c003bc0 0x7f5e7c003fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e80001940 tx=0x7f5e7c005880 comp rx=0 tx=0).stop 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.678+0000 7f5e8ed9d700 1 -- 172.21.15.144:0/3894532861 reap_dead start 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.679+0000 7f5e94dff700 1 -- 172.21.15.144:0/3894532861 shutdown_connections 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.679+0000 7f5e94dff700 1 -- 172.21.15.144:0/3894532861 >> 172.21.15.144:0/3894532861 conn(0x7f5e900d3180 msgr2=0x7f5e900d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.679+0000 7f5e94dff700 1 -- 172.21.15.144:0/3894532861 shutdown_connections 2023-05-11T07:35:56.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.679+0000 7f5e94dff700 1 -- 172.21.15.144:0/3894532861 wait complete. 2023-05-11T07:35:56.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.680+0000 7f5e94dff700 1 Processor -- start 2023-05-11T07:35:56.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.680+0000 7f5e94dff700 1 -- start start 2023-05-11T07:35:56.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c003bc0 0x7f5e901f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e900cc570 0x7f5e900cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901f2f50 con 0x7f5e900ca1c0 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900ccf50 con 0x7f5e7c003bc0 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.681+0000 7f5e94dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900cb540 con 0x7f5e900cc570 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60788/0 (socket says 172.21.15.144:60788) 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 -- 172.21.15.144:0/4178600107 learned_addr learned my addr 172.21.15.144:0/4178600107 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c003bc0 0x7f5e901f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e8ed9d700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e900cc570 0x7f5e900cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 -- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e900cc570 msgr2=0x7f5e900cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e900cc570 0x7f5e900cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 -- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c003bc0 msgr2=0x7f5e901f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c003bc0 0x7f5e901f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 -- 172.21.15.144:0/4178600107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900d1400 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e87fff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e78011b00 tx=0x7f5e78011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800fa00 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.682+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800fb60 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.683+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e900d1120 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.683+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78014440 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.683+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e900b66e0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.684+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e900744c0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.685+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e780145a0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.685+0000 7f5e86ffd700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 0x7f5e7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.686+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e7808a0a0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.686+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 0x7f5e7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.686+0000 7f5e8e59c700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 0x7f5e7006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e8000a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:56.693 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.690+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5e78054e80 con 0x7f5e900ca1c0 2023-05-11T07:35:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.881+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e900cb6d0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.881+0000 7f5e86ffd700 1 -- 172.21.15.144:0/4178600107 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e780584a0 con 0x7f5e900ca1c0 2023-05-11T07:35:56.884 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:35:56.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 msgr2=0x7f5e7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 0x7f5e7006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e8000a000 comp rx=0 tx=0).stop 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 msgr2=0x7f5e901590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e78011b00 tx=0x7f5e78011ec0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 shutdown_connections 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e7006ace0 0x7f5e7006d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e900cc570 0x7f5e900cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e7c003bc0 0x7f5e901f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 --2- 172.21.15.144:0/4178600107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e900ca1c0 0x7f5e901590b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:56.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 >> 172.21.15.144:0/4178600107 conn(0x7f5e900d3180 msgr2=0x7f5e90160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:56.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 shutdown_connections 2023-05-11T07:35:56.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:56.884+0000 7f5e94dff700 1 -- 172.21.15.144:0/4178600107 wait complete. 2023-05-11T07:35:56.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:35:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.088+0000 7f4a525ff700 1 Processor -- start 2023-05-11T07:35:57.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.088+0000 7f4a525ff700 1 -- start start 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a525ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4c160ee0 0x7f4a4c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a525ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a525ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0d0e80 con 0x7f4a4c15c940 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a525ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c06b600 con 0x7f4a4c160ee0 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a525ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0cdb00 con 0x7f4a4c06b180 2023-05-11T07:35:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4c160ee0 0x7f4a4c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4c160ee0 0x7f4a4c06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60790/0 (socket says 172.21.15.144:60790) 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1327429321 learned_addr learned my addr 172.21.15.144:0/1327429321 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a50b9c700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1327429321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 msgr2=0x7f4a4c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1327429321 >> v1:172.21.15.145:6789/0 conn(0x7f4a4c15c940 legacy=0x7f4a4c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.090+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1327429321 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0cdde0 con 0x7f4a4c160ee0 2023-05-11T07:35:57.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a4b7fe700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c06ac40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098f0 tx=0x7f4a40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e9e940fdfc768d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a4affd700 1 -- 172.21.15.144:0/1327429321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40004230 con 0x7f4a4c160ee0 2023-05-11T07:35:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a4affd700 1 -- 172.21.15.144:0/1327429321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40004390 con 0x7f4a4c160ee0 2023-05-11T07:35:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a4affd700 1 -- 172.21.15.144:0/1327429321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400036a0 con 0x7f4a4c160ee0 2023-05-11T07:35:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 -- 172.21.15.144:0/1327429321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c160ee0 msgr2=0x7f4a4c06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c06ac40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098f0 tx=0x7f4a40009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 -- 172.21.15.144:0/1327429321 shutdown_connections 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1327429321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c06ac40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 -- 172.21.15.144:0/1327429321 >> 172.21.15.144:0/1327429321 conn(0x7f4a4c0d3180 msgr2=0x7f4a4c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.091+0000 7f4a525ff700 1 -- 172.21.15.144:0/1327429321 shutdown_connections 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.092+0000 7f4a525ff700 1 -- 172.21.15.144:0/1327429321 wait complete. 2023-05-11T07:35:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.093+0000 7f4a525ff700 1 Processor -- start 2023-05-11T07:35:57.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.093+0000 7f4a525ff700 1 -- start start 2023-05-11T07:35:57.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c15ee80 con 0x7f4a4c15c940 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c155be0 con 0x7f4a4c160ee0 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a525ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c151010 con 0x7f4a4c06b180 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a4b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a4b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60806/0 (socket says 172.21.15.144:60806) 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1017221447 learned_addr learned my addr 172.21.15.144:0/1017221447 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a4bfff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.094+0000 7f4a50b9c700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 msgr2=0x7f4a4c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c160ee0 msgr2=0x7f4a4c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 -- 172.21.15.144:0/1017221447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009550 con 0x7f4a4c15c940 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a4b7fe700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0d40c0 tx=0x7f4a40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40003aa0 con 0x7f4a4c15c940 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4001f070 con 0x7f4a4c15c940 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40003e40 con 0x7f4a4c15c940 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c0d1400 con 0x7f4a4c15c940 2023-05-11T07:35:57.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.095+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c0d1120 con 0x7f4a4c15c940 2023-05-11T07:35:57.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.096+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c0b66e0 con 0x7f4a4c15c940 2023-05-11T07:35:57.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.097+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a40021030 con 0x7f4a4c15c940 2023-05-11T07:35:57.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.098+0000 7f4a48ff9700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 0x7f4a3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.098+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4a4008acb0 con 0x7f4a4c15c940 2023-05-11T07:35:57.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.098+0000 7f4a4bfff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 0x7f4a3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.099+0000 7f4a4bfff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 0x7f4a3806d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.103+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4a40055af0 con 0x7f4a4c15c940 2023-05-11T07:35:57.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.294+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a4c0b66e0 con 0x7f4a4c15c940 2023-05-11T07:35:57.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.295+0000 7f4a48ff9700 1 -- 172.21.15.144:0/1017221447 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a40059110 con 0x7f4a4c15c940 2023-05-11T07:35:57.297 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:35:57.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 msgr2=0x7f4a3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 0x7f4a3806d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c007ec0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 msgr2=0x7f4a4c1572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0d40c0 tx=0x7f4a40004750 comp rx=0 tx=0).stop 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 shutdown_connections 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a3806ad10 0x7f4a3806d1c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a4c06b180 0x7f4a4c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a4c160ee0 0x7f4a4c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 --2- 172.21.15.144:0/1017221447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4c15c940 0x7f4a4c1572b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 >> 172.21.15.144:0/1017221447 conn(0x7f4a4c0d3180 msgr2=0x7f4a4c158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:57.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 shutdown_connections 2023-05-11T07:35:57.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.297+0000 7f4a525ff700 1 -- 172.21.15.144:0/1017221447 wait complete. 2023-05-11T07:35:57.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:35:57.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.502+0000 7f8e30dff700 1 Processor -- start 2023-05-11T07:35:57.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.502+0000 7f8e30dff700 1 -- start start 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e30dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e2c160ee0 0x7f8e2c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e30dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e30dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c0d0e80 con 0x7f8e2c15c940 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e30dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c06b600 con 0x7f8e2c160ee0 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e30dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0cdb00 con 0x7f8e2c06b180 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e29d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e2c160ee0 0x7f8e2c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e29d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e2c160ee0 0x7f8e2c06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60822/0 (socket says 172.21.15.144:60822) 2023-05-11T07:35:57.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e29d9b700 1 -- 172.21.15.144:0/411842911 learned_addr learned my addr 172.21.15.144:0/411842911 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.503+0000 7f8e2ad9d700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e29d9b700 1 -- 172.21.15.144:0/411842911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 msgr2=0x7f8e2c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:57.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e29d9b700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e29d9b700 1 -- 172.21.15.144:0/411842911 >> v1:172.21.15.145:6789/0 conn(0x7f8e2c15c940 legacy=0x7f8e2c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e29d9b700 1 -- 172.21.15.144:0/411842911 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c0cdde0 con 0x7f8e2c160ee0 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e29d9b700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c06ac40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e200098f0 tx=0x7f8e20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b17a916505f7c93 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e2959a700 1 -- 172.21.15.144:0/411842911 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20011830 con 0x7f8e2c160ee0 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e2959a700 1 -- 172.21.15.144:0/411842911 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20011990 con 0x7f8e2c160ee0 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.504+0000 7f8e2959a700 1 -- 172.21.15.144:0/411842911 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20011d20 con 0x7f8e2c160ee0 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 -- 172.21.15.144:0/411842911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 msgr2=0x7f8e2c06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c06ac40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e200098f0 tx=0x7f8e20009c00 comp rx=0 tx=0).stop 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 -- 172.21.15.144:0/411842911 shutdown_connections 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 --2- 172.21.15.144:0/411842911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c06ac40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 -- 172.21.15.144:0/411842911 >> 172.21.15.144:0/411842911 conn(0x7f8e2c0d3180 msgr2=0x7f8e2c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 -- 172.21.15.144:0/411842911 shutdown_connections 2023-05-11T07:35:57.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.505+0000 7f8e30dff700 1 -- 172.21.15.144:0/411842911 wait complete. 2023-05-11T07:35:57.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.506+0000 7f8e30dff700 1 Processor -- start 2023-05-11T07:35:57.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.507+0000 7f8e30dff700 1 -- start start 2023-05-11T07:35:57.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.507+0000 7f8e30dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.507+0000 7f8e30dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2c15c940 0x7f8e2c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e30dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e30dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15ed50 con 0x7f8e2c160ee0 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e30dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15eff0 con 0x7f8e2c15c940 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e30dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15f2d0 con 0x7f8e2c06b180 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60826/0 (socket says 172.21.15.144:60826) 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 -- 172.21.15.144:0/1416152715 learned_addr learned my addr 172.21.15.144:0/1416152715 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e29d9b700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2c15c940 0x7f8e2c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2a59c700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 -- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 msgr2=0x7f8e2c150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 -- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2c15c940 msgr2=0x7f8e2c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2c15c940 0x7f8e2c0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 -- 172.21.15.144:0/1416152715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009550 con 0x7f8e2c160ee0 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2a59c700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.508+0000 7f8e2ad9d700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400efc0 tx=0x7f8e2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.509+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24009ea0 con 0x7f8e2c160ee0 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.509+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400f040 con 0x7f8e2c160ee0 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.509+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c0d1400 con 0x7f8e2c160ee0 2023-05-11T07:35:57.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.509+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24014480 con 0x7f8e2c160ee0 2023-05-11T07:35:57.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.509+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c0d1120 con 0x7f8e2c160ee0 2023-05-11T07:35:57.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.510+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c0b66e0 con 0x7f8e2c160ee0 2023-05-11T07:35:57.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.513+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e240145e0 con 0x7f8e2c160ee0 2023-05-11T07:35:57.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.514+0000 7f8e1affd700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.514+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e2408a760 con 0x7f8e2c160ee0 2023-05-11T07:35:57.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.514+0000 7f8e2a59c700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.515+0000 7f8e2a59c700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c000f60 tx=0x7f8e1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.517+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8e24055640 con 0x7f8e2c160ee0 2023-05-11T07:35:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.711+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e2c161330 con 0x7f8e2c160ee0 2023-05-11T07:35:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.711+0000 7f8e1affd700 1 -- 172.21.15.144:0/1416152715 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e24058c60 con 0x7f8e2c160ee0 2023-05-11T07:35:57.714 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:35:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 msgr2=0x7f8e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c000f60 tx=0x7f8e1c009040 comp rx=0 tx=0).stop 2023-05-11T07:35:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 msgr2=0x7f8e2c0b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400efc0 tx=0x7f8e2400c3a0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 shutdown_connections 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e2c06b180 0x7f8e2c150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2c160ee0 0x7f8e2c0b7e90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 --2- 172.21.15.144:0/1416152715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2c15c940 0x7f8e2c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.713+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 >> 172.21.15.144:0/1416152715 conn(0x7f8e2c0d3180 msgr2=0x7f8e2c0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:57.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.714+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 shutdown_connections 2023-05-11T07:35:57.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.714+0000 7f8e30dff700 1 -- 172.21.15.144:0/1416152715 wait complete. 2023-05-11T07:35:57.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:35:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.917+0000 7f5037dff700 1 Processor -- start 2023-05-11T07:35:57.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.917+0000 7f5037dff700 1 -- start start 2023-05-11T07:35:57.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f5037dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50300b6b20 0x7f50301678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f5037dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b5680 con 0x7f503015ce10 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f5037dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50300b4790 con 0x7f503006baf0 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f5037dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50300b28c0 con 0x7f50300b6b20 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f503639c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50300b6b20 0x7f50301678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f503639c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50300b6b20 0x7f50301678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60836/0 (socket says 172.21.15.144:60836) 2023-05-11T07:35:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.918+0000 7f503639c700 1 -- 172.21.15.144:0/3201430202 learned_addr learned my addr 172.21.15.144:0/3201430202 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f503639c700 1 -- 172.21.15.144:0/3201430202 >> v1:172.21.15.145:6789/0 conn(0x7f503006baf0 legacy=0x7f50300ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f503639c700 1 -- 172.21.15.144:0/3201430202 >> v1:172.21.15.144:6789/0 conn(0x7f503015ce10 legacy=0x7f503006b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f503639c700 1 -- 172.21.15.144:0/3201430202 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300b4a70 con 0x7f50300b6b20 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f503639c700 1 --2- 172.21.15.144:0/3201430202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50300b6b20 0x7f50301678a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5028009e50 tx=0x7f502800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e437753a59088eb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f5034b99700 1 -- 172.21.15.144:0/3201430202 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800e070 con 0x7f50300b6b20 2023-05-11T07:35:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f5034b99700 1 -- 172.21.15.144:0/3201430202 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502800b9c0 con 0x7f50300b6b20 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.919+0000 7f5034b99700 1 -- 172.21.15.144:0/3201430202 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800bd70 con 0x7f50300b6b20 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 -- 172.21.15.144:0/3201430202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50300b6b20 msgr2=0x7f50301678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 --2- 172.21.15.144:0/3201430202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50300b6b20 0x7f50301678a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5028009e50 tx=0x7f502800b330 comp rx=0 tx=0).stop 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 -- 172.21.15.144:0/3201430202 shutdown_connections 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 --2- 172.21.15.144:0/3201430202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50300b6b20 0x7f50301678a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 -- 172.21.15.144:0/3201430202 >> 172.21.15.144:0/3201430202 conn(0x7f503009a2c0 msgr2=0x7f50300d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 -- 172.21.15.144:0/3201430202 shutdown_connections 2023-05-11T07:35:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.920+0000 7f5037dff700 1 -- 172.21.15.144:0/3201430202 wait complete. 2023-05-11T07:35:57.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.921+0000 7f5037dff700 1 Processor -- start 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 -- start start 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 0x7f50300ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 0x7f50301577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50300cb2b0 con 0x7f503015ce10 2023-05-11T07:35:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50300c8110 con 0x7f503006baf0 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.922+0000 7f5037dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50300c83f0 con 0x7f50300b6b20 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60838/0 (socket says 172.21.15.144:60838) 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 -- 172.21.15.144:0/3212451511 learned_addr learned my addr 172.21.15.144:0/3212451511 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f5035b9b700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 0x7f50300ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503539a700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 0x7f50301577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 -- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 msgr2=0x7f50301577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 0x7f50301577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 -- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 msgr2=0x7f50300ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 0x7f50300ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 -- 172.21.15.144:0/3212451511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009b30 con 0x7f503015ce10 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503539a700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 0x7f50301577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f5035b9b700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 0x7f50300ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:35:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.923+0000 7f503639c700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5030067490 tx=0x7f5028004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.924+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50280099b0 con 0x7f503015ce10 2023-05-11T07:35:57.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.924+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280092e0 con 0x7f503015ce10 2023-05-11T07:35:57.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.924+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801c660 con 0x7f503015ce10 2023-05-11T07:35:57.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.924+0000 7f5037dff700 1 -- 172.21.15.144:0/3212451511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50300b5030 con 0x7f503015ce10 2023-05-11T07:35:57.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.924+0000 7f5037dff700 1 -- 172.21.15.144:0/3212451511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50300b4d50 con 0x7f503015ce10 2023-05-11T07:35:57.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.925+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50300b5310 con 0x7f503015ce10 2023-05-11T07:35:57.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.926+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f502801c7c0 con 0x7f503015ce10 2023-05-11T07:35:57.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.927+0000 7f50267fc700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 0x7f501406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:57.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.927+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f502808b6c0 con 0x7f503015ce10 2023-05-11T07:35:57.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.927+0000 7f5035b9b700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 0x7f501406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:57.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.928+0000 7f5035b9b700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 0x7f501406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50300ce9d0 tx=0x7f502c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:57.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:57.931+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5028056470 con 0x7f503015ce10 2023-05-11T07:35:58.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.125+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f50300744c0 con 0x7f503015ce10 2023-05-11T07:35:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.125+0000 7f50267fc700 1 -- 172.21.15.144:0/3212451511 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5028059a90 con 0x7f503015ce10 2023-05-11T07:35:58.128 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:35:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 msgr2=0x7f501406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 0x7f501406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50300ce9d0 tx=0x7f502c009040 comp rx=0 tx=0).stop 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 msgr2=0x7f5030156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5030067490 tx=0x7f5028004ad0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 shutdown_connections 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f501406ace0 0x7f501406d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503015ce10 0x7f5030156370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f503006baf0 0x7f50300ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 --2- 172.21.15.144:0/3212451511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f50300b6b20 0x7f50301577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 >> 172.21.15.144:0/3212451511 conn(0x7f503009a2c0 msgr2=0x7f503006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:58.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 shutdown_connections 2023-05-11T07:35:58.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.128+0000 7f5013fff700 1 -- 172.21.15.144:0/3212451511 wait complete. 2023-05-11T07:35:58.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:35:58.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.331+0000 7f19525ff700 1 Processor -- start 2023-05-11T07:35:58.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.331+0000 7f19525ff700 1 -- start start 2023-05-11T07:35:58.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f194c1599e0 0x7f194c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f194c0ca020 0x7f194c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 0x7f194c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c0b10c0 con 0x7f194c1599e0 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c15e200 con 0x7f194c0ca020 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f19525ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c15a100 con 0x7f194c0b0c60 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f194bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f194c1599e0 0x7f194c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f194bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f194c1599e0 0x7f194c0c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60852/0 (socket says 172.21.15.144:60852) 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f194bfff700 1 -- 172.21.15.144:0/859557067 learned_addr learned my addr 172.21.15.144:0/859557067 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.332+0000 7f194b7fe700 1 --2- 172.21.15.144:0/859557067 >> v2:172.21.15.145:3300/0 conn(0x7f194c0ca020 0x7f194c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f1950b9c700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 0x7f194c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 -- 172.21.15.144:0/859557067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 msgr2=0x7f194c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 0x7f194c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 -- 172.21.15.144:0/859557067 >> v2:172.21.15.145:3300/0 conn(0x7f194c0ca020 msgr2=0x7f194c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 --2- 172.21.15.144:0/859557067 >> v2:172.21.15.145:3300/0 conn(0x7f194c0ca020 0x7f194c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 -- 172.21.15.144:0/859557067 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c15a3e0 con 0x7f194c1599e0 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f1950b9c700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 0x7f194c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:35:58.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194bfff700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c0c9ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f194c06d8a0 tx=0x7f193c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15a0f02d9baa992 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:58.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194affd700 1 -- 172.21.15.144:0/859557067 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00b870 con 0x7f194c1599e0 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194affd700 1 -- 172.21.15.144:0/859557067 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b9d0 con 0x7f194c1599e0 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.333+0000 7f194affd700 1 -- 172.21.15.144:0/859557067 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00bd60 con 0x7f194c1599e0 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 -- 172.21.15.144:0/859557067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 msgr2=0x7f194c0c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c0c9ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f194c06d8a0 tx=0x7f193c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 -- 172.21.15.144:0/859557067 shutdown_connections 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0b0c60 0x7f194c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 --2- 172.21.15.144:0/859557067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c0c9ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 --2- 172.21.15.144:0/859557067 >> v2:172.21.15.145:3300/0 conn(0x7f194c0ca020 0x7f194c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 -- 172.21.15.144:0/859557067 >> 172.21.15.144:0/859557067 conn(0x7f194c0cb720 msgr2=0x7f194c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 -- 172.21.15.144:0/859557067 shutdown_connections 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.334+0000 7f19525ff700 1 -- 172.21.15.144:0/859557067 wait complete. 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.335+0000 7f19525ff700 1 Processor -- start 2023-05-11T07:35:58.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.336+0000 7f19525ff700 1 -- start start 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f194c0b0c60 0x7f194c153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0ca020 0x7f194c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c153a70 con 0x7f194c1599e0 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0c7e60 con 0x7f194c0b0c60 2023-05-11T07:35:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f19525ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0c8830 con 0x7f194c0ca020 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f194bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f194c0b0c60 0x7f194c153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60858/0 (socket says 172.21.15.144:60858) 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 -- 172.21.15.144:0/95223983 learned_addr learned my addr 172.21.15.144:0/95223983 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f194b7fe700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0ca020 0x7f194c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 -- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0ca020 msgr2=0x7f194c0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0ca020 0x7f194c0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 -- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f194c0b0c60 msgr2=0x7f194c153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f194c0b0c60 0x7f194c153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 -- 172.21.15.144:0/95223983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009550 con 0x7f194c1599e0 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.337+0000 7f1950b9c700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f194400cef0 tx=0x7f194400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.338+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400ac80 con 0x7f194c1599e0 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.338+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400ade0 con 0x7f194c1599e0 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.338+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c15a9a0 con 0x7f194c1599e0 2023-05-11T07:35:58.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.338+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944015680 con 0x7f194c1599e0 2023-05-11T07:35:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.338+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c15a6c0 con 0x7f194c1599e0 2023-05-11T07:35:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.339+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c159db0 con 0x7f194c1599e0 2023-05-11T07:35:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.340+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f194400d430 con 0x7f194c1599e0 2023-05-11T07:35:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.341+0000 7f1948ff9700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:35:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.341+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1944089bc0 con 0x7f194c1599e0 2023-05-11T07:35:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.341+0000 7f194bfff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:35:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.342+0000 7f194bfff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 0x7f193806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f193c014040 tx=0x7f193c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:35:58.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.345+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1944054970 con 0x7f194c1599e0 2023-05-11T07:35:58.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.555+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f194c0b1700 con 0x7f194c1599e0 2023-05-11T07:35:58.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.555+0000 7f1948ff9700 1 -- 172.21.15.144:0/95223983 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f194401a080 con 0x7f194c1599e0 2023-05-11T07:35:58.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 msgr2=0x7f193806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 0x7f193806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f193c014040 tx=0x7f193c008030 comp rx=0 tx=0).stop 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 msgr2=0x7f194c070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f194400cef0 tx=0x7f194400cf20 comp rx=0 tx=0).stop 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 shutdown_connections 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f194c1599e0 0x7f194c070b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f194c0b0c60 0x7f194c153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 --2- 172.21.15.144:0/95223983 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f194c0ca020 0x7f194c0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 >> 172.21.15.144:0/95223983 conn(0x7f194c0cb720 msgr2=0x7f194c0ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 shutdown_connections 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:35:58.558+0000 7f19525ff700 1 -- 172.21.15.144:0/95223983 wait complete. 2023-05-11T07:35:58.562 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:35:58.577 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi144.front.sepia.ceph.com... 2023-05-11T07:35:58.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:35:58.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-11T07:35:58.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[112111]: fuse finished with error 0 and tester_r 0 2023-05-11T07:35:58.642 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T07:36:02.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:36:02.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:36:04.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:36:04.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:04.745 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-11T07:36:04.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:05.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.996+0000 7f8c8f7ff700 1 Processor -- start 2023-05-11T07:36:05.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.996+0000 7f8c8f7ff700 1 -- start start 2023-05-11T07:36:05.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.997+0000 7f8c8f7ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c880b87e0 0x7f8c880b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.997+0000 7f8c8f7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 0x7f8c880b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.997+0000 7f8c8f7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8815cef0 con 0x7f8c880d02c0 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.997+0000 7f8c8f7ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880b5a80 con 0x7f8c880b87e0 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8f7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880cdf70 con 0x7f8c880d27a0 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c880b87e0 0x7f8c880b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c880b87e0 0x7f8c880b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60860/0 (socket says 172.21.15.144:60860) 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 -- 172.21.15.144:0/2110822218 learned_addr learned my addr 172.21.15.144:0/2110822218 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8dd9c700 1 --2- 172.21.15.144:0/2110822218 >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 0x7f8c880b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 -- 172.21.15.144:0/2110822218 >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 msgr2=0x7f8c880b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/2110822218 >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 0x7f8c880b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 -- 172.21.15.144:0/2110822218 >> v1:172.21.15.144:6789/0 conn(0x7f8c880d02c0 legacy=0x7f8c880d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 -- 172.21.15.144:0/2110822218 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880cd760 con 0x7f8c880b87e0 2023-05-11T07:36:05.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8dd9c700 1 --2- 172.21.15.144:0/2110822218 >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 0x7f8c880b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.998+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/2110822218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880b87e0 0x7f8c880b4b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c880c6be0 tx=0x7f8c84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a136b9459aa2d125 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c7ffff700 1 -- 172.21.15.144:0/2110822218 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400b870 con 0x7f8c880b87e0 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c7ffff700 1 -- 172.21.15.144:0/2110822218 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400b9d0 con 0x7f8c880b87e0 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c7ffff700 1 -- 172.21.15.144:0/2110822218 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400bd60 con 0x7f8c880b87e0 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/2110822218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880b87e0 msgr2=0x7f8c880b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/2110822218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880b87e0 0x7f8c880b4b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c880c6be0 tx=0x7f8c84009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/2110822218 shutdown_connections 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/2110822218 >> v2:172.21.15.145:3300/0 conn(0x7f8c880d27a0 0x7f8c880b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/2110822218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880b87e0 0x7f8c880b4b90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/2110822218 >> 172.21.15.144:0/2110822218 conn(0x7f8c8806acf0 msgr2=0x7f8c8806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:04.999+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/2110822218 shutdown_connections 2023-05-11T07:36:05.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.000+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/2110822218 wait complete. 2023-05-11T07:36:05.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.002+0000 7f8c8f7ff700 1 Processor -- start 2023-05-11T07:36:05.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.002+0000 7f8c8f7ff700 1 -- start start 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 0x7f8c8815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c880d02c0 0x7f8c880cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880ccd40 con 0x7f8c880d27a0 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880cc130 con 0x7f8c880d02c0 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8f7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880cc410 con 0x7f8c880b87e0 2023-05-11T07:36:05.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8dd9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8dd9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60876/0 (socket says 172.21.15.144:60876) 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.003+0000 7f8c8dd9c700 1 -- 172.21.15.144:0/1180794221 learned_addr learned my addr 172.21.15.144:0/1180794221 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8cd9a700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c880d02c0 0x7f8c880cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 0x7f8c8815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 -- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 msgr2=0x7f8c8815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 0x7f8c8815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 -- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c880d02c0 msgr2=0x7f8c880cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c880d02c0 0x7f8c880cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 -- 172.21.15.144:0/1180794221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84009550 con 0x7f8c880d27a0 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 0x7f8c8815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8dd9c700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c80007df0 tx=0x7f8c8000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000ddd0 con 0x7f8c880d27a0 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000f040 con 0x7f8c880d27a0 2023-05-11T07:36:05.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c880cd9b0 con 0x7f8c880d27a0 2023-05-11T07:36:05.012 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.004+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003c60 con 0x7f8c880d27a0 2023-05-11T07:36:05.012 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.005+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c880d2d30 con 0x7f8c880d27a0 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.006+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880cdc90 con 0x7f8c880d27a0 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.006+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c80004030 con 0x7f8c880d27a0 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.007+0000 7f8c7dffb700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 0x7f8c6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.007+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c80089a60 con 0x7f8c880d27a0 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.008+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 0x7f8c6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.008+0000 7f8c8d59b700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 0x7f8c6c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009130 tx=0x7f8c84008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.012+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8c800546f0 con 0x7f8c880d27a0 2023-05-11T07:36:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.206+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c8808b830 con 0x7f8c880d27a0 2023-05-11T07:36:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.207+0000 7f8c7dffb700 1 -- 172.21.15.144:0/1180794221 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f8c8001a090 con 0x7f8c880d27a0 2023-05-11T07:36:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:05.211 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 msgr2=0x7f8c6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 0x7f8c6c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009130 tx=0x7f8c84008030 comp rx=0 tx=0).stop 2023-05-11T07:36:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 msgr2=0x7f8c880cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c80007df0 tx=0x7f8c8000d3b0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 shutdown_connections 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8c6c06ace0 0x7f8c6c06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8c880b87e0 0x7f8c8815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c880d27a0 0x7f8c880cbad0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 --2- 172.21.15.144:0/1180794221 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c880d02c0 0x7f8c880cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.209+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 >> 172.21.15.144:0/1180794221 conn(0x7f8c8806acf0 msgr2=0x7f8c880d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.210+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 shutdown_connections 2023-05-11T07:36:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.210+0000 7f8c8f7ff700 1 -- 172.21.15.144:0/1180794221 wait complete. 2023-05-11T07:36:05.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:05.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.413+0000 7f7c44bff700 1 Processor -- start 2023-05-11T07:36:05.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.413+0000 7f7c44bff700 1 -- start start 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c44bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c401597f0 0x7f7c400c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c44bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c40159bc0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c44bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4015e120 con 0x7f7c4015dc80 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c44bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400c9e30 con 0x7f7c401597f0 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c3e59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c401597f0 0x7f7c400c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c3e59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c401597f0 0x7f7c400c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60878/0 (socket says 172.21.15.144:60878) 2023-05-11T07:36:05.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.414+0000 7f7c3e59c700 1 -- 172.21.15.144:0/330449135 learned_addr learned my addr 172.21.15.144:0/330449135 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:05.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3e59c700 1 -- 172.21.15.144:0/330449135 >> v1:172.21.15.145:6789/0 conn(0x7f7c4015dc80 legacy=0x7f7c400cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3e59c700 1 -- 172.21.15.144:0/330449135 >> v1:172.21.15.144:6789/0 conn(0x7f7c4006a2d0 legacy=0x7f7c4006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3e59c700 1 -- 172.21.15.144:0/330449135 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400ca110 con 0x7f7c401597f0 2023-05-11T07:36:05.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3e59c700 1 --2- 172.21.15.144:0/330449135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401597f0 0x7f7c400c9730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000bb90 tx=0x7f7c3000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7856505e74155a7f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3d59a700 1 -- 172.21.15.144:0/330449135 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000dd50 con 0x7f7c401597f0 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3d59a700 1 -- 172.21.15.144:0/330449135 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30010470 con 0x7f7c401597f0 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.415+0000 7f7c3d59a700 1 -- 172.21.15.144:0/330449135 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30010800 con 0x7f7c401597f0 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 -- 172.21.15.144:0/330449135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401597f0 msgr2=0x7f7c400c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 --2- 172.21.15.144:0/330449135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401597f0 0x7f7c400c9730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000bb90 tx=0x7f7c3000bea0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 -- 172.21.15.144:0/330449135 shutdown_connections 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 --2- 172.21.15.144:0/330449135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401597f0 0x7f7c400c9730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 -- 172.21.15.144:0/330449135 >> 172.21.15.144:0/330449135 conn(0x7f7c400cb7e0 msgr2=0x7f7c400cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:05.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 -- 172.21.15.144:0/330449135 shutdown_connections 2023-05-11T07:36:05.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.416+0000 7f7c44bff700 1 -- 172.21.15.144:0/330449135 wait complete. 2023-05-11T07:36:05.423 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.418+0000 7f7c44bff700 1 Processor -- start 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.418+0000 7f7c44bff700 1 -- start start 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 0x7f7c4015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c401597f0 0x7f7c400b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015ae50 con 0x7f7c4015dc80 2023-05-11T07:36:05.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c401e3170 con 0x7f7c4006a2d0 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c44bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c2b50 con 0x7f7c401597f0 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3e59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 0x7f7c4015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60880/0 (socket says 172.21.15.144:60880) 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3ed9d700 1 -- 172.21.15.144:0/687832853 learned_addr learned my addr 172.21.15.144:0/687832853 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3dd9b700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c401597f0 0x7f7c400b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3e59c700 1 -- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c401597f0 msgr2=0x7f7c400b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3e59c700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c401597f0 0x7f7c400b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3e59c700 1 -- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 msgr2=0x7f7c400c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.419+0000 7f7c3e59c700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c3e59c700 1 -- 172.21.15.144:0/687832853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3000b7f0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c3ed9d700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c3e59c700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 0x7f7c4015a7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c30018000 tx=0x7f7c30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3001f070 con 0x7f7c4006a2d0 2023-05-11T07:36:05.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c300038b0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c400ccf90 con 0x7f7c4006a2d0 2023-05-11T07:36:05.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30003c80 con 0x7f7c4006a2d0 2023-05-11T07:36:05.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.420+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c400cccb0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.421+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400cd270 con 0x7f7c4006a2d0 2023-05-11T07:36:05.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.422+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c3002d430 con 0x7f7c4006a2d0 2023-05-11T07:36:05.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.423+0000 7f7c2effd700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.423+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c3008d2d0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.423+0000 7f7c3dd9b700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.430 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.424+0000 7f7c3dd9b700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 0x7f7c2006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c4015c5f0 tx=0x7f7c34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.432 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.428+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7c300580a0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.621+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c400c9170 con 0x7f7c4006a2d0 2023-05-11T07:36:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.623+0000 7f7c2effd700 1 -- 172.21.15.144:0/687832853 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f7c3005b6c0 con 0x7f7c4006a2d0 2023-05-11T07:36:05.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:05.627 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 msgr2=0x7f7c2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 0x7f7c2006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c4015c5f0 tx=0x7f7c34009040 comp rx=0 tx=0).stop 2023-05-11T07:36:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 msgr2=0x7f7c4015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 0x7f7c4015a7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c30018000 tx=0x7f7c30004750 comp rx=0 tx=0).stop 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 shutdown_connections 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7c2006ace0 0x7f7c2006d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4015dc80 0x7f7c400c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c4006a2d0 0x7f7c4015a7c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.625+0000 7f7c44bff700 1 --2- 172.21.15.144:0/687832853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7c401597f0 0x7f7c400b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.626+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 >> 172.21.15.144:0/687832853 conn(0x7f7c400cb7e0 msgr2=0x7f7c400b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.626+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 shutdown_connections 2023-05-11T07:36:05.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.626+0000 7f7c44bff700 1 -- 172.21.15.144:0/687832853 wait complete. 2023-05-11T07:36:05.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-11T07:36:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.835+0000 7fea4cfff700 1 Processor -- start 2023-05-11T07:36:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.835+0000 7fea4cfff700 1 -- start start 2023-05-11T07:36:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4cfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fea48160ee0 0x7fea4806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4cfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea4806b180 0x7fea480d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4cfff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480d0e80 con 0x7fea4815c940 2023-05-11T07:36:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4cfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4806b600 con 0x7fea4806b180 2023-05-11T07:36:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4cfff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480cdb00 con 0x7fea48160ee0 2023-05-11T07:36:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4659c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fea4815c940 0x7fea480b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49010/0 (socket says 172.21.15.144:49010) 2023-05-11T07:36:05.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea4659c700 1 -- 172.21.15.144:0/2507849146 learned_addr learned my addr 172.21.15.144:0/2507849146 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea46d9d700 1 --2- 172.21.15.144:0/2507849146 >> v2:172.21.15.144:3300/0 conn(0x7fea4806b180 0x7fea480d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.836+0000 7fea45d9b700 1 --2- 172.21.15.144:0/2507849146 >> v2:172.21.15.145:3300/0 conn(0x7fea48160ee0 0x7fea4806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea46d9d700 1 -- 172.21.15.144:0/2507849146 >> v2:172.21.15.145:3300/0 conn(0x7fea48160ee0 msgr2=0x7fea4806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea46d9d700 1 --2- 172.21.15.144:0/2507849146 >> v2:172.21.15.145:3300/0 conn(0x7fea48160ee0 0x7fea4806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea46d9d700 1 -- 172.21.15.144:0/2507849146 >> v1:172.21.15.144:6789/0 conn(0x7fea4815c940 legacy=0x7fea480b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea46d9d700 1 -- 172.21.15.144:0/2507849146 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480cdde0 con 0x7fea4806b180 2023-05-11T07:36:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea46d9d700 1 --2- 172.21.15.144:0/2507849146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea480d1920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea480d3e60 tx=0x7fea4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54da7caa54f4a66c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea4559a700 1 -- 172.21.15.144:0/2507849146 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000e070 con 0x7fea4806b180 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea4559a700 1 -- 172.21.15.144:0/2507849146 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000bb20 con 0x7fea4806b180 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.837+0000 7fea4559a700 1 -- 172.21.15.144:0/2507849146 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012430 con 0x7fea4806b180 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 -- 172.21.15.144:0/2507849146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 msgr2=0x7fea480d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 --2- 172.21.15.144:0/2507849146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea480d1920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea480d3e60 tx=0x7fea4000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 -- 172.21.15.144:0/2507849146 shutdown_connections 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 --2- 172.21.15.144:0/2507849146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea480d1920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 --2- 172.21.15.144:0/2507849146 >> v2:172.21.15.145:3300/0 conn(0x7fea48160ee0 0x7fea4806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 -- 172.21.15.144:0/2507849146 >> 172.21.15.144:0/2507849146 conn(0x7fea480d3180 msgr2=0x7fea480d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:05.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 -- 172.21.15.144:0/2507849146 shutdown_connections 2023-05-11T07:36:05.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.838+0000 7fea4cfff700 1 -- 172.21.15.144:0/2507849146 wait complete. 2023-05-11T07:36:05.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.840+0000 7fea4cfff700 1 Processor -- start 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.840+0000 7fea4cfff700 1 -- start start 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fea4815c940 0x7fea480cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea48160ee0 0x7fea481f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480a9a80 con 0x7fea4806b180 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480cc160 con 0x7fea48160ee0 2023-05-11T07:36:05.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4cfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea481f55a0 con 0x7fea4815c940 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60890/0 (socket says 172.21.15.144:60890) 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 -- 172.21.15.144:0/1006436006 learned_addr learned my addr 172.21.15.144:0/1006436006 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea45d9b700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fea4815c940 0x7fea480cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea46d9d700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea48160ee0 0x7fea481f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 -- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fea4815c940 msgr2=0x7fea480cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fea4815c940 0x7fea480cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 -- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea48160ee0 msgr2=0x7fea481f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea48160ee0 0x7fea481f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.841+0000 7fea4659c700 1 -- 172.21.15.144:0/1006436006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40009a70 con 0x7fea4806b180 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea4659c700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c550 tx=0x7fea3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38005d70 con 0x7fea4806b180 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380070d0 con 0x7fea4806b180 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38007440 con 0x7fea4806b180 2023-05-11T07:36:05.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea480d1400 con 0x7fea4806b180 2023-05-11T07:36:05.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.842+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea480d1120 con 0x7fea4806b180 2023-05-11T07:36:05.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.843+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea480b66e0 con 0x7fea4806b180 2023-05-11T07:36:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.844+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea380075a0 con 0x7fea4806b180 2023-05-11T07:36:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.845+0000 7fea36ffd700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 0x7fea2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.845+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fea38088a20 con 0x7fea4806b180 2023-05-11T07:36:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.846+0000 7fea45d9b700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 0x7fea2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:05.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.846+0000 7fea45d9b700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 0x7fea2806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009be0 tx=0x7fea3c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:05.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:05.850+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fea38053880 con 0x7fea4806b180 2023-05-11T07:36:06.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.085+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea480744c0 con 0x7fea4806b180 2023-05-11T07:36:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.270+0000 7fea36ffd700 1 -- 172.21.15.144:0/1006436006 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea38056ea0 con 0x7fea4806b180 2023-05-11T07:36:06.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 msgr2=0x7fea2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 0x7fea2806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009be0 tx=0x7fea3c009210 comp rx=0 tx=0).stop 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 msgr2=0x7fea481f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c550 tx=0x7fea3800c860 comp rx=0 tx=0).stop 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 shutdown_connections 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fea2806ace0 0x7fea2806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fea48160ee0 0x7fea481f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea4806b180 0x7fea481f2240 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 --2- 172.21.15.144:0/1006436006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fea4815c940 0x7fea480cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 >> 172.21.15.144:0/1006436006 conn(0x7fea480d3180 msgr2=0x7fea480d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 shutdown_connections 2023-05-11T07:36:06.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.273+0000 7fea4cfff700 1 -- 172.21.15.144:0/1006436006 wait complete. 2023-05-11T07:36:06.294 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-11T07:36:06.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-11T07:36:06.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.479+0000 7f6cb51ff700 1 Processor -- start 2023-05-11T07:36:06.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.479+0000 7f6cb51ff700 1 -- start start 2023-05-11T07:36:06.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cb51ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6cb00cfe00 0x7f6cb00d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cb51ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6cb00d02a0 0x7f6cb00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cb51ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00cf640 con 0x7f6cb015c930 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cb51ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb015cd00 con 0x7f6cb00cfe00 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cb51ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00cd940 con 0x7f6cb00d02a0 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6caed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6cb015c930 0x7f6cb015d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40678/0 (socket says 172.21.15.144:40678) 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6caed9d700 1 -- 172.21.15.144:0/3337131362 learned_addr learned my addr 172.21.15.144:0/3337131362 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:06.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6cae59c700 1 --2- 172.21.15.144:0/3337131362 >> v2:172.21.15.144:3300/0 conn(0x7f6cb00cfe00 0x7f6cb00d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.481+0000 7f6caf59e700 1 --2- 172.21.15.144:0/3337131362 >> v2:172.21.15.145:3300/0 conn(0x7f6cb00d02a0 0x7f6cb00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cae59c700 1 -- 172.21.15.144:0/3337131362 >> v2:172.21.15.145:3300/0 conn(0x7f6cb00d02a0 msgr2=0x7f6cb00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:06.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cae59c700 1 --2- 172.21.15.144:0/3337131362 >> v2:172.21.15.145:3300/0 conn(0x7f6cb00d02a0 0x7f6cb00d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cae59c700 1 -- 172.21.15.144:0/3337131362 >> v1:172.21.15.144:6789/0 conn(0x7f6cb015c930 legacy=0x7f6cb015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cae59c700 1 -- 172.21.15.144:0/3337131362 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00cdc20 con 0x7f6cb00cfe00 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cae59c700 1 --2- 172.21.15.144:0/3337131362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00cfe00 0x7f6cb00d0db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009840 tx=0x7f6ca4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62a1bd8f46f83e5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cadd9b700 1 -- 172.21.15.144:0/3337131362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4011830 con 0x7f6cb00cfe00 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cadd9b700 1 -- 172.21.15.144:0/3337131362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4011990 con 0x7f6cb00cfe00 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.482+0000 7f6cadd9b700 1 -- 172.21.15.144:0/3337131362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4011d20 con 0x7f6cb00cfe00 2023-05-11T07:36:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3337131362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00cfe00 msgr2=0x7f6cb00d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3337131362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00cfe00 0x7f6cb00d0db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009840 tx=0x7f6ca4009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3337131362 shutdown_connections 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3337131362 >> v2:172.21.15.145:3300/0 conn(0x7f6cb00d02a0 0x7f6cb00d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3337131362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00cfe00 0x7f6cb00d0db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3337131362 >> 172.21.15.144:0/3337131362 conn(0x7f6cb0072650 msgr2=0x7f6cb006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3337131362 shutdown_connections 2023-05-11T07:36:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.483+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3337131362 wait complete. 2023-05-11T07:36:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.484+0000 7f6cb51ff700 1 Processor -- start 2023-05-11T07:36:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.484+0000 7f6cb51ff700 1 -- start start 2023-05-11T07:36:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cb00d02a0 0x7f6cb00c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 0x7f6cb00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00ccbb0 con 0x7f6cb00b3050 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00b35b0 con 0x7f6cb015c930 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.485+0000 7f6cb51ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00cc280 con 0x7f6cb00d02a0 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41488/0 (socket says 172.21.15.144:41488) 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 -- 172.21.15.144:0/3130017840 learned_addr learned my addr 172.21.15.144:0/3130017840 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6cae59c700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 0x7f6cb00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caed9d700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cb00d02a0 0x7f6cb00c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 -- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cb00d02a0 msgr2=0x7f6cb00c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cb00d02a0 0x7f6cb00c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 -- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 msgr2=0x7f6cb00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 0x7f6cb00b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 -- 172.21.15.144:0/3130017840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40094a0 con 0x7f6cb00b3050 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6cae59c700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 0x7f6cb00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.486+0000 7f6caf59e700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8007e40 tx=0x7f6ca800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.487+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800eea0 con 0x7f6cb00b3050 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.487+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8014420 con 0x7f6cb00b3050 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.487+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb00cdf00 con 0x7f6cb00b3050 2023-05-11T07:36:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.487+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80147b0 con 0x7f6cb00b3050 2023-05-11T07:36:06.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.487+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb00cf8e0 con 0x7f6cb00b3050 2023-05-11T07:36:06.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.488+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb00744c0 con 0x7f6cb00b3050 2023-05-11T07:36:06.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.489+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ca8014910 con 0x7f6cb00b3050 2023-05-11T07:36:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.490+0000 7f6c977fe700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 0x7f6c9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.490+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ca8089ff0 con 0x7f6cb00b3050 2023-05-11T07:36:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.490+0000 7f6caed9d700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 0x7f6c9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.491+0000 7f6caed9d700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 0x7f6c9c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0005910 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.494+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ca8054d70 con 0x7f6cb00b3050 2023-05-11T07:36:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:06.732+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6cb00cccf0 con 0x7f6cb00b3050 2023-05-11T07:36:07.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.271+0000 7f6c977fe700 1 -- 172.21.15.144:0/3130017840 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ca8058390 con 0x7f6cb00b3050 2023-05-11T07:36:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 msgr2=0x7f6c9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 0x7f6c9c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0005910 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 msgr2=0x7f6cb00d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8007e40 tx=0x7f6ca800e3c0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 shutdown_connections 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c9c06ace0 0x7f6c9c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6cb00d02a0 0x7f6cb00c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00b3050 0x7f6cb00d1de0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 --2- 172.21.15.144:0/3130017840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb015c930 0x7f6cb00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 >> 172.21.15.144:0/3130017840 conn(0x7f6cb00cfe00 msgr2=0x7f6cb0159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 shutdown_connections 2023-05-11T07:36:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.274+0000 7f6cb51ff700 1 -- 172.21.15.144:0/3130017840 wait complete. 2023-05-11T07:36:07.297 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-11T07:36:07.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:36:07.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.480+0000 7f3a795ff700 1 Processor -- start 2023-05-11T07:36:07.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.480+0000 7f3a795ff700 1 -- start start 2023-05-11T07:36:07.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.481+0000 7f3a795ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a740b52a0 0x7f3a740d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.481+0000 7f3a795ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7415cef0 con 0x7f3a740b87e0 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.481+0000 7f3a795ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740cd760 con 0x7f3a740d02c0 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.481+0000 7f3a795ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740b5a80 con 0x7f3a740b52a0 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a72ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3a740b87e0 0x7f3a740b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40682/0 (socket says 172.21.15.144:40682) 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a72ffd700 1 -- 172.21.15.144:0/2422919686 learned_addr learned my addr 172.21.15.144:0/2422919686 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a6bfff700 1 --2- 172.21.15.144:0/2422919686 >> v2:172.21.15.144:3300/0 conn(0x7f3a740b52a0 0x7f3a740d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700572239 0 0) 0x7f3a64001110 con 0x7f3a740b87e0 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a600035b0 con 0x7f3a740b87e0 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a6bfff700 1 -- 172.21.15.144:0/2422919686 >> v1:172.21.15.145:6789/0 conn(0x7f3a740d02c0 legacy=0x7f3a740d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423802969 0 0) 0x7f3a740cd760 con 0x7f3a740d02c0 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a6bfff700 1 -- 172.21.15.144:0/2422919686 >> v1:172.21.15.144:6789/0 conn(0x7f3a740b87e0 legacy=0x7f3a740b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.482+0000 7f3a6bfff700 1 -- 172.21.15.144:0/2422919686 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740d2d30 con 0x7f3a740b52a0 2023-05-11T07:36:07.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a6bfff700 1 --2- 172.21.15.144:0/2422919686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a740d2090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97f7a8a3a91cb89 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c011830 con 0x7f3a740b52a0 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c011990 con 0x7f3a740b52a0 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a727fc700 1 -- 172.21.15.144:0/2422919686 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c011d20 con 0x7f3a740b52a0 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a795ff700 1 -- 172.21.15.144:0/2422919686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 msgr2=0x7f3a740d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.483+0000 7f3a795ff700 1 --2- 172.21.15.144:0/2422919686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a740d2090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.484+0000 7f3a795ff700 1 -- 172.21.15.144:0/2422919686 shutdown_connections 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.484+0000 7f3a795ff700 1 --2- 172.21.15.144:0/2422919686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a740d2090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.484+0000 7f3a795ff700 1 -- 172.21.15.144:0/2422919686 >> 172.21.15.144:0/2422919686 conn(0x7f3a7406acf0 msgr2=0x7f3a7406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.484+0000 7f3a795ff700 1 -- 172.21.15.144:0/2422919686 shutdown_connections 2023-05-11T07:36:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.484+0000 7f3a795ff700 1 -- 172.21.15.144:0/2422919686 wait complete. 2023-05-11T07:36:07.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.485+0000 7f3a795ff700 1 Processor -- start 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.485+0000 7f3a795ff700 1 -- start start 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a740b87e0 0x7f3a741f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 0x7f3a74156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741f33d0 con 0x7f3a740b52a0 2023-05-11T07:36:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74155280 con 0x7f3a740b87e0 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.486+0000 7f3a795ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74155560 con 0x7f3a740d02c0 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41504/0 (socket says 172.21.15.144:41504) 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 -- 172.21.15.144:0/1510714994 learned_addr learned my addr 172.21.15.144:0/1510714994 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a6bfff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a740b87e0 0x7f3a741f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a737fe700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 0x7f3a74156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 -- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 msgr2=0x7f3a74156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 0x7f3a74156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 -- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a740b87e0 msgr2=0x7f3a741f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a740b87e0 0x7f3a741f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 -- 172.21.15.144:0/1510714994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0094a0 con 0x7f3a740b52a0 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a737fe700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 0x7f3a74156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a72ffd700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c4d0 tx=0x7f3a6400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64005d70 con 0x7f3a740b52a0 2023-05-11T07:36:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a640070d0 con 0x7f3a740b52a0 2023-05-11T07:36:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64007480 con 0x7f3a740b52a0 2023-05-11T07:36:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.487+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740cdc90 con 0x7f3a740b52a0 2023-05-11T07:36:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.488+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a740cd9b0 con 0x7f3a740b52a0 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.489+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a740b8bb0 con 0x7f3a740b52a0 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.490+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a640075e0 con 0x7f3a740b52a0 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.490+0000 7f3a6b7fe700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 0x7f3a5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.490+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a64088b60 con 0x7f3a740b52a0 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.491+0000 7f3a6bfff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 0x7f3a5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.491+0000 7f3a6bfff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 0x7f3a5406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.495+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a64053920 con 0x7f3a740b52a0 2023-05-11T07:36:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.733+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a7415ced0 con 0x7f3a740b52a0 2023-05-11T07:36:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.733+0000 7f3a6b7fe700 1 -- 172.21.15.144:0/1510714994 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f3a64017090 con 0x7f3a740b52a0 2023-05-11T07:36:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:07.737 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:36:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 msgr2=0x7f3a5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 0x7f3a5406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c01c040 comp rx=0 tx=0).stop 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 msgr2=0x7f3a741f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c4d0 tx=0x7f3a6400c890 comp rx=0 tx=0).stop 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 shutdown_connections 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3a5406ace0 0x7f3a5406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a740d02c0 0x7f3a74156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a740b52a0 0x7f3a741f1e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 --2- 172.21.15.144:0/1510714994 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a740b87e0 0x7f3a741f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 >> 172.21.15.144:0/1510714994 conn(0x7f3a7406acf0 msgr2=0x7f3a740d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 shutdown_connections 2023-05-11T07:36:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.736+0000 7f3a795ff700 1 -- 172.21.15.144:0/1510714994 wait complete. 2023-05-11T07:36:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:36:07.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:07.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.938+0000 7fcdd09ff700 1 Processor -- start 2023-05-11T07:36:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.938+0000 7fcdd09ff700 1 -- start start 2023-05-11T07:36:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcdcc0b87e0 0x7fcdcc0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0d2090 0x7fcdcc0d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b5a80 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0cdf70 con 0x7fcdcc0b87e0 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdd09ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0cfe70 con 0x7fcdcc0d2090 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdc3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdc3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41518/0 (socket says 172.21.15.144:41518) 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3510097592 learned_addr learned my addr 172.21.15.144:0/3510097592 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdca59c700 1 --2- 172.21.15.144:0/3510097592 >> v2:172.21.15.145:3300/0 conn(0x7fcdcc0b87e0 0x7fcdcc0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdcad9d700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0d2090 0x7fcdcc0d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.940+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3510097592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0d2090 msgr2=0x7fcdcc0d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:07.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0d2090 0x7fcdcc0d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3510097592 >> v2:172.21.15.145:3300/0 conn(0x7fcdcc0b87e0 msgr2=0x7fcdcc0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:07.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3510097592 >> v2:172.21.15.145:3300/0 conn(0x7fcdcc0b87e0 0x7fcdcc0b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3510097592 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc15cef0 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0b5cb0 tx=0x7fcdb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b627a054ee97a6d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc9d9b700 1 -- 172.21.15.144:0/3510097592 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4011830 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc9d9b700 1 -- 172.21.15.144:0/3510097592 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb4011990 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.941+0000 7fcdc9d9b700 1 -- 172.21.15.144:0/3510097592 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4011d20 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3510097592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 msgr2=0x7fcdcc0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0b5cb0 tx=0x7fcdb4009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3510097592 shutdown_connections 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0d2090 0x7fcdcc0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3510097592 >> v2:172.21.15.145:3300/0 conn(0x7fcdcc0b87e0 0x7fcdcc0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3510097592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0b50d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3510097592 >> 172.21.15.144:0/3510097592 conn(0x7fcdcc06acf0 msgr2=0x7fcdcc06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:07.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3510097592 shutdown_connections 2023-05-11T07:36:07.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.942+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3510097592 wait complete. 2023-05-11T07:36:07.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.943+0000 7fcdd09ff700 1 Processor -- start 2023-05-11T07:36:07.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.943+0000 7fcdd09ff700 1 -- start start 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 0x7fcdcc147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 0x7fcdcc0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0cb950 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc147870 con 0x7fcdcc0d2090 2023-05-11T07:36:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.944+0000 7fcdd09ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0cb390 con 0x7fcdcc0b87e0 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdca59c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 0x7fcdcc147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdcad9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 0x7fcdcc0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdca59c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 0x7fcdcc147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52040/0 (socket says 172.21.15.144:52040) 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdca59c700 1 -- 172.21.15.144:0/3884291566 learned_addr learned my addr 172.21.15.144:0/3884291566 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41522/0 (socket says 172.21.15.144:41522) 2023-05-11T07:36:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 msgr2=0x7fcdcc147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 0x7fcdcc147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 msgr2=0x7fcdcc0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 0x7fcdcc0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 -- 172.21.15.144:0/3884291566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4009550 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdcad9d700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 0x7fcdcc0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.945+0000 7fcdc3fff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4016000 tx=0x7fcdb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.946+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4004240 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.946+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb401f070 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.946+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40045e0 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.946+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0d2d30 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.946+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc0cd760 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.947+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc0cd9b0 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.948+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdb4021030 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.949+0000 7fcdc2ffd700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 0x7fcdac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.949+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdb408a7b0 con 0x7fcdcc0d02c0 2023-05-11T07:36:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.949+0000 7fcdca59c700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 0x7fcdac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.950+0000 7fcdca59c700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 0x7fcdac06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009c20 tx=0x7fcdbc009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:07.954+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcdb4055560 con 0x7fcdcc0d02c0 2023-05-11T07:36:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.152+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdcc15ced0 con 0x7fcdcc0d02c0 2023-05-11T07:36:08.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.154+0000 7fcdc2ffd700 1 -- 172.21.15.144:0/3884291566 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fcdb4058b80 con 0x7fcdcc0d02c0 2023-05-11T07:36:08.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:08.158 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 msgr2=0x7fcdac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 0x7fcdac06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009c20 tx=0x7fcdbc009210 comp rx=0 tx=0).stop 2023-05-11T07:36:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 msgr2=0x7fcdcc0c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4016000 tx=0x7fcdb4004750 comp rx=0 tx=0).stop 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 shutdown_connections 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fcdac06ace0 0x7fcdac06d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcdcc0b87e0 0x7fcdcc147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcdcc0d2090 0x7fcdcc0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 --2- 172.21.15.144:0/3884291566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc0d02c0 0x7fcdcc0c94e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.156+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 >> 172.21.15.144:0/3884291566 conn(0x7fcdcc06acf0 msgr2=0x7fcdcc0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.157+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 shutdown_connections 2023-05-11T07:36:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.157+0000 7fcdd09ff700 1 -- 172.21.15.144:0/3884291566 wait complete. 2023-05-11T07:36:08.178 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-11T07:36:08.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:36:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.358+0000 7f21f89ff700 1 Processor -- start 2023-05-11T07:36:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.358+0000 7f21f89ff700 1 -- start start 2023-05-11T07:36:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f89ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f21f415cea0 0x7f21f40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21f406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f89ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40aca00 con 0x7f21f415a440 2023-05-11T07:36:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f89ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f406ac90 con 0x7f21f415cea0 2023-05-11T07:36:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f415a810 con 0x7f21f406a2d0 2023-05-11T07:36:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f21f415a440 0x7f21f40adf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40696/0 (socket says 172.21.15.144:40696) 2023-05-11T07:36:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f259c700 1 -- 172.21.15.144:0/1053567654 learned_addr learned my addr 172.21.15.144:0/1053567654 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504188935 0 0) 0x7f21f40aca00 con 0x7f21f415a440 2023-05-11T07:36:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e00035b0 con 0x7f21f415a440 2023-05-11T07:36:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21ebfff700 1 --2- 172.21.15.144:0/1053567654 >> v2:172.21.15.145:3300/0 conn(0x7f21f415cea0 0x7f21f40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.360+0000 7f21f2d9d700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21f406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1495033265 0 0) 0x7f21e00035b0 con 0x7f21f415a440 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 msgr2=0x7f21f406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21f406a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 >> v2:172.21.15.145:3300/0 conn(0x7f21f415cea0 msgr2=0x7f21f40c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 --2- 172.21.15.144:0/1053567654 >> v2:172.21.15.145:3300/0 conn(0x7f21f415cea0 0x7f21f40c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f415d460 con 0x7f21f415a440 2023-05-11T07:36:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f21e4001670 con 0x7f21f415a440 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 >> v1:172.21.15.144:6789/0 conn(0x7f21f415a440 legacy=0x7f21f40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0003a00 0x7f21e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e0004850 0x7f21e0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21e0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f406ac90 con 0x7f21e0004850 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f415a810 con 0x7f21e0003a00 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e000ba10 con 0x7f21f406a2d0 2023-05-11T07:36:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e0004850 0x7f21e0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f2d9d700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21e0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21f259c700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0003a00 0x7f21e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 -- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 msgr2=0x7f21e0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f406a2d0 0x7f21e0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 -- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0003a00 msgr2=0x7f21e0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0003a00 0x7f21e0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.361+0000 7f21ebfff700 1 -- 172.21.15.144:0/1053567654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00035b0 con 0x7f21e0004850 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21ebfff700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e0004850 0x7f21e0004cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b90 tx=0x7f21e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3d3c26937cbf8a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00e6c0 con 0x7f21e0004850 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00e820 con 0x7f21e0004850 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f1d9b700 1 -- 172.21.15.144:0/1053567654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00eb90 con 0x7f21e0004850 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f89ff700 1 -- 172.21.15.144:0/1053567654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e0004850 msgr2=0x7f21e0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f89ff700 1 --2- 172.21.15.144:0/1053567654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e0004850 0x7f21e0004cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b90 tx=0x7f21e0005880 comp rx=0 tx=0).stop 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f2d9d700 1 -- 172.21.15.144:0/1053567654 reap_dead start 2023-05-11T07:36:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f89ff700 1 -- 172.21.15.144:0/1053567654 shutdown_connections 2023-05-11T07:36:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.362+0000 7f21f89ff700 1 -- 172.21.15.144:0/1053567654 >> 172.21.15.144:0/1053567654 conn(0x7f21f40cb7e0 msgr2=0x7f21f40cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.363+0000 7f21f89ff700 1 -- 172.21.15.144:0/1053567654 shutdown_connections 2023-05-11T07:36:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.363+0000 7f21f89ff700 1 -- 172.21.15.144:0/1053567654 wait complete. 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.364+0000 7f21f89ff700 1 Processor -- start 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.364+0000 7f21f89ff700 1 -- start start 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 0x7f21f40b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f414a440 0x7f21f40aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f415cbc0 con 0x7f21f40b2d80 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f414a8e0 con 0x7f21e0004850 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21f89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40b3220 con 0x7f21f414a440 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.365+0000 7f21ebfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41540/0 (socket says 172.21.15.144:41540) 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 -- 172.21.15.144:0/4272759810 learned_addr learned my addr 172.21.15.144:0/4272759810 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21f2d9d700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f414a440 0x7f21f40aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21f259c700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 0x7f21f40b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 -- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f414a440 msgr2=0x7f21f40aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f414a440 0x7f21f40aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 -- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 msgr2=0x7f21f40b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 0x7f21f40b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 -- 172.21.15.144:0/4272759810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f415da20 con 0x7f21f40b2d80 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21f259c700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 0x7f21f40b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21ebfff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21e00046c0 tx=0x7f21dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00e6c0 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc003ad0 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc003e80 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.366+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f415d740 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.367+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f415dd00 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.368+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f40b4110 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.368+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21dc013470 con 0x7f21f40b2d80 2023-05-11T07:36:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.369+0000 7f21eaffd700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 0x7f21d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.369+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f21dc08b190 con 0x7f21f40b2d80 2023-05-11T07:36:08.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.369+0000 7f21f259c700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 0x7f21d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.370+0000 7f21f259c700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 0x7f21d406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000fb0 tx=0x7f21e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.373+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f21dc055fe0 con 0x7f21f40b2d80 2023-05-11T07:36:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.566+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21f415cbc0 con 0x7f21d406ace0 2023-05-11T07:36:08.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.579+0000 7f21eaffd700 1 -- 172.21.15.144:0/4272759810 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367325 (secure 0 0 0) 0x7f21f415cbc0 con 0x7f21d406ace0 2023-05-11T07:36:08.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 msgr2=0x7f21d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 0x7f21d406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000fb0 tx=0x7f21e4009040 comp rx=0 tx=0).stop 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 msgr2=0x7f21f415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21e00046c0 tx=0x7f21dc0047c0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 shutdown_connections 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f21d406ace0 0x7f21d406d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f21f414a440 0x7f21f40aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f21e0004850 0x7f21f40b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 --2- 172.21.15.144:0/4272759810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21f40b2d80 0x7f21f415c680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 >> 172.21.15.144:0/4272759810 conn(0x7f21f40cb7e0 msgr2=0x7f21f406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 shutdown_connections 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.584+0000 7f21f89ff700 1 -- 172.21.15.144:0/4272759810 wait complete. 2023-05-11T07:36:08.590 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:36:08.605 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-11T07:36:07.718914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2146888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003035"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089760+0000","last_change":"2023-05-11T07:35:40.003263+0000","last_active":"2023-05-11T07:35:45.089760+0000","last_peered":"2023-05-11T07:35:45.089760+0000","last_clean":"2023-05-11T07:35:45.089760+0000","last_became_active":"2023-05-11T07:35:40.002990+0000","last_became_peered":"2023-05-11T07:35:40.002990+0000","last_unstale":"2023-05-11T07:35:45.089760+0000","last_undegraded":"2023-05-11T07:35:45.089760+0000","last_fullsized":"2023-05-11T07:35:45.089760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:47:49.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015531+0000","last_change":"2023-05-11T07:35:40.026566+0000","last_active":"2023-05-11T07:35:45.015531+0000","last_peered":"2023-05-11T07:35:45.015531+0000","last_clean":"2023-05-11T07:35:45.015531+0000","last_became_active":"2023-05-11T07:35:40.026251+0000","last_became_peered":"2023-05-11T07:35:40.026251+0000","last_unstale":"2023-05-11T07:35:45.015531+0000","last_undegraded":"2023-05-11T07:35:45.015531+0000","last_fullsized":"2023-05-11T07:35:45.015531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:55:14.716226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562178+0000","last_change":"2023-05-11T07:35:40.017456+0000","last_active":"2023-05-11T07:35:47.562178+0000","last_peered":"2023-05-11T07:35:47.562178+0000","last_clean":"2023-05-11T07:35:47.562178+0000","last_became_active":"2023-05-11T07:35:40.017116+0000","last_became_peered":"2023-05-11T07:35:40.017116+0000","last_unstale":"2023-05-11T07:35:47.562178+0000","last_undegraded":"2023-05-11T07:35:47.562178+0000","last_fullsized":"2023-05-11T07:35:47.562178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:56.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891706+0000","last_change":"2023-05-11T07:35:40.015700+0000","last_active":"2023-05-11T07:35:46.891706+0000","last_peered":"2023-05-11T07:35:46.891706+0000","last_clean":"2023-05-11T07:35:46.891706+0000","last_became_active":"2023-05-11T07:35:40.015379+0000","last_became_peered":"2023-05-11T07:35:40.015379+0000","last_unstale":"2023-05-11T07:35:46.891706+0000","last_undegraded":"2023-05-11T07:35:46.891706+0000","last_fullsized":"2023-05-11T07:35:46.891706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:18:19.207636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517497+0000","last_change":"2023-05-11T07:35:40.017874+0000","last_active":"2023-05-11T07:35:44.517497+0000","last_peered":"2023-05-11T07:35:44.517497+0000","last_clean":"2023-05-11T07:35:44.517497+0000","last_became_active":"2023-05-11T07:35:40.017633+0000","last_became_peered":"2023-05-11T07:35:40.017633+0000","last_unstale":"2023-05-11T07:35:44.517497+0000","last_undegraded":"2023-05-11T07:35:44.517497+0000","last_fullsized":"2023-05-11T07:35:44.517497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561892+0000","last_change":"2023-05-11T07:35:40.019837+0000","last_active":"2023-05-11T07:35:47.561892+0000","last_peered":"2023-05-11T07:35:47.561892+0000","last_clean":"2023-05-11T07:35:47.561892+0000","last_became_active":"2023-05-11T07:35:40.019582+0000","last_became_peered":"2023-05-11T07:35:40.019582+0000","last_unstale":"2023-05-11T07:35:47.561892+0000","last_undegraded":"2023-05-11T07:35:47.561892+0000","last_fullsized":"2023-05-11T07:35:47.561892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:04:10.251391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518855+0000","last_change":"2023-05-11T07:35:40.019621+0000","last_active":"2023-05-11T07:35:44.518855+0000","last_peered":"2023-05-11T07:35:44.518855+0000","last_clean":"2023-05-11T07:35:44.518855+0000","last_became_active":"2023-05-11T07:35:40.019325+0000","last_became_peered":"2023-05-11T07:35:40.019325+0000","last_unstale":"2023-05-11T07:35:44.518855+0000","last_undegraded":"2023-05-11T07:35:44.518855+0000","last_fullsized":"2023-05-11T07:35:44.518855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:11.547662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014908+0000","last_change":"2023-05-11T07:35:40.026209+0000","last_active":"2023-05-11T07:35:45.014908+0000","last_peered":"2023-05-11T07:35:45.014908+0000","last_clean":"2023-05-11T07:35:45.014908+0000","last_became_active":"2023-05-11T07:35:40.025835+0000","last_became_peered":"2023-05-11T07:35:40.025835+0000","last_unstale":"2023-05-11T07:35:45.014908+0000","last_undegraded":"2023-05-11T07:35:45.014908+0000","last_fullsized":"2023-05-11T07:35:45.014908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:35.384590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516451+0000","last_change":"2023-05-11T07:35:40.027053+0000","last_active":"2023-05-11T07:35:44.516451+0000","last_peered":"2023-05-11T07:35:44.516451+0000","last_clean":"2023-05-11T07:35:44.516451+0000","last_became_active":"2023-05-11T07:35:40.026802+0000","last_became_peered":"2023-05-11T07:35:40.026802+0000","last_unstale":"2023-05-11T07:35:44.516451+0000","last_undegraded":"2023-05-11T07:35:44.516451+0000","last_fullsized":"2023-05-11T07:35:44.516451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015789+0000","last_change":"2023-05-11T07:35:40.028043+0000","last_active":"2023-05-11T07:35:45.015789+0000","last_peered":"2023-05-11T07:35:45.015789+0000","last_clean":"2023-05-11T07:35:45.015789+0000","last_became_active":"2023-05-11T07:35:40.027745+0000","last_became_peered":"2023-05-11T07:35:40.027745+0000","last_unstale":"2023-05-11T07:35:45.015789+0000","last_undegraded":"2023-05-11T07:35:45.015789+0000","last_fullsized":"2023-05-11T07:35:45.015789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:43.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562271+0000","last_change":"2023-05-11T07:35:40.021833+0000","last_active":"2023-05-11T07:35:47.562271+0000","last_peered":"2023-05-11T07:35:47.562271+0000","last_clean":"2023-05-11T07:35:47.562271+0000","last_became_active":"2023-05-11T07:35:40.021555+0000","last_became_peered":"2023-05-11T07:35:40.021555+0000","last_unstale":"2023-05-11T07:35:47.562271+0000","last_undegraded":"2023-05-11T07:35:47.562271+0000","last_fullsized":"2023-05-11T07:35:47.562271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:28.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089711+0000","last_change":"2023-05-11T07:35:40.008540+0000","last_active":"2023-05-11T07:35:45.089711+0000","last_peered":"2023-05-11T07:35:45.089711+0000","last_clean":"2023-05-11T07:35:45.089711+0000","last_became_active":"2023-05-11T07:35:40.008085+0000","last_became_peered":"2023-05-11T07:35:40.008085+0000","last_unstale":"2023-05-11T07:35:45.089711+0000","last_undegraded":"2023-05-11T07:35:45.089711+0000","last_fullsized":"2023-05-11T07:35:45.089711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:02:06.990407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089645+0000","last_change":"2023-05-11T07:35:40.003691+0000","last_active":"2023-05-11T07:35:45.089645+0000","last_peered":"2023-05-11T07:35:45.089645+0000","last_clean":"2023-05-11T07:35:45.089645+0000","last_became_active":"2023-05-11T07:35:40.003340+0000","last_became_peered":"2023-05-11T07:35:40.003340+0000","last_unstale":"2023-05-11T07:35:45.089645+0000","last_undegraded":"2023-05-11T07:35:45.089645+0000","last_fullsized":"2023-05-11T07:35:45.089645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:40.739929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014917+0000","last_change":"2023-05-11T07:35:40.023425+0000","last_active":"2023-05-11T07:35:45.014917+0000","last_peered":"2023-05-11T07:35:45.014917+0000","last_clean":"2023-05-11T07:35:45.014917+0000","last_became_active":"2023-05-11T07:35:40.023149+0000","last_became_peered":"2023-05-11T07:35:40.023149+0000","last_unstale":"2023-05-11T07:35:45.014917+0000","last_undegraded":"2023-05-11T07:35:45.014917+0000","last_fullsized":"2023-05-11T07:35:45.014917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:57.291650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517873+0000","last_change":"2023-05-11T07:35:40.019674+0000","last_active":"2023-05-11T07:35:44.517873+0000","last_peered":"2023-05-11T07:35:44.517873+0000","last_clean":"2023-05-11T07:35:44.517873+0000","last_became_active":"2023-05-11T07:35:40.019341+0000","last_became_peered":"2023-05-11T07:35:40.019341+0000","last_unstale":"2023-05-11T07:35:44.517873+0000","last_undegraded":"2023-05-11T07:35:44.517873+0000","last_fullsized":"2023-05-11T07:35:44.517873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561553+0000","last_change":"2023-05-11T07:35:40.017375+0000","last_active":"2023-05-11T07:35:47.561553+0000","last_peered":"2023-05-11T07:35:47.561553+0000","last_clean":"2023-05-11T07:35:47.561553+0000","last_became_active":"2023-05-11T07:35:40.017066+0000","last_became_peered":"2023-05-11T07:35:40.017066+0000","last_unstale":"2023-05-11T07:35:47.561553+0000","last_undegraded":"2023-05-11T07:35:47.561553+0000","last_fullsized":"2023-05-11T07:35:47.561553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:30:12.395814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516538+0000","last_change":"2023-05-11T07:35:40.028493+0000","last_active":"2023-05-11T07:35:44.516538+0000","last_peered":"2023-05-11T07:35:44.516538+0000","last_clean":"2023-05-11T07:35:44.516538+0000","last_became_active":"2023-05-11T07:35:40.028204+0000","last_became_peered":"2023-05-11T07:35:40.028204+0000","last_unstale":"2023-05-11T07:35:44.516538+0000","last_undegraded":"2023-05-11T07:35:44.516538+0000","last_fullsized":"2023-05-11T07:35:44.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:26.521370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562117+0000","last_change":"2023-05-11T07:35:40.014959+0000","last_active":"2023-05-11T07:35:47.562117+0000","last_peered":"2023-05-11T07:35:47.562117+0000","last_clean":"2023-05-11T07:35:47.562117+0000","last_became_active":"2023-05-11T07:35:40.014689+0000","last_became_peered":"2023-05-11T07:35:40.014689+0000","last_unstale":"2023-05-11T07:35:47.562117+0000","last_undegraded":"2023-05-11T07:35:47.562117+0000","last_fullsized":"2023-05-11T07:35:47.562117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:42.131185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089549+0000","last_change":"2023-05-11T07:35:40.001699+0000","last_active":"2023-05-11T07:35:45.089549+0000","last_peered":"2023-05-11T07:35:45.089549+0000","last_clean":"2023-05-11T07:35:45.089549+0000","last_became_active":"2023-05-11T07:35:40.001449+0000","last_became_peered":"2023-05-11T07:35:40.001449+0000","last_unstale":"2023-05-11T07:35:45.089549+0000","last_undegraded":"2023-05-11T07:35:45.089549+0000","last_fullsized":"2023-05-11T07:35:45.089549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:39:10.961995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561455+0000","last_change":"2023-05-11T07:35:40.023713+0000","last_active":"2023-05-11T07:35:47.561455+0000","last_peered":"2023-05-11T07:35:47.561455+0000","last_clean":"2023-05-11T07:35:47.561455+0000","last_became_active":"2023-05-11T07:35:40.023403+0000","last_became_peered":"2023-05-11T07:35:40.023403+0000","last_unstale":"2023-05-11T07:35:47.561455+0000","last_undegraded":"2023-05-11T07:35:47.561455+0000","last_fullsized":"2023-05-11T07:35:47.561455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:51:38.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518306+0000","last_change":"2023-05-11T07:35:40.019898+0000","last_active":"2023-05-11T07:35:44.518306+0000","last_peered":"2023-05-11T07:35:44.518306+0000","last_clean":"2023-05-11T07:35:44.518306+0000","last_became_active":"2023-05-11T07:35:40.019650+0000","last_became_peered":"2023-05-11T07:35:40.019650+0000","last_unstale":"2023-05-11T07:35:44.518306+0000","last_undegraded":"2023-05-11T07:35:44.518306+0000","last_fullsized":"2023-05-11T07:35:44.518306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516495+0000","last_change":"2023-05-11T07:35:40.018256+0000","last_active":"2023-05-11T07:35:44.516495+0000","last_peered":"2023-05-11T07:35:44.516495+0000","last_clean":"2023-05-11T07:35:44.516495+0000","last_became_active":"2023-05-11T07:35:40.017973+0000","last_became_peered":"2023-05-11T07:35:40.017973+0000","last_unstale":"2023-05-11T07:35:44.516495+0000","last_undegraded":"2023-05-11T07:35:44.516495+0000","last_fullsized":"2023-05-11T07:35:44.516495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:53.607196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.015426+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.015144+0000","last_became_peered":"2023-05-11T07:35:40.015144+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518102+0000","last_change":"2023-05-11T07:35:40.029940+0000","last_active":"2023-05-11T07:35:44.518102+0000","last_peered":"2023-05-11T07:35:44.518102+0000","last_clean":"2023-05-11T07:35:44.518102+0000","last_became_active":"2023-05-11T07:35:40.029761+0000","last_became_peered":"2023-05-11T07:35:40.029761+0000","last_unstale":"2023-05-11T07:35:44.518102+0000","last_undegraded":"2023-05-11T07:35:44.518102+0000","last_fullsized":"2023-05-11T07:35:44.518102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004787+0000","last_change":"2023-05-11T07:35:40.016915+0000","last_active":"2023-05-11T07:35:45.004787+0000","last_peered":"2023-05-11T07:35:45.004787+0000","last_clean":"2023-05-11T07:35:45.004787+0000","last_became_active":"2023-05-11T07:35:40.016633+0000","last_became_peered":"2023-05-11T07:35:40.016633+0000","last_unstale":"2023-05-11T07:35:45.004787+0000","last_undegraded":"2023-05-11T07:35:45.004787+0000","last_fullsized":"2023-05-11T07:35:45.004787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:02.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004835+0000","last_change":"2023-05-11T07:35:40.014665+0000","last_active":"2023-05-11T07:35:45.004835+0000","last_peered":"2023-05-11T07:35:45.004835+0000","last_clean":"2023-05-11T07:35:45.004835+0000","last_became_active":"2023-05-11T07:35:40.013282+0000","last_became_peered":"2023-05-11T07:35:40.013282+0000","last_unstale":"2023-05-11T07:35:45.004835+0000","last_undegraded":"2023-05-11T07:35:45.004835+0000","last_fullsized":"2023-05-11T07:35:45.004835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015640+0000","last_change":"2023-05-11T07:35:40.028278+0000","last_active":"2023-05-11T07:35:45.015640+0000","last_peered":"2023-05-11T07:35:45.015640+0000","last_clean":"2023-05-11T07:35:45.015640+0000","last_became_active":"2023-05-11T07:35:40.027965+0000","last_became_peered":"2023-05-11T07:35:40.027965+0000","last_unstale":"2023-05-11T07:35:45.015640+0000","last_undegraded":"2023-05-11T07:35:45.015640+0000","last_fullsized":"2023-05-11T07:35:45.015640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:25.486990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561879+0000","last_change":"2023-05-11T07:35:44.058122+0000","last_active":"2023-05-11T07:35:47.561879+0000","last_peered":"2023-05-11T07:35:47.561879+0000","last_clean":"2023-05-11T07:35:47.561879+0000","last_became_active":"2023-05-11T07:35:44.057702+0000","last_became_peered":"2023-05-11T07:35:44.057702+0000","last_unstale":"2023-05-11T07:35:47.561879+0000","last_undegraded":"2023-05-11T07:35:47.561879+0000","last_fullsized":"2023-05-11T07:35:47.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:36:05.616117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560688+0000","last_change":"2023-05-11T07:35:39.525251+0000","last_active":"2023-05-11T07:35:47.560688+0000","last_peered":"2023-05-11T07:35:47.560688+0000","last_clean":"2023-05-11T07:35:47.560688+0000","last_became_active":"2023-05-11T07:35:39.523877+0000","last_became_peered":"2023-05-11T07:35:39.523877+0000","last_unstale":"2023-05-11T07:35:47.560688+0000","last_undegraded":"2023-05-11T07:35:47.560688+0000","last_fullsized":"2023-05-11T07:35:47.560688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:53.446198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561824+0000","last_change":"2023-05-11T07:35:40.004593+0000","last_active":"2023-05-11T07:35:47.561824+0000","last_peered":"2023-05-11T07:35:47.561824+0000","last_clean":"2023-05-11T07:35:47.561824+0000","last_became_active":"2023-05-11T07:35:40.004302+0000","last_became_peered":"2023-05-11T07:35:40.004302+0000","last_unstale":"2023-05-11T07:35:47.561824+0000","last_undegraded":"2023-05-11T07:35:47.561824+0000","last_fullsized":"2023-05-11T07:35:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:02.707221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891981+0000","last_change":"2023-05-11T07:35:44.049215+0000","last_active":"2023-05-11T07:35:46.891981+0000","last_peered":"2023-05-11T07:35:46.891981+0000","last_clean":"2023-05-11T07:35:46.891981+0000","last_became_active":"2023-05-11T07:35:44.048856+0000","last_became_peered":"2023-05-11T07:35:44.048856+0000","last_unstale":"2023-05-11T07:35:46.891981+0000","last_undegraded":"2023-05-11T07:35:46.891981+0000","last_fullsized":"2023-05-11T07:35:46.891981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:59:50.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.003945+0000","last_change":"2023-05-11T07:35:39.522351+0000","last_active":"2023-05-11T07:35:45.003945+0000","last_peered":"2023-05-11T07:35:45.003945+0000","last_clean":"2023-05-11T07:35:45.003945+0000","last_became_active":"2023-05-11T07:35:39.522056+0000","last_became_peered":"2023-05-11T07:35:39.522056+0000","last_unstale":"2023-05-11T07:35:45.003945+0000","last_undegraded":"2023-05-11T07:35:45.003945+0000","last_fullsized":"2023-05-11T07:35:45.003945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:47:55.321727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516630+0000","last_change":"2023-05-11T07:35:40.027281+0000","last_active":"2023-05-11T07:35:44.516630+0000","last_peered":"2023-05-11T07:35:44.516630+0000","last_clean":"2023-05-11T07:35:44.516630+0000","last_became_active":"2023-05-11T07:35:40.026683+0000","last_became_peered":"2023-05-11T07:35:40.026683+0000","last_unstale":"2023-05-11T07:35:44.516630+0000","last_undegraded":"2023-05-11T07:35:44.516630+0000","last_fullsized":"2023-05-11T07:35:44.516630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516623+0000","last_change":"2023-05-11T07:35:44.045971+0000","last_active":"2023-05-11T07:35:44.516623+0000","last_peered":"2023-05-11T07:35:44.516623+0000","last_clean":"2023-05-11T07:35:44.516623+0000","last_became_active":"2023-05-11T07:35:44.045617+0000","last_became_peered":"2023-05-11T07:35:44.045617+0000","last_unstale":"2023-05-11T07:35:44.516623+0000","last_undegraded":"2023-05-11T07:35:44.516623+0000","last_fullsized":"2023-05-11T07:35:44.516623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:57.332534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560634+0000","last_change":"2023-05-11T07:35:39.521019+0000","last_active":"2023-05-11T07:35:47.560634+0000","last_peered":"2023-05-11T07:35:47.560634+0000","last_clean":"2023-05-11T07:35:47.560634+0000","last_became_active":"2023-05-11T07:35:39.520725+0000","last_became_peered":"2023-05-11T07:35:39.520725+0000","last_unstale":"2023-05-11T07:35:47.560634+0000","last_undegraded":"2023-05-11T07:35:47.560634+0000","last_fullsized":"2023-05-11T07:35:47.560634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.892105+0000","last_change":"2023-05-11T07:35:40.028356+0000","last_active":"2023-05-11T07:35:46.892105+0000","last_peered":"2023-05-11T07:35:46.892105+0000","last_clean":"2023-05-11T07:35:46.892105+0000","last_became_active":"2023-05-11T07:35:40.028139+0000","last_became_peered":"2023-05-11T07:35:40.028139+0000","last_unstale":"2023-05-11T07:35:46.892105+0000","last_undegraded":"2023-05-11T07:35:46.892105+0000","last_fullsized":"2023-05-11T07:35:46.892105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:09:08.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:44.048081+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:44.047704+0000","last_became_peered":"2023-05-11T07:35:44.047704+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:27.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516590+0000","last_change":"2023-05-11T07:35:39.524366+0000","last_active":"2023-05-11T07:35:44.516590+0000","last_peered":"2023-05-11T07:35:44.516590+0000","last_clean":"2023-05-11T07:35:44.516590+0000","last_became_active":"2023-05-11T07:35:39.523956+0000","last_became_peered":"2023-05-11T07:35:39.523956+0000","last_unstale":"2023-05-11T07:35:44.516590+0000","last_undegraded":"2023-05-11T07:35:44.516590+0000","last_fullsized":"2023-05-11T07:35:44.516590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:49.699791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561237+0000","last_change":"2023-05-11T07:35:40.004665+0000","last_active":"2023-05-11T07:35:47.561237+0000","last_peered":"2023-05-11T07:35:47.561237+0000","last_clean":"2023-05-11T07:35:47.561237+0000","last_became_active":"2023-05-11T07:35:40.004422+0000","last_became_peered":"2023-05-11T07:35:40.004422+0000","last_unstale":"2023-05-11T07:35:47.561237+0000","last_undegraded":"2023-05-11T07:35:47.561237+0000","last_fullsized":"2023-05-11T07:35:47.561237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517909+0000","last_change":"2023-05-11T07:35:44.059577+0000","last_active":"2023-05-11T07:35:44.517909+0000","last_peered":"2023-05-11T07:35:44.517909+0000","last_clean":"2023-05-11T07:35:44.517909+0000","last_became_active":"2023-05-11T07:35:44.058668+0000","last_became_peered":"2023-05-11T07:35:44.058668+0000","last_unstale":"2023-05-11T07:35:44.517909+0000","last_undegraded":"2023-05-11T07:35:44.517909+0000","last_fullsized":"2023-05-11T07:35:44.517909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:06.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015648+0000","last_change":"2023-05-11T07:35:39.516925+0000","last_active":"2023-05-11T07:35:45.015648+0000","last_peered":"2023-05-11T07:35:45.015648+0000","last_clean":"2023-05-11T07:35:45.015648+0000","last_became_active":"2023-05-11T07:35:39.516579+0000","last_became_peered":"2023-05-11T07:35:39.516579+0000","last_unstale":"2023-05-11T07:35:45.015648+0000","last_undegraded":"2023-05-11T07:35:45.015648+0000","last_fullsized":"2023-05-11T07:35:45.015648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:48:28.388729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560769+0000","last_change":"2023-05-11T07:35:40.020195+0000","last_active":"2023-05-11T07:35:47.560769+0000","last_peered":"2023-05-11T07:35:47.560769+0000","last_clean":"2023-05-11T07:35:47.560769+0000","last_became_active":"2023-05-11T07:35:40.020000+0000","last_became_peered":"2023-05-11T07:35:40.020000+0000","last_unstale":"2023-05-11T07:35:47.560769+0000","last_undegraded":"2023-05-11T07:35:47.560769+0000","last_fullsized":"2023-05-11T07:35:47.560769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561713+0000","last_change":"2023-05-11T07:35:44.046341+0000","last_active":"2023-05-11T07:35:47.561713+0000","last_peered":"2023-05-11T07:35:47.561713+0000","last_clean":"2023-05-11T07:35:47.561713+0000","last_became_active":"2023-05-11T07:35:44.045931+0000","last_became_peered":"2023-05-11T07:35:44.045931+0000","last_unstale":"2023-05-11T07:35:47.561713+0000","last_undegraded":"2023-05-11T07:35:47.561713+0000","last_fullsized":"2023-05-11T07:35:47.561713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:43:00.804549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518863+0000","last_change":"2023-05-11T07:35:39.522292+0000","last_active":"2023-05-11T07:35:44.518863+0000","last_peered":"2023-05-11T07:35:44.518863+0000","last_clean":"2023-05-11T07:35:44.518863+0000","last_became_active":"2023-05-11T07:35:39.522044+0000","last_became_peered":"2023-05-11T07:35:39.522044+0000","last_unstale":"2023-05-11T07:35:44.518863+0000","last_undegraded":"2023-05-11T07:35:44.518863+0000","last_fullsized":"2023-05-11T07:35:44.518863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004352+0000","last_change":"2023-05-11T07:35:40.006244+0000","last_active":"2023-05-11T07:35:45.004352+0000","last_peered":"2023-05-11T07:35:45.004352+0000","last_clean":"2023-05-11T07:35:45.004352+0000","last_became_active":"2023-05-11T07:35:40.006008+0000","last_became_peered":"2023-05-11T07:35:40.006008+0000","last_unstale":"2023-05-11T07:35:45.004352+0000","last_undegraded":"2023-05-11T07:35:45.004352+0000","last_fullsized":"2023-05-11T07:35:45.004352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004124+0000","last_change":"2023-05-11T07:35:44.050216+0000","last_active":"2023-05-11T07:35:45.004124+0000","last_peered":"2023-05-11T07:35:45.004124+0000","last_clean":"2023-05-11T07:35:45.004124+0000","last_became_active":"2023-05-11T07:35:44.049821+0000","last_became_peered":"2023-05-11T07:35:44.049821+0000","last_unstale":"2023-05-11T07:35:45.004124+0000","last_undegraded":"2023-05-11T07:35:45.004124+0000","last_fullsized":"2023-05-11T07:35:45.004124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:52:59.303972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:58.639060+0000","last_change":"2023-05-11T07:35:39.524270+0000","last_active":"2023-05-11T07:35:58.639060+0000","last_peered":"2023-05-11T07:35:58.639060+0000","last_clean":"2023-05-11T07:35:58.639060+0000","last_became_active":"2023-05-11T07:35:39.523839+0000","last_became_peered":"2023-05-11T07:35:39.523839+0000","last_unstale":"2023-05-11T07:35:58.639060+0000","last_undegraded":"2023-05-11T07:35:58.639060+0000","last_fullsized":"2023-05-11T07:35:58.639060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:22:25.344878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561662+0000","last_change":"2023-05-11T07:35:40.023719+0000","last_active":"2023-05-11T07:35:47.561662+0000","last_peered":"2023-05-11T07:35:47.561662+0000","last_clean":"2023-05-11T07:35:47.561662+0000","last_became_active":"2023-05-11T07:35:40.023383+0000","last_became_peered":"2023-05-11T07:35:40.023383+0000","last_unstale":"2023-05-11T07:35:47.561662+0000","last_undegraded":"2023-05-11T07:35:47.561662+0000","last_fullsized":"2023-05-11T07:35:47.561662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:42.106118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015869+0000","last_change":"2023-05-11T07:35:44.049508+0000","last_active":"2023-05-11T07:35:45.015869+0000","last_peered":"2023-05-11T07:35:45.015869+0000","last_clean":"2023-05-11T07:35:45.015869+0000","last_became_active":"2023-05-11T07:35:44.049065+0000","last_became_peered":"2023-05-11T07:35:44.049065+0000","last_unstale":"2023-05-11T07:35:45.015869+0000","last_undegraded":"2023-05-11T07:35:45.015869+0000","last_fullsized":"2023-05-11T07:35:45.015869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:40.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518317+0000","last_change":"2023-05-11T07:35:39.531094+0000","last_active":"2023-05-11T07:35:44.518317+0000","last_peered":"2023-05-11T07:35:44.518317+0000","last_clean":"2023-05-11T07:35:44.518317+0000","last_became_active":"2023-05-11T07:35:39.530798+0000","last_became_peered":"2023-05-11T07:35:39.530798+0000","last_unstale":"2023-05-11T07:35:44.518317+0000","last_undegraded":"2023-05-11T07:35:44.518317+0000","last_fullsized":"2023-05-11T07:35:44.518317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:35.170874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561870+0000","last_change":"2023-05-11T07:35:40.005168+0000","last_active":"2023-05-11T07:35:47.561870+0000","last_peered":"2023-05-11T07:35:47.561870+0000","last_clean":"2023-05-11T07:35:47.561870+0000","last_became_active":"2023-05-11T07:35:40.004912+0000","last_became_peered":"2023-05-11T07:35:40.004912+0000","last_unstale":"2023-05-11T07:35:47.561870+0000","last_undegraded":"2023-05-11T07:35:47.561870+0000","last_fullsized":"2023-05-11T07:35:47.561870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:42.658238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561731+0000","last_change":"2023-05-11T07:35:44.048532+0000","last_active":"2023-05-11T07:35:47.561731+0000","last_peered":"2023-05-11T07:35:47.561731+0000","last_clean":"2023-05-11T07:35:47.561731+0000","last_became_active":"2023-05-11T07:35:44.048154+0000","last_became_peered":"2023-05-11T07:35:44.048154+0000","last_unstale":"2023-05-11T07:35:47.561731+0000","last_undegraded":"2023-05-11T07:35:47.561731+0000","last_fullsized":"2023-05-11T07:35:47.561731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:15.060562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516352+0000","last_change":"2023-05-11T07:35:39.522998+0000","last_active":"2023-05-11T07:35:44.516352+0000","last_peered":"2023-05-11T07:35:44.516352+0000","last_clean":"2023-05-11T07:35:44.516352+0000","last_became_active":"2023-05-11T07:35:39.522721+0000","last_became_peered":"2023-05-11T07:35:39.522721+0000","last_unstale":"2023-05-11T07:35:44.516352+0000","last_undegraded":"2023-05-11T07:35:44.516352+0000","last_fullsized":"2023-05-11T07:35:44.516352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:33.291889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015465+0000","last_change":"2023-05-11T07:35:40.032638+0000","last_active":"2023-05-11T07:35:45.015465+0000","last_peered":"2023-05-11T07:35:45.015465+0000","last_clean":"2023-05-11T07:35:45.015465+0000","last_became_active":"2023-05-11T07:35:40.032296+0000","last_became_peered":"2023-05-11T07:35:40.032296+0000","last_unstale":"2023-05-11T07:35:45.015465+0000","last_undegraded":"2023-05-11T07:35:45.015465+0000","last_fullsized":"2023-05-11T07:35:45.015465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:42:43.821239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562026+0000","last_change":"2023-05-11T07:35:44.048077+0000","last_active":"2023-05-11T07:35:47.562026+0000","last_peered":"2023-05-11T07:35:47.562026+0000","last_clean":"2023-05-11T07:35:47.562026+0000","last_became_active":"2023-05-11T07:35:44.047653+0000","last_became_peered":"2023-05-11T07:35:44.047653+0000","last_unstale":"2023-05-11T07:35:47.562026+0000","last_undegraded":"2023-05-11T07:35:47.562026+0000","last_fullsized":"2023-05-11T07:35:47.562026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517958+0000","last_change":"2023-05-11T07:35:39.529551+0000","last_active":"2023-05-11T07:35:44.517958+0000","last_peered":"2023-05-11T07:35:44.517958+0000","last_clean":"2023-05-11T07:35:44.517958+0000","last_became_active":"2023-05-11T07:35:39.529219+0000","last_became_peered":"2023-05-11T07:35:39.529219+0000","last_unstale":"2023-05-11T07:35:44.517958+0000","last_undegraded":"2023-05-11T07:35:44.517958+0000","last_fullsized":"2023-05-11T07:35:44.517958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:32.191475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516724+0000","last_change":"2023-05-11T07:35:40.027456+0000","last_active":"2023-05-11T07:35:44.516724+0000","last_peered":"2023-05-11T07:35:44.516724+0000","last_clean":"2023-05-11T07:35:44.516724+0000","last_became_active":"2023-05-11T07:35:40.027006+0000","last_became_peered":"2023-05-11T07:35:40.027006+0000","last_unstale":"2023-05-11T07:35:44.516724+0000","last_undegraded":"2023-05-11T07:35:44.516724+0000","last_fullsized":"2023-05-11T07:35:44.516724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015429+0000","last_change":"2023-05-11T07:35:44.051656+0000","last_active":"2023-05-11T07:35:45.015429+0000","last_peered":"2023-05-11T07:35:45.015429+0000","last_clean":"2023-05-11T07:35:45.015429+0000","last_became_active":"2023-05-11T07:35:44.051177+0000","last_became_peered":"2023-05-11T07:35:44.051177+0000","last_unstale":"2023-05-11T07:35:45.015429+0000","last_undegraded":"2023-05-11T07:35:45.015429+0000","last_fullsized":"2023-05-11T07:35:45.015429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:31:20.083650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891445+0000","last_change":"2023-05-11T07:35:39.525663+0000","last_active":"2023-05-11T07:35:46.891445+0000","last_peered":"2023-05-11T07:35:46.891445+0000","last_clean":"2023-05-11T07:35:46.891445+0000","last_became_active":"2023-05-11T07:35:39.525120+0000","last_became_peered":"2023-05-11T07:35:39.525120+0000","last_unstale":"2023-05-11T07:35:46.891445+0000","last_undegraded":"2023-05-11T07:35:46.891445+0000","last_fullsized":"2023-05-11T07:35:46.891445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:53:41.174416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562065+0000","last_change":"2023-05-11T07:35:40.019244+0000","last_active":"2023-05-11T07:35:47.562065+0000","last_peered":"2023-05-11T07:35:47.562065+0000","last_clean":"2023-05-11T07:35:47.562065+0000","last_became_active":"2023-05-11T07:35:40.018998+0000","last_became_peered":"2023-05-11T07:35:40.018998+0000","last_unstale":"2023-05-11T07:35:47.562065+0000","last_undegraded":"2023-05-11T07:35:47.562065+0000","last_fullsized":"2023-05-11T07:35:47.562065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:35.403397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518703+0000","last_change":"2023-05-11T07:35:44.056854+0000","last_active":"2023-05-11T07:35:44.518703+0000","last_peered":"2023-05-11T07:35:44.518703+0000","last_clean":"2023-05-11T07:35:44.518703+0000","last_became_active":"2023-05-11T07:35:44.056483+0000","last_became_peered":"2023-05-11T07:35:44.056483+0000","last_unstale":"2023-05-11T07:35:44.518703+0000","last_undegraded":"2023-05-11T07:35:44.518703+0000","last_fullsized":"2023-05-11T07:35:44.518703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:38.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518566+0000","last_change":"2023-05-11T07:35:39.529492+0000","last_active":"2023-05-11T07:35:44.518566+0000","last_peered":"2023-05-11T07:35:44.518566+0000","last_clean":"2023-05-11T07:35:44.518566+0000","last_became_active":"2023-05-11T07:35:39.529182+0000","last_became_peered":"2023-05-11T07:35:39.529182+0000","last_unstale":"2023-05-11T07:35:44.518566+0000","last_undegraded":"2023-05-11T07:35:44.518566+0000","last_fullsized":"2023-05-11T07:35:44.518566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:41.677638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014849+0000","last_change":"2023-05-11T07:35:40.029916+0000","last_active":"2023-05-11T07:35:45.014849+0000","last_peered":"2023-05-11T07:35:45.014849+0000","last_clean":"2023-05-11T07:35:45.014849+0000","last_became_active":"2023-05-11T07:35:40.029633+0000","last_became_peered":"2023-05-11T07:35:40.029633+0000","last_unstale":"2023-05-11T07:35:45.014849+0000","last_undegraded":"2023-05-11T07:35:45.014849+0000","last_fullsized":"2023-05-11T07:35:45.014849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089763+0000","last_change":"2023-05-11T07:35:44.046464+0000","last_active":"2023-05-11T07:35:45.089763+0000","last_peered":"2023-05-11T07:35:45.089763+0000","last_clean":"2023-05-11T07:35:45.089763+0000","last_became_active":"2023-05-11T07:35:44.046046+0000","last_became_peered":"2023-05-11T07:35:44.046046+0000","last_unstale":"2023-05-11T07:35:45.089763+0000","last_undegraded":"2023-05-11T07:35:45.089763+0000","last_fullsized":"2023-05-11T07:35:45.089763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:31:21.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518773+0000","last_change":"2023-05-11T07:35:39.529523+0000","last_active":"2023-05-11T07:35:44.518773+0000","last_peered":"2023-05-11T07:35:44.518773+0000","last_clean":"2023-05-11T07:35:44.518773+0000","last_became_active":"2023-05-11T07:35:39.529198+0000","last_became_peered":"2023-05-11T07:35:39.529198+0000","last_unstale":"2023-05-11T07:35:44.518773+0000","last_undegraded":"2023-05-11T07:35:44.518773+0000","last_fullsized":"2023-05-11T07:35:44.518773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:56.284794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561457+0000","last_change":"2023-05-11T07:35:40.021866+0000","last_active":"2023-05-11T07:35:47.561457+0000","last_peered":"2023-05-11T07:35:47.561457+0000","last_clean":"2023-05-11T07:35:47.561457+0000","last_became_active":"2023-05-11T07:35:40.021576+0000","last_became_peered":"2023-05-11T07:35:40.021576+0000","last_unstale":"2023-05-11T07:35:47.561457+0000","last_undegraded":"2023-05-11T07:35:47.561457+0000","last_fullsized":"2023-05-11T07:35:47.561457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:19:05.603259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089718+0000","last_change":"2023-05-11T07:35:44.045836+0000","last_active":"2023-05-11T07:35:45.089718+0000","last_peered":"2023-05-11T07:35:45.089718+0000","last_clean":"2023-05-11T07:35:45.089718+0000","last_became_active":"2023-05-11T07:35:44.045453+0000","last_became_peered":"2023-05-11T07:35:44.045453+0000","last_unstale":"2023-05-11T07:35:45.089718+0000","last_undegraded":"2023-05-11T07:35:45.089718+0000","last_fullsized":"2023-05-11T07:35:45.089718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.845162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518973+0000","last_change":"2023-05-11T07:35:39.526694+0000","last_active":"2023-05-11T07:35:44.518973+0000","last_peered":"2023-05-11T07:35:44.518973+0000","last_clean":"2023-05-11T07:35:44.518973+0000","last_became_active":"2023-05-11T07:35:39.526370+0000","last_became_peered":"2023-05-11T07:35:39.526370+0000","last_unstale":"2023-05-11T07:35:44.518973+0000","last_undegraded":"2023-05-11T07:35:44.518973+0000","last_fullsized":"2023-05-11T07:35:44.518973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:13:59.267692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:40.014209+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:40.013884+0000","last_became_peered":"2023-05-11T07:35:40.013884+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:49:21.339051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089552+0000","last_change":"2023-05-11T07:35:44.050723+0000","last_active":"2023-05-11T07:35:45.089552+0000","last_peered":"2023-05-11T07:35:45.089552+0000","last_clean":"2023-05-11T07:35:45.089552+0000","last_became_active":"2023-05-11T07:35:44.050285+0000","last_became_peered":"2023-05-11T07:35:44.050285+0000","last_unstale":"2023-05-11T07:35:45.089552+0000","last_undegraded":"2023-05-11T07:35:45.089552+0000","last_fullsized":"2023-05-11T07:35:45.089552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:44:48.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015149+0000","last_change":"2023-05-11T07:35:39.506013+0000","last_active":"2023-05-11T07:35:45.015149+0000","last_peered":"2023-05-11T07:35:45.015149+0000","last_clean":"2023-05-11T07:35:45.015149+0000","last_became_active":"2023-05-11T07:35:39.505714+0000","last_became_peered":"2023-05-11T07:35:39.505714+0000","last_unstale":"2023-05-11T07:35:45.015149+0000","last_undegraded":"2023-05-11T07:35:45.015149+0000","last_fullsized":"2023-05-11T07:35:45.015149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:01.700365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517568+0000","last_change":"2023-05-11T07:35:40.018422+0000","last_active":"2023-05-11T07:35:44.517568+0000","last_peered":"2023-05-11T07:35:44.517568+0000","last_clean":"2023-05-11T07:35:44.517568+0000","last_became_active":"2023-05-11T07:35:40.018159+0000","last_became_peered":"2023-05-11T07:35:40.018159+0000","last_unstale":"2023-05-11T07:35:44.517568+0000","last_undegraded":"2023-05-11T07:35:44.517568+0000","last_fullsized":"2023-05-11T07:35:44.517568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089716+0000","last_change":"2023-05-11T07:35:44.047834+0000","last_active":"2023-05-11T07:35:45.089716+0000","last_peered":"2023-05-11T07:35:45.089716+0000","last_clean":"2023-05-11T07:35:45.089716+0000","last_became_active":"2023-05-11T07:35:44.047465+0000","last_became_peered":"2023-05-11T07:35:44.047465+0000","last_unstale":"2023-05-11T07:35:45.089716+0000","last_undegraded":"2023-05-11T07:35:45.089716+0000","last_fullsized":"2023-05-11T07:35:45.089716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:59:10.577106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560876+0000","last_change":"2023-05-11T07:35:39.523143+0000","last_active":"2023-05-11T07:35:47.560876+0000","last_peered":"2023-05-11T07:35:47.560876+0000","last_clean":"2023-05-11T07:35:47.560876+0000","last_became_active":"2023-05-11T07:35:39.522833+0000","last_became_peered":"2023-05-11T07:35:39.522833+0000","last_unstale":"2023-05-11T07:35:47.560876+0000","last_undegraded":"2023-05-11T07:35:47.560876+0000","last_fullsized":"2023-05-11T07:35:47.560876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:43.170391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561462+0000","last_change":"2023-05-11T07:35:40.019416+0000","last_active":"2023-05-11T07:35:47.561462+0000","last_peered":"2023-05-11T07:35:47.561462+0000","last_clean":"2023-05-11T07:35:47.561462+0000","last_became_active":"2023-05-11T07:35:40.017783+0000","last_became_peered":"2023-05-11T07:35:40.017783+0000","last_unstale":"2023-05-11T07:35:47.561462+0000","last_undegraded":"2023-05-11T07:35:47.561462+0000","last_fullsized":"2023-05-11T07:35:47.561462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:40.343002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004455+0000","last_change":"2023-05-11T07:35:44.043607+0000","last_active":"2023-05-11T07:35:45.004455+0000","last_peered":"2023-05-11T07:35:45.004455+0000","last_clean":"2023-05-11T07:35:45.004455+0000","last_became_active":"2023-05-11T07:35:44.043204+0000","last_became_peered":"2023-05-11T07:35:44.043204+0000","last_unstale":"2023-05-11T07:35:45.004455+0000","last_undegraded":"2023-05-11T07:35:45.004455+0000","last_fullsized":"2023-05-11T07:35:45.004455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:57.120095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891506+0000","last_change":"2023-05-11T07:35:39.520690+0000","last_active":"2023-05-11T07:35:46.891506+0000","last_peered":"2023-05-11T07:35:46.891506+0000","last_clean":"2023-05-11T07:35:46.891506+0000","last_became_active":"2023-05-11T07:35:39.520360+0000","last_became_peered":"2023-05-11T07:35:39.520360+0000","last_unstale":"2023-05-11T07:35:46.891506+0000","last_undegraded":"2023-05-11T07:35:46.891506+0000","last_fullsized":"2023-05-11T07:35:46.891506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:07:45.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561931+0000","last_change":"2023-05-11T07:35:40.019241+0000","last_active":"2023-05-11T07:35:47.561931+0000","last_peered":"2023-05-11T07:35:47.561931+0000","last_clean":"2023-05-11T07:35:47.561931+0000","last_became_active":"2023-05-11T07:35:40.018965+0000","last_became_peered":"2023-05-11T07:35:40.018965+0000","last_unstale":"2023-05-11T07:35:47.561931+0000","last_undegraded":"2023-05-11T07:35:47.561931+0000","last_fullsized":"2023-05-11T07:35:47.561931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:05.166289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015716+0000","last_change":"2023-05-11T07:35:44.056735+0000","last_active":"2023-05-11T07:35:45.015716+0000","last_peered":"2023-05-11T07:35:45.015716+0000","last_clean":"2023-05-11T07:35:45.015716+0000","last_became_active":"2023-05-11T07:35:44.056344+0000","last_became_peered":"2023-05-11T07:35:44.056344+0000","last_unstale":"2023-05-11T07:35:45.015716+0000","last_undegraded":"2023-05-11T07:35:45.015716+0000","last_fullsized":"2023-05-11T07:35:45.015716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:05.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560559+0000","last_change":"2023-05-11T07:35:39.521039+0000","last_active":"2023-05-11T07:35:47.560559+0000","last_peered":"2023-05-11T07:35:47.560559+0000","last_clean":"2023-05-11T07:35:47.560559+0000","last_became_active":"2023-05-11T07:35:39.519579+0000","last_became_peered":"2023-05-11T07:35:39.519579+0000","last_unstale":"2023-05-11T07:35:47.560559+0000","last_undegraded":"2023-05-11T07:35:47.560559+0000","last_fullsized":"2023-05-11T07:35:47.560559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:17.898498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562159+0000","last_change":"2023-05-11T07:35:40.024176+0000","last_active":"2023-05-11T07:35:47.562159+0000","last_peered":"2023-05-11T07:35:47.562159+0000","last_clean":"2023-05-11T07:35:47.562159+0000","last_became_active":"2023-05-11T07:35:40.023913+0000","last_became_peered":"2023-05-11T07:35:40.023913+0000","last_unstale":"2023-05-11T07:35:47.562159+0000","last_undegraded":"2023-05-11T07:35:47.562159+0000","last_fullsized":"2023-05-11T07:35:47.562159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:45:40.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562016+0000","last_change":"2023-05-11T07:35:44.053961+0000","last_active":"2023-05-11T07:35:47.562016+0000","last_peered":"2023-05-11T07:35:47.562016+0000","last_clean":"2023-05-11T07:35:47.562016+0000","last_became_active":"2023-05-11T07:35:44.053562+0000","last_became_peered":"2023-05-11T07:35:44.053562+0000","last_unstale":"2023-05-11T07:35:47.562016+0000","last_undegraded":"2023-05-11T07:35:47.562016+0000","last_fullsized":"2023-05-11T07:35:47.562016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:43:09.942525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560794+0000","last_change":"2023-05-11T07:35:39.519635+0000","last_active":"2023-05-11T07:35:47.560794+0000","last_peered":"2023-05-11T07:35:47.560794+0000","last_clean":"2023-05-11T07:35:47.560794+0000","last_became_active":"2023-05-11T07:35:39.519358+0000","last_became_peered":"2023-05-11T07:35:39.519358+0000","last_unstale":"2023-05-11T07:35:47.560794+0000","last_undegraded":"2023-05-11T07:35:47.560794+0000","last_fullsized":"2023-05-11T07:35:47.560794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004912+0000","last_change":"2023-05-11T07:35:40.005569+0000","last_active":"2023-05-11T07:35:45.004912+0000","last_peered":"2023-05-11T07:35:45.004912+0000","last_clean":"2023-05-11T07:35:45.004912+0000","last_became_active":"2023-05-11T07:35:40.005265+0000","last_became_peered":"2023-05-11T07:35:40.005265+0000","last_unstale":"2023-05-11T07:35:45.004912+0000","last_undegraded":"2023-05-11T07:35:45.004912+0000","last_fullsized":"2023-05-11T07:35:45.004912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:05.664545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516637+0000","last_change":"2023-05-11T07:35:44.044625+0000","last_active":"2023-05-11T07:35:44.516637+0000","last_peered":"2023-05-11T07:35:44.516637+0000","last_clean":"2023-05-11T07:35:44.516637+0000","last_became_active":"2023-05-11T07:35:44.044209+0000","last_became_peered":"2023-05-11T07:35:44.044209+0000","last_unstale":"2023-05-11T07:35:44.516637+0000","last_undegraded":"2023-05-11T07:35:44.516637+0000","last_fullsized":"2023-05-11T07:35:44.516637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:05.083240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004520+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:35:45.004520+0000","last_peered":"2023-05-11T07:35:45.004520+0000","last_clean":"2023-05-11T07:35:45.004520+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:35:45.004520+0000","last_undegraded":"2023-05-11T07:35:45.004520+0000","last_fullsized":"2023-05-11T07:35:45.004520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:19.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015475+0000","last_change":"2023-05-11T07:35:39.507928+0000","last_active":"2023-05-11T07:35:45.015475+0000","last_peered":"2023-05-11T07:35:45.015475+0000","last_clean":"2023-05-11T07:35:45.015475+0000","last_became_active":"2023-05-11T07:35:39.507652+0000","last_became_peered":"2023-05-11T07:35:39.507652+0000","last_unstale":"2023-05-11T07:35:45.015475+0000","last_undegraded":"2023-05-11T07:35:45.015475+0000","last_fullsized":"2023-05-11T07:35:45.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:10.367809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004210+0000","last_change":"2023-05-11T07:35:40.023291+0000","last_active":"2023-05-11T07:35:45.004210+0000","last_peered":"2023-05-11T07:35:45.004210+0000","last_clean":"2023-05-11T07:35:45.004210+0000","last_became_active":"2023-05-11T07:35:40.023039+0000","last_became_peered":"2023-05-11T07:35:40.023039+0000","last_unstale":"2023-05-11T07:35:45.004210+0000","last_undegraded":"2023-05-11T07:35:45.004210+0000","last_fullsized":"2023-05-11T07:35:45.004210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:34.298746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516791+0000","last_change":"2023-05-11T07:35:44.056582+0000","last_active":"2023-05-11T07:35:44.516791+0000","last_peered":"2023-05-11T07:35:44.516791+0000","last_clean":"2023-05-11T07:35:44.516791+0000","last_became_active":"2023-05-11T07:35:44.055990+0000","last_became_peered":"2023-05-11T07:35:44.055990+0000","last_unstale":"2023-05-11T07:35:44.516791+0000","last_undegraded":"2023-05-11T07:35:44.516791+0000","last_fullsized":"2023-05-11T07:35:44.516791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:09.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014983+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:35:45.014983+0000","last_peered":"2023-05-11T07:35:45.014983+0000","last_clean":"2023-05-11T07:35:45.014983+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:35:45.014983+0000","last_undegraded":"2023-05-11T07:35:45.014983+0000","last_fullsized":"2023-05-11T07:35:45.014983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:04.852885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560659+0000","last_change":"2023-05-11T07:35:39.525461+0000","last_active":"2023-05-11T07:35:47.560659+0000","last_peered":"2023-05-11T07:35:47.560659+0000","last_clean":"2023-05-11T07:35:47.560659+0000","last_became_active":"2023-05-11T07:35:39.525087+0000","last_became_peered":"2023-05-11T07:35:39.525087+0000","last_unstale":"2023-05-11T07:35:47.560659+0000","last_undegraded":"2023-05-11T07:35:47.560659+0000","last_fullsized":"2023-05-11T07:35:47.560659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:32:39.463622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004389+0000","last_change":"2023-05-11T07:35:40.015281+0000","last_active":"2023-05-11T07:35:45.004389+0000","last_peered":"2023-05-11T07:35:45.004389+0000","last_clean":"2023-05-11T07:35:45.004389+0000","last_became_active":"2023-05-11T07:35:40.015024+0000","last_became_peered":"2023-05-11T07:35:40.015024+0000","last_unstale":"2023-05-11T07:35:45.004389+0000","last_undegraded":"2023-05-11T07:35:45.004389+0000","last_fullsized":"2023-05-11T07:35:45.004389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:25.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089964+0000","last_change":"2023-05-11T07:35:44.051357+0000","last_active":"2023-05-11T07:35:45.089964+0000","last_peered":"2023-05-11T07:35:45.089964+0000","last_clean":"2023-05-11T07:35:45.089964+0000","last_became_active":"2023-05-11T07:35:44.051006+0000","last_became_peered":"2023-05-11T07:35:44.051006+0000","last_unstale":"2023-05-11T07:35:45.089964+0000","last_undegraded":"2023-05-11T07:35:45.089964+0000","last_fullsized":"2023-05-11T07:35:45.089964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:52:35.255028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089456+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:35:45.089456+0000","last_peered":"2023-05-11T07:35:45.089456+0000","last_clean":"2023-05-11T07:35:45.089456+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:35:45.089456+0000","last_undegraded":"2023-05-11T07:35:45.089456+0000","last_fullsized":"2023-05-11T07:35:45.089456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:55:52.663792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004173+0000","last_change":"2023-05-11T07:35:39.519332+0000","last_active":"2023-05-11T07:35:45.004173+0000","last_peered":"2023-05-11T07:35:45.004173+0000","last_clean":"2023-05-11T07:35:45.004173+0000","last_became_active":"2023-05-11T07:35:39.518915+0000","last_became_peered":"2023-05-11T07:35:39.518915+0000","last_unstale":"2023-05-11T07:35:45.004173+0000","last_undegraded":"2023-05-11T07:35:45.004173+0000","last_fullsized":"2023-05-11T07:35:45.004173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004831+0000","last_change":"2023-05-11T07:35:40.029329+0000","last_active":"2023-05-11T07:35:45.004831+0000","last_peered":"2023-05-11T07:35:45.004831+0000","last_clean":"2023-05-11T07:35:45.004831+0000","last_became_active":"2023-05-11T07:35:40.029022+0000","last_became_peered":"2023-05-11T07:35:40.029022+0000","last_unstale":"2023-05-11T07:35:45.004831+0000","last_undegraded":"2023-05-11T07:35:45.004831+0000","last_fullsized":"2023-05-11T07:35:45.004831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518310+0000","last_change":"2023-05-11T07:35:44.049973+0000","last_active":"2023-05-11T07:35:44.518310+0000","last_peered":"2023-05-11T07:35:44.518310+0000","last_clean":"2023-05-11T07:35:44.518310+0000","last_became_active":"2023-05-11T07:35:44.049495+0000","last_became_peered":"2023-05-11T07:35:44.049495+0000","last_unstale":"2023-05-11T07:35:44.518310+0000","last_undegraded":"2023-05-11T07:35:44.518310+0000","last_fullsized":"2023-05-11T07:35:44.518310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:18.555450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015274+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:35:45.015274+0000","last_peered":"2023-05-11T07:35:45.015274+0000","last_clean":"2023-05-11T07:35:45.015274+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:35:45.015274+0000","last_undegraded":"2023-05-11T07:35:45.015274+0000","last_fullsized":"2023-05-11T07:35:45.015274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:03:52.797193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517992+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:35:44.517992+0000","last_peered":"2023-05-11T07:35:44.517992+0000","last_clean":"2023-05-11T07:35:44.517992+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:35:44.517992+0000","last_undegraded":"2023-05-11T07:35:44.517992+0000","last_fullsized":"2023-05-11T07:35:44.517992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:36:52.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561588+0000","last_change":"2023-05-11T07:35:39.510017+0000","last_active":"2023-05-11T07:35:47.561588+0000","last_peered":"2023-05-11T07:35:47.561588+0000","last_clean":"2023-05-11T07:35:47.561588+0000","last_became_active":"2023-05-11T07:35:39.509671+0000","last_became_peered":"2023-05-11T07:35:39.509671+0000","last_unstale":"2023-05-11T07:35:47.561588+0000","last_undegraded":"2023-05-11T07:35:47.561588+0000","last_fullsized":"2023-05-11T07:35:47.561588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:34.377733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891878+0000","last_change":"2023-05-11T07:35:40.008915+0000","last_active":"2023-05-11T07:35:46.891878+0000","last_peered":"2023-05-11T07:35:46.891878+0000","last_clean":"2023-05-11T07:35:46.891878+0000","last_became_active":"2023-05-11T07:35:40.008581+0000","last_became_peered":"2023-05-11T07:35:40.008581+0000","last_unstale":"2023-05-11T07:35:46.891878+0000","last_undegraded":"2023-05-11T07:35:46.891878+0000","last_fullsized":"2023-05-11T07:35:46.891878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:40:05.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015471+0000","last_change":"2023-05-11T07:35:44.057326+0000","last_active":"2023-05-11T07:35:45.015471+0000","last_peered":"2023-05-11T07:35:45.015471+0000","last_clean":"2023-05-11T07:35:45.015471+0000","last_became_active":"2023-05-11T07:35:44.056853+0000","last_became_peered":"2023-05-11T07:35:44.056853+0000","last_unstale":"2023-05-11T07:35:45.015471+0000","last_undegraded":"2023-05-11T07:35:45.015471+0000","last_fullsized":"2023-05-11T07:35:45.015471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:23.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518296+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:35:44.518296+0000","last_peered":"2023-05-11T07:35:44.518296+0000","last_clean":"2023-05-11T07:35:44.518296+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:35:44.518296+0000","last_undegraded":"2023-05-11T07:35:44.518296+0000","last_fullsized":"2023-05-11T07:35:44.518296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:17.235034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516272+0000","last_change":"2023-05-11T07:35:39.524833+0000","last_active":"2023-05-11T07:35:44.516272+0000","last_peered":"2023-05-11T07:35:44.516272+0000","last_clean":"2023-05-11T07:35:44.516272+0000","last_became_active":"2023-05-11T07:35:39.524447+0000","last_became_peered":"2023-05-11T07:35:39.524447+0000","last_unstale":"2023-05-11T07:35:44.516272+0000","last_undegraded":"2023-05-11T07:35:44.516272+0000","last_fullsized":"2023-05-11T07:35:44.516272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516309+0000","last_change":"2023-05-11T07:35:40.023349+0000","last_active":"2023-05-11T07:35:44.516309+0000","last_peered":"2023-05-11T07:35:44.516309+0000","last_clean":"2023-05-11T07:35:44.516309+0000","last_became_active":"2023-05-11T07:35:40.023100+0000","last_became_peered":"2023-05-11T07:35:40.023100+0000","last_unstale":"2023-05-11T07:35:44.516309+0000","last_undegraded":"2023-05-11T07:35:44.516309+0000","last_fullsized":"2023-05-11T07:35:44.516309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.824139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891965+0000","last_change":"2023-05-11T07:35:44.043637+0000","last_active":"2023-05-11T07:35:46.891965+0000","last_peered":"2023-05-11T07:35:46.891965+0000","last_clean":"2023-05-11T07:35:46.891965+0000","last_became_active":"2023-05-11T07:35:44.043165+0000","last_became_peered":"2023-05-11T07:35:44.043165+0000","last_unstale":"2023-05-11T07:35:46.891965+0000","last_undegraded":"2023-05-11T07:35:46.891965+0000","last_fullsized":"2023-05-11T07:35:46.891965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:49.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518831+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:35:44.518831+0000","last_peered":"2023-05-11T07:35:44.518831+0000","last_clean":"2023-05-11T07:35:44.518831+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:35:44.518831+0000","last_undegraded":"2023-05-11T07:35:44.518831+0000","last_fullsized":"2023-05-11T07:35:44.518831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:50:56.012444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004600+0000","last_change":"2023-05-11T07:35:39.518954+0000","last_active":"2023-05-11T07:35:45.004600+0000","last_peered":"2023-05-11T07:35:45.004600+0000","last_clean":"2023-05-11T07:35:45.004600+0000","last_became_active":"2023-05-11T07:35:39.518679+0000","last_became_peered":"2023-05-11T07:35:39.518679+0000","last_unstale":"2023-05-11T07:35:45.004600+0000","last_undegraded":"2023-05-11T07:35:45.004600+0000","last_fullsized":"2023-05-11T07:35:45.004600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516743+0000","last_change":"2023-05-11T07:35:40.027840+0000","last_active":"2023-05-11T07:35:44.516743+0000","last_peered":"2023-05-11T07:35:44.516743+0000","last_clean":"2023-05-11T07:35:44.516743+0000","last_became_active":"2023-05-11T07:35:40.027601+0000","last_became_peered":"2023-05-11T07:35:40.027601+0000","last_unstale":"2023-05-11T07:35:44.516743+0000","last_undegraded":"2023-05-11T07:35:44.516743+0000","last_fullsized":"2023-05-11T07:35:44.516743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561680+0000","last_change":"2023-05-11T07:35:44.057877+0000","last_active":"2023-05-11T07:35:47.561680+0000","last_peered":"2023-05-11T07:35:47.561680+0000","last_clean":"2023-05-11T07:35:47.561680+0000","last_became_active":"2023-05-11T07:35:44.057419+0000","last_became_peered":"2023-05-11T07:35:44.057419+0000","last_unstale":"2023-05-11T07:35:47.561680+0000","last_undegraded":"2023-05-11T07:35:47.561680+0000","last_fullsized":"2023-05-11T07:35:47.561680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:08:36.688411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561013+0000","last_change":"2023-05-11T07:35:39.520251+0000","last_active":"2023-05-11T07:35:47.561013+0000","last_peered":"2023-05-11T07:35:47.561013+0000","last_clean":"2023-05-11T07:35:47.561013+0000","last_became_active":"2023-05-11T07:35:39.519934+0000","last_became_peered":"2023-05-11T07:35:39.519934+0000","last_unstale":"2023-05-11T07:35:47.561013+0000","last_undegraded":"2023-05-11T07:35:47.561013+0000","last_fullsized":"2023-05-11T07:35:47.561013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:04.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004725+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:35:45.004725+0000","last_peered":"2023-05-11T07:35:45.004725+0000","last_clean":"2023-05-11T07:35:45.004725+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:35:45.004725+0000","last_undegraded":"2023-05-11T07:35:45.004725+0000","last_fullsized":"2023-05-11T07:35:45.004725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:14.281579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561109+0000","last_change":"2023-05-11T07:35:40.019926+0000","last_active":"2023-05-11T07:35:47.561109+0000","last_peered":"2023-05-11T07:35:47.561109+0000","last_clean":"2023-05-11T07:35:47.561109+0000","last_became_active":"2023-05-11T07:35:40.019675+0000","last_became_peered":"2023-05-11T07:35:40.019675+0000","last_unstale":"2023-05-11T07:35:47.561109+0000","last_undegraded":"2023-05-11T07:35:47.561109+0000","last_fullsized":"2023-05-11T07:35:47.561109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560939+0000","last_change":"2023-05-11T07:35:44.043124+0000","last_active":"2023-05-11T07:35:47.560939+0000","last_peered":"2023-05-11T07:35:47.560939+0000","last_clean":"2023-05-11T07:35:47.560939+0000","last_became_active":"2023-05-11T07:35:44.042657+0000","last_became_peered":"2023-05-11T07:35:44.042657+0000","last_unstale":"2023-05-11T07:35:47.560939+0000","last_undegraded":"2023-05-11T07:35:47.560939+0000","last_fullsized":"2023-05-11T07:35:47.560939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:36.711230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891959+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:35:46.891959+0000","last_peered":"2023-05-11T07:35:46.891959+0000","last_clean":"2023-05-11T07:35:46.891959+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:35:46.891959+0000","last_undegraded":"2023-05-11T07:35:46.891959+0000","last_fullsized":"2023-05-11T07:35:46.891959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:55:13.429347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516483+0000","last_change":"2023-05-11T07:35:39.522039+0000","last_active":"2023-05-11T07:35:44.516483+0000","last_peered":"2023-05-11T07:35:44.516483+0000","last_clean":"2023-05-11T07:35:44.516483+0000","last_became_active":"2023-05-11T07:35:39.521457+0000","last_became_peered":"2023-05-11T07:35:39.521457+0000","last_unstale":"2023-05-11T07:35:44.516483+0000","last_undegraded":"2023-05-11T07:35:44.516483+0000","last_fullsized":"2023-05-11T07:35:44.516483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:24.062361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561314+0000","last_change":"2023-05-11T07:35:40.019321+0000","last_active":"2023-05-11T07:35:47.561314+0000","last_peered":"2023-05-11T07:35:47.561314+0000","last_clean":"2023-05-11T07:35:47.561314+0000","last_became_active":"2023-05-11T07:35:40.019071+0000","last_became_peered":"2023-05-11T07:35:40.019071+0000","last_unstale":"2023-05-11T07:35:47.561314+0000","last_undegraded":"2023-05-11T07:35:47.561314+0000","last_fullsized":"2023-05-11T07:35:47.561314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:09.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004624+0000","last_change":"2023-05-11T07:35:44.056475+0000","last_active":"2023-05-11T07:35:45.004624+0000","last_peered":"2023-05-11T07:35:45.004624+0000","last_clean":"2023-05-11T07:35:45.004624+0000","last_became_active":"2023-05-11T07:35:44.056110+0000","last_became_peered":"2023-05-11T07:35:44.056110+0000","last_unstale":"2023-05-11T07:35:45.004624+0000","last_undegraded":"2023-05-11T07:35:45.004624+0000","last_fullsized":"2023-05-11T07:35:45.004624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:54.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516667+0000","last_change":"2023-05-11T07:35:39.525088+0000","last_active":"2023-05-11T07:35:44.516667+0000","last_peered":"2023-05-11T07:35:44.516667+0000","last_clean":"2023-05-11T07:35:44.516667+0000","last_became_active":"2023-05-11T07:35:39.524603+0000","last_became_peered":"2023-05-11T07:35:39.524603+0000","last_unstale":"2023-05-11T07:35:44.516667+0000","last_undegraded":"2023-05-11T07:35:44.516667+0000","last_fullsized":"2023-05-11T07:35:44.516667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089889+0000","last_change":"2023-05-11T07:35:40.008368+0000","last_active":"2023-05-11T07:35:45.089889+0000","last_peered":"2023-05-11T07:35:45.089889+0000","last_clean":"2023-05-11T07:35:45.089889+0000","last_became_active":"2023-05-11T07:35:40.006963+0000","last_became_peered":"2023-05-11T07:35:40.006963+0000","last_unstale":"2023-05-11T07:35:45.089889+0000","last_undegraded":"2023-05-11T07:35:45.089889+0000","last_fullsized":"2023-05-11T07:35:45.089889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:16:58.803321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518483+0000","last_change":"2023-05-11T07:35:44.056975+0000","last_active":"2023-05-11T07:35:44.518483+0000","last_peered":"2023-05-11T07:35:44.518483+0000","last_clean":"2023-05-11T07:35:44.518483+0000","last_became_active":"2023-05-11T07:35:44.056495+0000","last_became_peered":"2023-05-11T07:35:44.056495+0000","last_unstale":"2023-05-11T07:35:44.518483+0000","last_undegraded":"2023-05-11T07:35:44.518483+0000","last_fullsized":"2023-05-11T07:35:44.518483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:53.367006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015252+0000","last_change":"2023-05-11T07:35:39.521916+0000","last_active":"2023-05-11T07:35:45.015252+0000","last_peered":"2023-05-11T07:35:45.015252+0000","last_clean":"2023-05-11T07:35:45.015252+0000","last_became_active":"2023-05-11T07:35:39.521597+0000","last_became_peered":"2023-05-11T07:35:39.521597+0000","last_unstale":"2023-05-11T07:35:45.015252+0000","last_undegraded":"2023-05-11T07:35:45.015252+0000","last_fullsized":"2023-05-11T07:35:45.015252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:34.396540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561427+0000","last_change":"2023-05-11T07:35:40.017540+0000","last_active":"2023-05-11T07:35:47.561427+0000","last_peered":"2023-05-11T07:35:47.561427+0000","last_clean":"2023-05-11T07:35:47.561427+0000","last_became_active":"2023-05-11T07:35:40.016451+0000","last_became_peered":"2023-05-11T07:35:40.016451+0000","last_unstale":"2023-05-11T07:35:47.561427+0000","last_undegraded":"2023-05-11T07:35:47.561427+0000","last_fullsized":"2023-05-11T07:35:47.561427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:44:21.145951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015327+0000","last_change":"2023-05-11T07:35:44.052508+0000","last_active":"2023-05-11T07:35:45.015327+0000","last_peered":"2023-05-11T07:35:45.015327+0000","last_clean":"2023-05-11T07:35:45.015327+0000","last_became_active":"2023-05-11T07:35:44.052017+0000","last_became_peered":"2023-05-11T07:35:44.052017+0000","last_unstale":"2023-05-11T07:35:45.015327+0000","last_undegraded":"2023-05-11T07:35:45.015327+0000","last_fullsized":"2023-05-11T07:35:45.015327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015262+0000","last_change":"2023-05-11T07:35:39.521328+0000","last_active":"2023-05-11T07:35:45.015262+0000","last_peered":"2023-05-11T07:35:45.015262+0000","last_clean":"2023-05-11T07:35:45.015262+0000","last_became_active":"2023-05-11T07:35:39.521000+0000","last_became_peered":"2023-05-11T07:35:39.521000+0000","last_unstale":"2023-05-11T07:35:45.015262+0000","last_undegraded":"2023-05-11T07:35:45.015262+0000","last_fullsized":"2023-05-11T07:35:45.015262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.018737+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.017851+0000","last_became_peered":"2023-05-11T07:35:40.017851+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:34:37.153358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561068+0000","last_change":"2023-05-11T07:35:44.054974+0000","last_active":"2023-05-11T07:35:47.561068+0000","last_peered":"2023-05-11T07:35:47.561068+0000","last_clean":"2023-05-11T07:35:47.561068+0000","last_became_active":"2023-05-11T07:35:44.051992+0000","last_became_peered":"2023-05-11T07:35:44.051992+0000","last_unstale":"2023-05-11T07:35:47.561068+0000","last_undegraded":"2023-05-11T07:35:47.561068+0000","last_fullsized":"2023-05-11T07:35:47.561068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:01:14.299594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561390+0000","last_change":"2023-05-11T07:35:39.517443+0000","last_active":"2023-05-11T07:35:47.561390+0000","last_peered":"2023-05-11T07:35:47.561390+0000","last_clean":"2023-05-11T07:35:47.561390+0000","last_became_active":"2023-05-11T07:35:39.517129+0000","last_became_peered":"2023-05-11T07:35:39.517129+0000","last_unstale":"2023-05-11T07:35:47.561390+0000","last_undegraded":"2023-05-11T07:35:47.561390+0000","last_fullsized":"2023-05-11T07:35:47.561390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:48.847251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561320+0000","last_change":"2023-05-11T07:35:40.006173+0000","last_active":"2023-05-11T07:35:47.561320+0000","last_peered":"2023-05-11T07:35:47.561320+0000","last_clean":"2023-05-11T07:35:47.561320+0000","last_became_active":"2023-05-11T07:35:40.005890+0000","last_became_peered":"2023-05-11T07:35:40.005890+0000","last_unstale":"2023-05-11T07:35:47.561320+0000","last_undegraded":"2023-05-11T07:35:47.561320+0000","last_fullsized":"2023-05-11T07:35:47.561320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:36.177731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004231+0000","last_change":"2023-05-11T07:35:44.049707+0000","last_active":"2023-05-11T07:35:45.004231+0000","last_peered":"2023-05-11T07:35:45.004231+0000","last_clean":"2023-05-11T07:35:45.004231+0000","last_became_active":"2023-05-11T07:35:44.048969+0000","last_became_peered":"2023-05-11T07:35:44.048969+0000","last_unstale":"2023-05-11T07:35:45.004231+0000","last_undegraded":"2023-05-11T07:35:45.004231+0000","last_fullsized":"2023-05-11T07:35:45.004231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:27.337039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516740+0000","last_change":"2023-05-11T07:35:39.524299+0000","last_active":"2023-05-11T07:35:44.516740+0000","last_peered":"2023-05-11T07:35:44.516740+0000","last_clean":"2023-05-11T07:35:44.516740+0000","last_became_active":"2023-05-11T07:35:39.523715+0000","last_became_peered":"2023-05-11T07:35:39.523715+0000","last_unstale":"2023-05-11T07:35:44.516740+0000","last_undegraded":"2023-05-11T07:35:44.516740+0000","last_fullsized":"2023-05-11T07:35:44.516740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:50.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561653+0000","last_change":"2023-05-11T07:35:40.024550+0000","last_active":"2023-05-11T07:35:47.561653+0000","last_peered":"2023-05-11T07:35:47.561653+0000","last_clean":"2023-05-11T07:35:47.561653+0000","last_became_active":"2023-05-11T07:35:40.024275+0000","last_became_peered":"2023-05-11T07:35:40.024275+0000","last_unstale":"2023-05-11T07:35:47.561653+0000","last_undegraded":"2023-05-11T07:35:47.561653+0000","last_fullsized":"2023-05-11T07:35:47.561653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:34:28.815609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891614+0000","last_change":"2023-05-11T07:35:40.006241+0000","last_active":"2023-05-11T07:35:46.891614+0000","last_peered":"2023-05-11T07:35:46.891614+0000","last_clean":"2023-05-11T07:35:46.891614+0000","last_became_active":"2023-05-11T07:35:40.004809+0000","last_became_peered":"2023-05-11T07:35:40.004809+0000","last_unstale":"2023-05-11T07:35:46.891614+0000","last_undegraded":"2023-05-11T07:35:46.891614+0000","last_fullsized":"2023-05-11T07:35:46.891614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:12:57.760117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561474+0000","last_change":"2023-05-11T07:35:40.005112+0000","last_active":"2023-05-11T07:35:47.561474+0000","last_peered":"2023-05-11T07:35:47.561474+0000","last_clean":"2023-05-11T07:35:47.561474+0000","last_became_active":"2023-05-11T07:35:40.004879+0000","last_became_peered":"2023-05-11T07:35:40.004879+0000","last_unstale":"2023-05-11T07:35:47.561474+0000","last_undegraded":"2023-05-11T07:35:47.561474+0000","last_fullsized":"2023-05-11T07:35:47.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561826+0000","last_change":"2023-05-11T07:35:40.025239+0000","last_active":"2023-05-11T07:35:47.561826+0000","last_peered":"2023-05-11T07:35:47.561826+0000","last_clean":"2023-05-11T07:35:47.561826+0000","last_became_active":"2023-05-11T07:35:40.024971+0000","last_became_peered":"2023-05-11T07:35:40.024971+0000","last_unstale":"2023-05-11T07:35:47.561826+0000","last_undegraded":"2023-05-11T07:35:47.561826+0000","last_fullsized":"2023-05-11T07:35:47.561826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:24.724155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561353+0000","last_change":"2023-05-11T07:35:40.021603+0000","last_active":"2023-05-11T07:35:47.561353+0000","last_peered":"2023-05-11T07:35:47.561353+0000","last_clean":"2023-05-11T07:35:47.561353+0000","last_became_active":"2023-05-11T07:35:40.021312+0000","last_became_peered":"2023-05-11T07:35:40.021312+0000","last_unstale":"2023-05-11T07:35:47.561353+0000","last_undegraded":"2023-05-11T07:35:47.561353+0000","last_fullsized":"2023-05-11T07:35:47.561353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004544+0000","last_change":"2023-05-11T07:35:40.017015+0000","last_active":"2023-05-11T07:35:45.004544+0000","last_peered":"2023-05-11T07:35:45.004544+0000","last_clean":"2023-05-11T07:35:45.004544+0000","last_became_active":"2023-05-11T07:35:40.016304+0000","last_became_peered":"2023-05-11T07:35:40.016304+0000","last_unstale":"2023-05-11T07:35:45.004544+0000","last_undegraded":"2023-05-11T07:35:45.004544+0000","last_fullsized":"2023-05-11T07:35:45.004544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:53.819634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":713999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:36:08.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:36:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.826+0000 7f648bfff700 1 Processor -- start 2023-05-11T07:36:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.827+0000 7f648bfff700 1 -- start start 2023-05-11T07:36:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.828+0000 7f648bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.828+0000 7f648bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f648406beb0 0x7f6484070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.828+0000 7f648bfff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64840cb2b0 con 0x7f648406af50 2023-05-11T07:36:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.828+0000 7f648bfff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840c9790 con 0x7f648406beb0 2023-05-11T07:36:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.828+0000 7f648bfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648406c2f0 con 0x7f6484158be0 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52080/0 (socket says 172.21.15.144:52080) 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 -- 172.21.15.144:0/4282982781 learned_addr learned my addr 172.21.15.144:0/4282982781 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f648a59c700 1 --2- 172.21.15.144:0/4282982781 >> v2:172.21.15.145:3300/0 conn(0x7f648406beb0 0x7f6484070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 -- 172.21.15.144:0/4282982781 >> v2:172.21.15.145:3300/0 conn(0x7f648406beb0 msgr2=0x7f6484070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 --2- 172.21.15.144:0/4282982781 >> v2:172.21.15.145:3300/0 conn(0x7f648406beb0 0x7f6484070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 -- 172.21.15.144:0/4282982781 >> v1:172.21.15.145:6789/0 conn(0x7f648406af50 legacy=0x7f648406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.829+0000 7f6489d9b700 1 -- 172.21.15.144:0/4282982781 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648415d3c0 con 0x7f6484158be0 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f6489d9b700 1 --2- 172.21.15.144:0/4282982781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f64800098f0 tx=0x7f6480009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47181232de46699e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f6488d99700 1 -- 172.21.15.144:0/4282982781 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011830 con 0x7f6484158be0 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f6488d99700 1 -- 172.21.15.144:0/4282982781 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480011990 con 0x7f6484158be0 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f6488d99700 1 -- 172.21.15.144:0/4282982781 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011d20 con 0x7f6484158be0 2023-05-11T07:36:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 -- 172.21.15.144:0/4282982781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 msgr2=0x7f64840ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 --2- 172.21.15.144:0/4282982781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f64800098f0 tx=0x7f6480009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 -- 172.21.15.144:0/4282982781 shutdown_connections 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 --2- 172.21.15.144:0/4282982781 >> v2:172.21.15.145:3300/0 conn(0x7f648406beb0 0x7f6484070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 --2- 172.21.15.144:0/4282982781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64840ce570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 -- 172.21.15.144:0/4282982781 >> 172.21.15.144:0/4282982781 conn(0x7f64840cb7e0 msgr2=0x7f64840cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 -- 172.21.15.144:0/4282982781 shutdown_connections 2023-05-11T07:36:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.830+0000 7f648bfff700 1 -- 172.21.15.144:0/4282982781 wait complete. 2023-05-11T07:36:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.832+0000 7f648bfff700 1 Processor -- start 2023-05-11T07:36:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.832+0000 7f648bfff700 1 -- start start 2023-05-11T07:36:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 0x7f64840c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64841f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64841f5a00 con 0x7f648406beb0 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64841f2b90 con 0x7f648406af50 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.833+0000 7f648bfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64840c2a10 con 0x7f6484158be0 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41544/0 (socket says 172.21.15.144:41544) 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 -- 172.21.15.144:0/1845127836 learned_addr learned my addr 172.21.15.144:0/1845127836 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f6489d9b700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 0x7f64840c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648a59c700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64841f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 -- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 msgr2=0x7f64841f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64841f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 -- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 msgr2=0x7f64840c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 0x7f64840c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 -- 172.21.15.144:0/1845127836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009550 con 0x7f648406beb0 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f6489d9b700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 0x7f64840c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648a59c700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64841f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.834+0000 7f648959a700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f647400c450 tx=0x7f647400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.835+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740052d0 con 0x7f648406beb0 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.835+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474005430 con 0x7f648406beb0 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.835+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64840c93b0 con 0x7f648406beb0 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.835+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740038c0 con 0x7f648406beb0 2023-05-11T07:36:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.835+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648415d6a0 con 0x7f648406beb0 2023-05-11T07:36:08.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.836+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64840ceab0 con 0x7f648406beb0 2023-05-11T07:36:08.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.837+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6474003a20 con 0x7f648406beb0 2023-05-11T07:36:08.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.838+0000 7f647a7fc700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 0x7f646806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:08.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.838+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6474088b30 con 0x7f648406beb0 2023-05-11T07:36:08.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.838+0000 7f6489d9b700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 0x7f646806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:08.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.839+0000 7f6489d9b700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 0x7f646806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6480009c40 tx=0x7f6480008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:08.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:08.842+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6474053850 con 0x7f648406beb0 2023-05-11T07:36:09.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.031+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64840c2bd0 con 0x7f646806ace0 2023-05-11T07:36:09.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.041+0000 7f647a7fc700 1 -- 172.21.15.144:0/1845127836 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367325 (secure 0 0 0) 0x7f64840c2bd0 con 0x7f646806ace0 2023-05-11T07:36:09.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:09.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 msgr2=0x7f646806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 0x7f646806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6480009c40 tx=0x7f6480008030 comp rx=0 tx=0).stop 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 msgr2=0x7f64841f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f647400c450 tx=0x7f647400c760 comp rx=0 tx=0).stop 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 shutdown_connections 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f646806ace0 0x7f646806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6484158be0 0x7f64841f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f648406af50 0x7f64840c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 --2- 172.21.15.144:0/1845127836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f648406beb0 0x7f64841f54c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 >> 172.21.15.144:0/1845127836 conn(0x7f64840cb7e0 msgr2=0x7f64840af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 shutdown_connections 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.046+0000 7f648bfff700 1 -- 172.21.15.144:0/1845127836 wait complete. 2023-05-11T07:36:09.052 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:36:09.067 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-11T07:36:07.718914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2146888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003035"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089760+0000","last_change":"2023-05-11T07:35:40.003263+0000","last_active":"2023-05-11T07:35:45.089760+0000","last_peered":"2023-05-11T07:35:45.089760+0000","last_clean":"2023-05-11T07:35:45.089760+0000","last_became_active":"2023-05-11T07:35:40.002990+0000","last_became_peered":"2023-05-11T07:35:40.002990+0000","last_unstale":"2023-05-11T07:35:45.089760+0000","last_undegraded":"2023-05-11T07:35:45.089760+0000","last_fullsized":"2023-05-11T07:35:45.089760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:47:49.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015531+0000","last_change":"2023-05-11T07:35:40.026566+0000","last_active":"2023-05-11T07:35:45.015531+0000","last_peered":"2023-05-11T07:35:45.015531+0000","last_clean":"2023-05-11T07:35:45.015531+0000","last_became_active":"2023-05-11T07:35:40.026251+0000","last_became_peered":"2023-05-11T07:35:40.026251+0000","last_unstale":"2023-05-11T07:35:45.015531+0000","last_undegraded":"2023-05-11T07:35:45.015531+0000","last_fullsized":"2023-05-11T07:35:45.015531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:55:14.716226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562178+0000","last_change":"2023-05-11T07:35:40.017456+0000","last_active":"2023-05-11T07:35:47.562178+0000","last_peered":"2023-05-11T07:35:47.562178+0000","last_clean":"2023-05-11T07:35:47.562178+0000","last_became_active":"2023-05-11T07:35:40.017116+0000","last_became_peered":"2023-05-11T07:35:40.017116+0000","last_unstale":"2023-05-11T07:35:47.562178+0000","last_undegraded":"2023-05-11T07:35:47.562178+0000","last_fullsized":"2023-05-11T07:35:47.562178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:56.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891706+0000","last_change":"2023-05-11T07:35:40.015700+0000","last_active":"2023-05-11T07:35:46.891706+0000","last_peered":"2023-05-11T07:35:46.891706+0000","last_clean":"2023-05-11T07:35:46.891706+0000","last_became_active":"2023-05-11T07:35:40.015379+0000","last_became_peered":"2023-05-11T07:35:40.015379+0000","last_unstale":"2023-05-11T07:35:46.891706+0000","last_undegraded":"2023-05-11T07:35:46.891706+0000","last_fullsized":"2023-05-11T07:35:46.891706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:18:19.207636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517497+0000","last_change":"2023-05-11T07:35:40.017874+0000","last_active":"2023-05-11T07:35:44.517497+0000","last_peered":"2023-05-11T07:35:44.517497+0000","last_clean":"2023-05-11T07:35:44.517497+0000","last_became_active":"2023-05-11T07:35:40.017633+0000","last_became_peered":"2023-05-11T07:35:40.017633+0000","last_unstale":"2023-05-11T07:35:44.517497+0000","last_undegraded":"2023-05-11T07:35:44.517497+0000","last_fullsized":"2023-05-11T07:35:44.517497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561892+0000","last_change":"2023-05-11T07:35:40.019837+0000","last_active":"2023-05-11T07:35:47.561892+0000","last_peered":"2023-05-11T07:35:47.561892+0000","last_clean":"2023-05-11T07:35:47.561892+0000","last_became_active":"2023-05-11T07:35:40.019582+0000","last_became_peered":"2023-05-11T07:35:40.019582+0000","last_unstale":"2023-05-11T07:35:47.561892+0000","last_undegraded":"2023-05-11T07:35:47.561892+0000","last_fullsized":"2023-05-11T07:35:47.561892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:04:10.251391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518855+0000","last_change":"2023-05-11T07:35:40.019621+0000","last_active":"2023-05-11T07:35:44.518855+0000","last_peered":"2023-05-11T07:35:44.518855+0000","last_clean":"2023-05-11T07:35:44.518855+0000","last_became_active":"2023-05-11T07:35:40.019325+0000","last_became_peered":"2023-05-11T07:35:40.019325+0000","last_unstale":"2023-05-11T07:35:44.518855+0000","last_undegraded":"2023-05-11T07:35:44.518855+0000","last_fullsized":"2023-05-11T07:35:44.518855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:11.547662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014908+0000","last_change":"2023-05-11T07:35:40.026209+0000","last_active":"2023-05-11T07:35:45.014908+0000","last_peered":"2023-05-11T07:35:45.014908+0000","last_clean":"2023-05-11T07:35:45.014908+0000","last_became_active":"2023-05-11T07:35:40.025835+0000","last_became_peered":"2023-05-11T07:35:40.025835+0000","last_unstale":"2023-05-11T07:35:45.014908+0000","last_undegraded":"2023-05-11T07:35:45.014908+0000","last_fullsized":"2023-05-11T07:35:45.014908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:35.384590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516451+0000","last_change":"2023-05-11T07:35:40.027053+0000","last_active":"2023-05-11T07:35:44.516451+0000","last_peered":"2023-05-11T07:35:44.516451+0000","last_clean":"2023-05-11T07:35:44.516451+0000","last_became_active":"2023-05-11T07:35:40.026802+0000","last_became_peered":"2023-05-11T07:35:40.026802+0000","last_unstale":"2023-05-11T07:35:44.516451+0000","last_undegraded":"2023-05-11T07:35:44.516451+0000","last_fullsized":"2023-05-11T07:35:44.516451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015789+0000","last_change":"2023-05-11T07:35:40.028043+0000","last_active":"2023-05-11T07:35:45.015789+0000","last_peered":"2023-05-11T07:35:45.015789+0000","last_clean":"2023-05-11T07:35:45.015789+0000","last_became_active":"2023-05-11T07:35:40.027745+0000","last_became_peered":"2023-05-11T07:35:40.027745+0000","last_unstale":"2023-05-11T07:35:45.015789+0000","last_undegraded":"2023-05-11T07:35:45.015789+0000","last_fullsized":"2023-05-11T07:35:45.015789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:43.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562271+0000","last_change":"2023-05-11T07:35:40.021833+0000","last_active":"2023-05-11T07:35:47.562271+0000","last_peered":"2023-05-11T07:35:47.562271+0000","last_clean":"2023-05-11T07:35:47.562271+0000","last_became_active":"2023-05-11T07:35:40.021555+0000","last_became_peered":"2023-05-11T07:35:40.021555+0000","last_unstale":"2023-05-11T07:35:47.562271+0000","last_undegraded":"2023-05-11T07:35:47.562271+0000","last_fullsized":"2023-05-11T07:35:47.562271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:28.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089711+0000","last_change":"2023-05-11T07:35:40.008540+0000","last_active":"2023-05-11T07:35:45.089711+0000","last_peered":"2023-05-11T07:35:45.089711+0000","last_clean":"2023-05-11T07:35:45.089711+0000","last_became_active":"2023-05-11T07:35:40.008085+0000","last_became_peered":"2023-05-11T07:35:40.008085+0000","last_unstale":"2023-05-11T07:35:45.089711+0000","last_undegraded":"2023-05-11T07:35:45.089711+0000","last_fullsized":"2023-05-11T07:35:45.089711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:02:06.990407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089645+0000","last_change":"2023-05-11T07:35:40.003691+0000","last_active":"2023-05-11T07:35:45.089645+0000","last_peered":"2023-05-11T07:35:45.089645+0000","last_clean":"2023-05-11T07:35:45.089645+0000","last_became_active":"2023-05-11T07:35:40.003340+0000","last_became_peered":"2023-05-11T07:35:40.003340+0000","last_unstale":"2023-05-11T07:35:45.089645+0000","last_undegraded":"2023-05-11T07:35:45.089645+0000","last_fullsized":"2023-05-11T07:35:45.089645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:40.739929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014917+0000","last_change":"2023-05-11T07:35:40.023425+0000","last_active":"2023-05-11T07:35:45.014917+0000","last_peered":"2023-05-11T07:35:45.014917+0000","last_clean":"2023-05-11T07:35:45.014917+0000","last_became_active":"2023-05-11T07:35:40.023149+0000","last_became_peered":"2023-05-11T07:35:40.023149+0000","last_unstale":"2023-05-11T07:35:45.014917+0000","last_undegraded":"2023-05-11T07:35:45.014917+0000","last_fullsized":"2023-05-11T07:35:45.014917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:57.291650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517873+0000","last_change":"2023-05-11T07:35:40.019674+0000","last_active":"2023-05-11T07:35:44.517873+0000","last_peered":"2023-05-11T07:35:44.517873+0000","last_clean":"2023-05-11T07:35:44.517873+0000","last_became_active":"2023-05-11T07:35:40.019341+0000","last_became_peered":"2023-05-11T07:35:40.019341+0000","last_unstale":"2023-05-11T07:35:44.517873+0000","last_undegraded":"2023-05-11T07:35:44.517873+0000","last_fullsized":"2023-05-11T07:35:44.517873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561553+0000","last_change":"2023-05-11T07:35:40.017375+0000","last_active":"2023-05-11T07:35:47.561553+0000","last_peered":"2023-05-11T07:35:47.561553+0000","last_clean":"2023-05-11T07:35:47.561553+0000","last_became_active":"2023-05-11T07:35:40.017066+0000","last_became_peered":"2023-05-11T07:35:40.017066+0000","last_unstale":"2023-05-11T07:35:47.561553+0000","last_undegraded":"2023-05-11T07:35:47.561553+0000","last_fullsized":"2023-05-11T07:35:47.561553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:30:12.395814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516538+0000","last_change":"2023-05-11T07:35:40.028493+0000","last_active":"2023-05-11T07:35:44.516538+0000","last_peered":"2023-05-11T07:35:44.516538+0000","last_clean":"2023-05-11T07:35:44.516538+0000","last_became_active":"2023-05-11T07:35:40.028204+0000","last_became_peered":"2023-05-11T07:35:40.028204+0000","last_unstale":"2023-05-11T07:35:44.516538+0000","last_undegraded":"2023-05-11T07:35:44.516538+0000","last_fullsized":"2023-05-11T07:35:44.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:26.521370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562117+0000","last_change":"2023-05-11T07:35:40.014959+0000","last_active":"2023-05-11T07:35:47.562117+0000","last_peered":"2023-05-11T07:35:47.562117+0000","last_clean":"2023-05-11T07:35:47.562117+0000","last_became_active":"2023-05-11T07:35:40.014689+0000","last_became_peered":"2023-05-11T07:35:40.014689+0000","last_unstale":"2023-05-11T07:35:47.562117+0000","last_undegraded":"2023-05-11T07:35:47.562117+0000","last_fullsized":"2023-05-11T07:35:47.562117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:42.131185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089549+0000","last_change":"2023-05-11T07:35:40.001699+0000","last_active":"2023-05-11T07:35:45.089549+0000","last_peered":"2023-05-11T07:35:45.089549+0000","last_clean":"2023-05-11T07:35:45.089549+0000","last_became_active":"2023-05-11T07:35:40.001449+0000","last_became_peered":"2023-05-11T07:35:40.001449+0000","last_unstale":"2023-05-11T07:35:45.089549+0000","last_undegraded":"2023-05-11T07:35:45.089549+0000","last_fullsized":"2023-05-11T07:35:45.089549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:39:10.961995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561455+0000","last_change":"2023-05-11T07:35:40.023713+0000","last_active":"2023-05-11T07:35:47.561455+0000","last_peered":"2023-05-11T07:35:47.561455+0000","last_clean":"2023-05-11T07:35:47.561455+0000","last_became_active":"2023-05-11T07:35:40.023403+0000","last_became_peered":"2023-05-11T07:35:40.023403+0000","last_unstale":"2023-05-11T07:35:47.561455+0000","last_undegraded":"2023-05-11T07:35:47.561455+0000","last_fullsized":"2023-05-11T07:35:47.561455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:51:38.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518306+0000","last_change":"2023-05-11T07:35:40.019898+0000","last_active":"2023-05-11T07:35:44.518306+0000","last_peered":"2023-05-11T07:35:44.518306+0000","last_clean":"2023-05-11T07:35:44.518306+0000","last_became_active":"2023-05-11T07:35:40.019650+0000","last_became_peered":"2023-05-11T07:35:40.019650+0000","last_unstale":"2023-05-11T07:35:44.518306+0000","last_undegraded":"2023-05-11T07:35:44.518306+0000","last_fullsized":"2023-05-11T07:35:44.518306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516495+0000","last_change":"2023-05-11T07:35:40.018256+0000","last_active":"2023-05-11T07:35:44.516495+0000","last_peered":"2023-05-11T07:35:44.516495+0000","last_clean":"2023-05-11T07:35:44.516495+0000","last_became_active":"2023-05-11T07:35:40.017973+0000","last_became_peered":"2023-05-11T07:35:40.017973+0000","last_unstale":"2023-05-11T07:35:44.516495+0000","last_undegraded":"2023-05-11T07:35:44.516495+0000","last_fullsized":"2023-05-11T07:35:44.516495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:53.607196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.015426+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.015144+0000","last_became_peered":"2023-05-11T07:35:40.015144+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518102+0000","last_change":"2023-05-11T07:35:40.029940+0000","last_active":"2023-05-11T07:35:44.518102+0000","last_peered":"2023-05-11T07:35:44.518102+0000","last_clean":"2023-05-11T07:35:44.518102+0000","last_became_active":"2023-05-11T07:35:40.029761+0000","last_became_peered":"2023-05-11T07:35:40.029761+0000","last_unstale":"2023-05-11T07:35:44.518102+0000","last_undegraded":"2023-05-11T07:35:44.518102+0000","last_fullsized":"2023-05-11T07:35:44.518102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004787+0000","last_change":"2023-05-11T07:35:40.016915+0000","last_active":"2023-05-11T07:35:45.004787+0000","last_peered":"2023-05-11T07:35:45.004787+0000","last_clean":"2023-05-11T07:35:45.004787+0000","last_became_active":"2023-05-11T07:35:40.016633+0000","last_became_peered":"2023-05-11T07:35:40.016633+0000","last_unstale":"2023-05-11T07:35:45.004787+0000","last_undegraded":"2023-05-11T07:35:45.004787+0000","last_fullsized":"2023-05-11T07:35:45.004787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:02.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004835+0000","last_change":"2023-05-11T07:35:40.014665+0000","last_active":"2023-05-11T07:35:45.004835+0000","last_peered":"2023-05-11T07:35:45.004835+0000","last_clean":"2023-05-11T07:35:45.004835+0000","last_became_active":"2023-05-11T07:35:40.013282+0000","last_became_peered":"2023-05-11T07:35:40.013282+0000","last_unstale":"2023-05-11T07:35:45.004835+0000","last_undegraded":"2023-05-11T07:35:45.004835+0000","last_fullsized":"2023-05-11T07:35:45.004835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015640+0000","last_change":"2023-05-11T07:35:40.028278+0000","last_active":"2023-05-11T07:35:45.015640+0000","last_peered":"2023-05-11T07:35:45.015640+0000","last_clean":"2023-05-11T07:35:45.015640+0000","last_became_active":"2023-05-11T07:35:40.027965+0000","last_became_peered":"2023-05-11T07:35:40.027965+0000","last_unstale":"2023-05-11T07:35:45.015640+0000","last_undegraded":"2023-05-11T07:35:45.015640+0000","last_fullsized":"2023-05-11T07:35:45.015640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:25.486990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561879+0000","last_change":"2023-05-11T07:35:44.058122+0000","last_active":"2023-05-11T07:35:47.561879+0000","last_peered":"2023-05-11T07:35:47.561879+0000","last_clean":"2023-05-11T07:35:47.561879+0000","last_became_active":"2023-05-11T07:35:44.057702+0000","last_became_peered":"2023-05-11T07:35:44.057702+0000","last_unstale":"2023-05-11T07:35:47.561879+0000","last_undegraded":"2023-05-11T07:35:47.561879+0000","last_fullsized":"2023-05-11T07:35:47.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:36:05.616117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560688+0000","last_change":"2023-05-11T07:35:39.525251+0000","last_active":"2023-05-11T07:35:47.560688+0000","last_peered":"2023-05-11T07:35:47.560688+0000","last_clean":"2023-05-11T07:35:47.560688+0000","last_became_active":"2023-05-11T07:35:39.523877+0000","last_became_peered":"2023-05-11T07:35:39.523877+0000","last_unstale":"2023-05-11T07:35:47.560688+0000","last_undegraded":"2023-05-11T07:35:47.560688+0000","last_fullsized":"2023-05-11T07:35:47.560688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:53.446198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561824+0000","last_change":"2023-05-11T07:35:40.004593+0000","last_active":"2023-05-11T07:35:47.561824+0000","last_peered":"2023-05-11T07:35:47.561824+0000","last_clean":"2023-05-11T07:35:47.561824+0000","last_became_active":"2023-05-11T07:35:40.004302+0000","last_became_peered":"2023-05-11T07:35:40.004302+0000","last_unstale":"2023-05-11T07:35:47.561824+0000","last_undegraded":"2023-05-11T07:35:47.561824+0000","last_fullsized":"2023-05-11T07:35:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:02.707221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891981+0000","last_change":"2023-05-11T07:35:44.049215+0000","last_active":"2023-05-11T07:35:46.891981+0000","last_peered":"2023-05-11T07:35:46.891981+0000","last_clean":"2023-05-11T07:35:46.891981+0000","last_became_active":"2023-05-11T07:35:44.048856+0000","last_became_peered":"2023-05-11T07:35:44.048856+0000","last_unstale":"2023-05-11T07:35:46.891981+0000","last_undegraded":"2023-05-11T07:35:46.891981+0000","last_fullsized":"2023-05-11T07:35:46.891981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:59:50.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.003945+0000","last_change":"2023-05-11T07:35:39.522351+0000","last_active":"2023-05-11T07:35:45.003945+0000","last_peered":"2023-05-11T07:35:45.003945+0000","last_clean":"2023-05-11T07:35:45.003945+0000","last_became_active":"2023-05-11T07:35:39.522056+0000","last_became_peered":"2023-05-11T07:35:39.522056+0000","last_unstale":"2023-05-11T07:35:45.003945+0000","last_undegraded":"2023-05-11T07:35:45.003945+0000","last_fullsized":"2023-05-11T07:35:45.003945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:47:55.321727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516630+0000","last_change":"2023-05-11T07:35:40.027281+0000","last_active":"2023-05-11T07:35:44.516630+0000","last_peered":"2023-05-11T07:35:44.516630+0000","last_clean":"2023-05-11T07:35:44.516630+0000","last_became_active":"2023-05-11T07:35:40.026683+0000","last_became_peered":"2023-05-11T07:35:40.026683+0000","last_unstale":"2023-05-11T07:35:44.516630+0000","last_undegraded":"2023-05-11T07:35:44.516630+0000","last_fullsized":"2023-05-11T07:35:44.516630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516623+0000","last_change":"2023-05-11T07:35:44.045971+0000","last_active":"2023-05-11T07:35:44.516623+0000","last_peered":"2023-05-11T07:35:44.516623+0000","last_clean":"2023-05-11T07:35:44.516623+0000","last_became_active":"2023-05-11T07:35:44.045617+0000","last_became_peered":"2023-05-11T07:35:44.045617+0000","last_unstale":"2023-05-11T07:35:44.516623+0000","last_undegraded":"2023-05-11T07:35:44.516623+0000","last_fullsized":"2023-05-11T07:35:44.516623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:57.332534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560634+0000","last_change":"2023-05-11T07:35:39.521019+0000","last_active":"2023-05-11T07:35:47.560634+0000","last_peered":"2023-05-11T07:35:47.560634+0000","last_clean":"2023-05-11T07:35:47.560634+0000","last_became_active":"2023-05-11T07:35:39.520725+0000","last_became_peered":"2023-05-11T07:35:39.520725+0000","last_unstale":"2023-05-11T07:35:47.560634+0000","last_undegraded":"2023-05-11T07:35:47.560634+0000","last_fullsized":"2023-05-11T07:35:47.560634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.892105+0000","last_change":"2023-05-11T07:35:40.028356+0000","last_active":"2023-05-11T07:35:46.892105+0000","last_peered":"2023-05-11T07:35:46.892105+0000","last_clean":"2023-05-11T07:35:46.892105+0000","last_became_active":"2023-05-11T07:35:40.028139+0000","last_became_peered":"2023-05-11T07:35:40.028139+0000","last_unstale":"2023-05-11T07:35:46.892105+0000","last_undegraded":"2023-05-11T07:35:46.892105+0000","last_fullsized":"2023-05-11T07:35:46.892105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:09:08.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:44.048081+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:44.047704+0000","last_became_peered":"2023-05-11T07:35:44.047704+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:27.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516590+0000","last_change":"2023-05-11T07:35:39.524366+0000","last_active":"2023-05-11T07:35:44.516590+0000","last_peered":"2023-05-11T07:35:44.516590+0000","last_clean":"2023-05-11T07:35:44.516590+0000","last_became_active":"2023-05-11T07:35:39.523956+0000","last_became_peered":"2023-05-11T07:35:39.523956+0000","last_unstale":"2023-05-11T07:35:44.516590+0000","last_undegraded":"2023-05-11T07:35:44.516590+0000","last_fullsized":"2023-05-11T07:35:44.516590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:49.699791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561237+0000","last_change":"2023-05-11T07:35:40.004665+0000","last_active":"2023-05-11T07:35:47.561237+0000","last_peered":"2023-05-11T07:35:47.561237+0000","last_clean":"2023-05-11T07:35:47.561237+0000","last_became_active":"2023-05-11T07:35:40.004422+0000","last_became_peered":"2023-05-11T07:35:40.004422+0000","last_unstale":"2023-05-11T07:35:47.561237+0000","last_undegraded":"2023-05-11T07:35:47.561237+0000","last_fullsized":"2023-05-11T07:35:47.561237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517909+0000","last_change":"2023-05-11T07:35:44.059577+0000","last_active":"2023-05-11T07:35:44.517909+0000","last_peered":"2023-05-11T07:35:44.517909+0000","last_clean":"2023-05-11T07:35:44.517909+0000","last_became_active":"2023-05-11T07:35:44.058668+0000","last_became_peered":"2023-05-11T07:35:44.058668+0000","last_unstale":"2023-05-11T07:35:44.517909+0000","last_undegraded":"2023-05-11T07:35:44.517909+0000","last_fullsized":"2023-05-11T07:35:44.517909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:06.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015648+0000","last_change":"2023-05-11T07:35:39.516925+0000","last_active":"2023-05-11T07:35:45.015648+0000","last_peered":"2023-05-11T07:35:45.015648+0000","last_clean":"2023-05-11T07:35:45.015648+0000","last_became_active":"2023-05-11T07:35:39.516579+0000","last_became_peered":"2023-05-11T07:35:39.516579+0000","last_unstale":"2023-05-11T07:35:45.015648+0000","last_undegraded":"2023-05-11T07:35:45.015648+0000","last_fullsized":"2023-05-11T07:35:45.015648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:48:28.388729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560769+0000","last_change":"2023-05-11T07:35:40.020195+0000","last_active":"2023-05-11T07:35:47.560769+0000","last_peered":"2023-05-11T07:35:47.560769+0000","last_clean":"2023-05-11T07:35:47.560769+0000","last_became_active":"2023-05-11T07:35:40.020000+0000","last_became_peered":"2023-05-11T07:35:40.020000+0000","last_unstale":"2023-05-11T07:35:47.560769+0000","last_undegraded":"2023-05-11T07:35:47.560769+0000","last_fullsized":"2023-05-11T07:35:47.560769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561713+0000","last_change":"2023-05-11T07:35:44.046341+0000","last_active":"2023-05-11T07:35:47.561713+0000","last_peered":"2023-05-11T07:35:47.561713+0000","last_clean":"2023-05-11T07:35:47.561713+0000","last_became_active":"2023-05-11T07:35:44.045931+0000","last_became_peered":"2023-05-11T07:35:44.045931+0000","last_unstale":"2023-05-11T07:35:47.561713+0000","last_undegraded":"2023-05-11T07:35:47.561713+0000","last_fullsized":"2023-05-11T07:35:47.561713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:43:00.804549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518863+0000","last_change":"2023-05-11T07:35:39.522292+0000","last_active":"2023-05-11T07:35:44.518863+0000","last_peered":"2023-05-11T07:35:44.518863+0000","last_clean":"2023-05-11T07:35:44.518863+0000","last_became_active":"2023-05-11T07:35:39.522044+0000","last_became_peered":"2023-05-11T07:35:39.522044+0000","last_unstale":"2023-05-11T07:35:44.518863+0000","last_undegraded":"2023-05-11T07:35:44.518863+0000","last_fullsized":"2023-05-11T07:35:44.518863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004352+0000","last_change":"2023-05-11T07:35:40.006244+0000","last_active":"2023-05-11T07:35:45.004352+0000","last_peered":"2023-05-11T07:35:45.004352+0000","last_clean":"2023-05-11T07:35:45.004352+0000","last_became_active":"2023-05-11T07:35:40.006008+0000","last_became_peered":"2023-05-11T07:35:40.006008+0000","last_unstale":"2023-05-11T07:35:45.004352+0000","last_undegraded":"2023-05-11T07:35:45.004352+0000","last_fullsized":"2023-05-11T07:35:45.004352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004124+0000","last_change":"2023-05-11T07:35:44.050216+0000","last_active":"2023-05-11T07:35:45.004124+0000","last_peered":"2023-05-11T07:35:45.004124+0000","last_clean":"2023-05-11T07:35:45.004124+0000","last_became_active":"2023-05-11T07:35:44.049821+0000","last_became_peered":"2023-05-11T07:35:44.049821+0000","last_unstale":"2023-05-11T07:35:45.004124+0000","last_undegraded":"2023-05-11T07:35:45.004124+0000","last_fullsized":"2023-05-11T07:35:45.004124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:52:59.303972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:58.639060+0000","last_change":"2023-05-11T07:35:39.524270+0000","last_active":"2023-05-11T07:35:58.639060+0000","last_peered":"2023-05-11T07:35:58.639060+0000","last_clean":"2023-05-11T07:35:58.639060+0000","last_became_active":"2023-05-11T07:35:39.523839+0000","last_became_peered":"2023-05-11T07:35:39.523839+0000","last_unstale":"2023-05-11T07:35:58.639060+0000","last_undegraded":"2023-05-11T07:35:58.639060+0000","last_fullsized":"2023-05-11T07:35:58.639060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:22:25.344878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561662+0000","last_change":"2023-05-11T07:35:40.023719+0000","last_active":"2023-05-11T07:35:47.561662+0000","last_peered":"2023-05-11T07:35:47.561662+0000","last_clean":"2023-05-11T07:35:47.561662+0000","last_became_active":"2023-05-11T07:35:40.023383+0000","last_became_peered":"2023-05-11T07:35:40.023383+0000","last_unstale":"2023-05-11T07:35:47.561662+0000","last_undegraded":"2023-05-11T07:35:47.561662+0000","last_fullsized":"2023-05-11T07:35:47.561662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:42.106118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015869+0000","last_change":"2023-05-11T07:35:44.049508+0000","last_active":"2023-05-11T07:35:45.015869+0000","last_peered":"2023-05-11T07:35:45.015869+0000","last_clean":"2023-05-11T07:35:45.015869+0000","last_became_active":"2023-05-11T07:35:44.049065+0000","last_became_peered":"2023-05-11T07:35:44.049065+0000","last_unstale":"2023-05-11T07:35:45.015869+0000","last_undegraded":"2023-05-11T07:35:45.015869+0000","last_fullsized":"2023-05-11T07:35:45.015869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:40.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518317+0000","last_change":"2023-05-11T07:35:39.531094+0000","last_active":"2023-05-11T07:35:44.518317+0000","last_peered":"2023-05-11T07:35:44.518317+0000","last_clean":"2023-05-11T07:35:44.518317+0000","last_became_active":"2023-05-11T07:35:39.530798+0000","last_became_peered":"2023-05-11T07:35:39.530798+0000","last_unstale":"2023-05-11T07:35:44.518317+0000","last_undegraded":"2023-05-11T07:35:44.518317+0000","last_fullsized":"2023-05-11T07:35:44.518317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:35.170874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561870+0000","last_change":"2023-05-11T07:35:40.005168+0000","last_active":"2023-05-11T07:35:47.561870+0000","last_peered":"2023-05-11T07:35:47.561870+0000","last_clean":"2023-05-11T07:35:47.561870+0000","last_became_active":"2023-05-11T07:35:40.004912+0000","last_became_peered":"2023-05-11T07:35:40.004912+0000","last_unstale":"2023-05-11T07:35:47.561870+0000","last_undegraded":"2023-05-11T07:35:47.561870+0000","last_fullsized":"2023-05-11T07:35:47.561870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:42.658238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561731+0000","last_change":"2023-05-11T07:35:44.048532+0000","last_active":"2023-05-11T07:35:47.561731+0000","last_peered":"2023-05-11T07:35:47.561731+0000","last_clean":"2023-05-11T07:35:47.561731+0000","last_became_active":"2023-05-11T07:35:44.048154+0000","last_became_peered":"2023-05-11T07:35:44.048154+0000","last_unstale":"2023-05-11T07:35:47.561731+0000","last_undegraded":"2023-05-11T07:35:47.561731+0000","last_fullsized":"2023-05-11T07:35:47.561731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:15.060562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516352+0000","last_change":"2023-05-11T07:35:39.522998+0000","last_active":"2023-05-11T07:35:44.516352+0000","last_peered":"2023-05-11T07:35:44.516352+0000","last_clean":"2023-05-11T07:35:44.516352+0000","last_became_active":"2023-05-11T07:35:39.522721+0000","last_became_peered":"2023-05-11T07:35:39.522721+0000","last_unstale":"2023-05-11T07:35:44.516352+0000","last_undegraded":"2023-05-11T07:35:44.516352+0000","last_fullsized":"2023-05-11T07:35:44.516352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:33.291889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015465+0000","last_change":"2023-05-11T07:35:40.032638+0000","last_active":"2023-05-11T07:35:45.015465+0000","last_peered":"2023-05-11T07:35:45.015465+0000","last_clean":"2023-05-11T07:35:45.015465+0000","last_became_active":"2023-05-11T07:35:40.032296+0000","last_became_peered":"2023-05-11T07:35:40.032296+0000","last_unstale":"2023-05-11T07:35:45.015465+0000","last_undegraded":"2023-05-11T07:35:45.015465+0000","last_fullsized":"2023-05-11T07:35:45.015465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:42:43.821239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562026+0000","last_change":"2023-05-11T07:35:44.048077+0000","last_active":"2023-05-11T07:35:47.562026+0000","last_peered":"2023-05-11T07:35:47.562026+0000","last_clean":"2023-05-11T07:35:47.562026+0000","last_became_active":"2023-05-11T07:35:44.047653+0000","last_became_peered":"2023-05-11T07:35:44.047653+0000","last_unstale":"2023-05-11T07:35:47.562026+0000","last_undegraded":"2023-05-11T07:35:47.562026+0000","last_fullsized":"2023-05-11T07:35:47.562026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517958+0000","last_change":"2023-05-11T07:35:39.529551+0000","last_active":"2023-05-11T07:35:44.517958+0000","last_peered":"2023-05-11T07:35:44.517958+0000","last_clean":"2023-05-11T07:35:44.517958+0000","last_became_active":"2023-05-11T07:35:39.529219+0000","last_became_peered":"2023-05-11T07:35:39.529219+0000","last_unstale":"2023-05-11T07:35:44.517958+0000","last_undegraded":"2023-05-11T07:35:44.517958+0000","last_fullsized":"2023-05-11T07:35:44.517958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:32.191475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516724+0000","last_change":"2023-05-11T07:35:40.027456+0000","last_active":"2023-05-11T07:35:44.516724+0000","last_peered":"2023-05-11T07:35:44.516724+0000","last_clean":"2023-05-11T07:35:44.516724+0000","last_became_active":"2023-05-11T07:35:40.027006+0000","last_became_peered":"2023-05-11T07:35:40.027006+0000","last_unstale":"2023-05-11T07:35:44.516724+0000","last_undegraded":"2023-05-11T07:35:44.516724+0000","last_fullsized":"2023-05-11T07:35:44.516724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015429+0000","last_change":"2023-05-11T07:35:44.051656+0000","last_active":"2023-05-11T07:35:45.015429+0000","last_peered":"2023-05-11T07:35:45.015429+0000","last_clean":"2023-05-11T07:35:45.015429+0000","last_became_active":"2023-05-11T07:35:44.051177+0000","last_became_peered":"2023-05-11T07:35:44.051177+0000","last_unstale":"2023-05-11T07:35:45.015429+0000","last_undegraded":"2023-05-11T07:35:45.015429+0000","last_fullsized":"2023-05-11T07:35:45.015429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:31:20.083650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891445+0000","last_change":"2023-05-11T07:35:39.525663+0000","last_active":"2023-05-11T07:35:46.891445+0000","last_peered":"2023-05-11T07:35:46.891445+0000","last_clean":"2023-05-11T07:35:46.891445+0000","last_became_active":"2023-05-11T07:35:39.525120+0000","last_became_peered":"2023-05-11T07:35:39.525120+0000","last_unstale":"2023-05-11T07:35:46.891445+0000","last_undegraded":"2023-05-11T07:35:46.891445+0000","last_fullsized":"2023-05-11T07:35:46.891445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:53:41.174416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562065+0000","last_change":"2023-05-11T07:35:40.019244+0000","last_active":"2023-05-11T07:35:47.562065+0000","last_peered":"2023-05-11T07:35:47.562065+0000","last_clean":"2023-05-11T07:35:47.562065+0000","last_became_active":"2023-05-11T07:35:40.018998+0000","last_became_peered":"2023-05-11T07:35:40.018998+0000","last_unstale":"2023-05-11T07:35:47.562065+0000","last_undegraded":"2023-05-11T07:35:47.562065+0000","last_fullsized":"2023-05-11T07:35:47.562065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:35.403397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518703+0000","last_change":"2023-05-11T07:35:44.056854+0000","last_active":"2023-05-11T07:35:44.518703+0000","last_peered":"2023-05-11T07:35:44.518703+0000","last_clean":"2023-05-11T07:35:44.518703+0000","last_became_active":"2023-05-11T07:35:44.056483+0000","last_became_peered":"2023-05-11T07:35:44.056483+0000","last_unstale":"2023-05-11T07:35:44.518703+0000","last_undegraded":"2023-05-11T07:35:44.518703+0000","last_fullsized":"2023-05-11T07:35:44.518703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:38.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518566+0000","last_change":"2023-05-11T07:35:39.529492+0000","last_active":"2023-05-11T07:35:44.518566+0000","last_peered":"2023-05-11T07:35:44.518566+0000","last_clean":"2023-05-11T07:35:44.518566+0000","last_became_active":"2023-05-11T07:35:39.529182+0000","last_became_peered":"2023-05-11T07:35:39.529182+0000","last_unstale":"2023-05-11T07:35:44.518566+0000","last_undegraded":"2023-05-11T07:35:44.518566+0000","last_fullsized":"2023-05-11T07:35:44.518566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:41.677638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014849+0000","last_change":"2023-05-11T07:35:40.029916+0000","last_active":"2023-05-11T07:35:45.014849+0000","last_peered":"2023-05-11T07:35:45.014849+0000","last_clean":"2023-05-11T07:35:45.014849+0000","last_became_active":"2023-05-11T07:35:40.029633+0000","last_became_peered":"2023-05-11T07:35:40.029633+0000","last_unstale":"2023-05-11T07:35:45.014849+0000","last_undegraded":"2023-05-11T07:35:45.014849+0000","last_fullsized":"2023-05-11T07:35:45.014849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089763+0000","last_change":"2023-05-11T07:35:44.046464+0000","last_active":"2023-05-11T07:35:45.089763+0000","last_peered":"2023-05-11T07:35:45.089763+0000","last_clean":"2023-05-11T07:35:45.089763+0000","last_became_active":"2023-05-11T07:35:44.046046+0000","last_became_peered":"2023-05-11T07:35:44.046046+0000","last_unstale":"2023-05-11T07:35:45.089763+0000","last_undegraded":"2023-05-11T07:35:45.089763+0000","last_fullsized":"2023-05-11T07:35:45.089763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:31:21.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518773+0000","last_change":"2023-05-11T07:35:39.529523+0000","last_active":"2023-05-11T07:35:44.518773+0000","last_peered":"2023-05-11T07:35:44.518773+0000","last_clean":"2023-05-11T07:35:44.518773+0000","last_became_active":"2023-05-11T07:35:39.529198+0000","last_became_peered":"2023-05-11T07:35:39.529198+0000","last_unstale":"2023-05-11T07:35:44.518773+0000","last_undegraded":"2023-05-11T07:35:44.518773+0000","last_fullsized":"2023-05-11T07:35:44.518773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:56.284794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561457+0000","last_change":"2023-05-11T07:35:40.021866+0000","last_active":"2023-05-11T07:35:47.561457+0000","last_peered":"2023-05-11T07:35:47.561457+0000","last_clean":"2023-05-11T07:35:47.561457+0000","last_became_active":"2023-05-11T07:35:40.021576+0000","last_became_peered":"2023-05-11T07:35:40.021576+0000","last_unstale":"2023-05-11T07:35:47.561457+0000","last_undegraded":"2023-05-11T07:35:47.561457+0000","last_fullsized":"2023-05-11T07:35:47.561457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:19:05.603259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089718+0000","last_change":"2023-05-11T07:35:44.045836+0000","last_active":"2023-05-11T07:35:45.089718+0000","last_peered":"2023-05-11T07:35:45.089718+0000","last_clean":"2023-05-11T07:35:45.089718+0000","last_became_active":"2023-05-11T07:35:44.045453+0000","last_became_peered":"2023-05-11T07:35:44.045453+0000","last_unstale":"2023-05-11T07:35:45.089718+0000","last_undegraded":"2023-05-11T07:35:45.089718+0000","last_fullsized":"2023-05-11T07:35:45.089718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.845162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518973+0000","last_change":"2023-05-11T07:35:39.526694+0000","last_active":"2023-05-11T07:35:44.518973+0000","last_peered":"2023-05-11T07:35:44.518973+0000","last_clean":"2023-05-11T07:35:44.518973+0000","last_became_active":"2023-05-11T07:35:39.526370+0000","last_became_peered":"2023-05-11T07:35:39.526370+0000","last_unstale":"2023-05-11T07:35:44.518973+0000","last_undegraded":"2023-05-11T07:35:44.518973+0000","last_fullsized":"2023-05-11T07:35:44.518973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:13:59.267692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:40.014209+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:40.013884+0000","last_became_peered":"2023-05-11T07:35:40.013884+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:49:21.339051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089552+0000","last_change":"2023-05-11T07:35:44.050723+0000","last_active":"2023-05-11T07:35:45.089552+0000","last_peered":"2023-05-11T07:35:45.089552+0000","last_clean":"2023-05-11T07:35:45.089552+0000","last_became_active":"2023-05-11T07:35:44.050285+0000","last_became_peered":"2023-05-11T07:35:44.050285+0000","last_unstale":"2023-05-11T07:35:45.089552+0000","last_undegraded":"2023-05-11T07:35:45.089552+0000","last_fullsized":"2023-05-11T07:35:45.089552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:44:48.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015149+0000","last_change":"2023-05-11T07:35:39.506013+0000","last_active":"2023-05-11T07:35:45.015149+0000","last_peered":"2023-05-11T07:35:45.015149+0000","last_clean":"2023-05-11T07:35:45.015149+0000","last_became_active":"2023-05-11T07:35:39.505714+0000","last_became_peered":"2023-05-11T07:35:39.505714+0000","last_unstale":"2023-05-11T07:35:45.015149+0000","last_undegraded":"2023-05-11T07:35:45.015149+0000","last_fullsized":"2023-05-11T07:35:45.015149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:01.700365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517568+0000","last_change":"2023-05-11T07:35:40.018422+0000","last_active":"2023-05-11T07:35:44.517568+0000","last_peered":"2023-05-11T07:35:44.517568+0000","last_clean":"2023-05-11T07:35:44.517568+0000","last_became_active":"2023-05-11T07:35:40.018159+0000","last_became_peered":"2023-05-11T07:35:40.018159+0000","last_unstale":"2023-05-11T07:35:44.517568+0000","last_undegraded":"2023-05-11T07:35:44.517568+0000","last_fullsized":"2023-05-11T07:35:44.517568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089716+0000","last_change":"2023-05-11T07:35:44.047834+0000","last_active":"2023-05-11T07:35:45.089716+0000","last_peered":"2023-05-11T07:35:45.089716+0000","last_clean":"2023-05-11T07:35:45.089716+0000","last_became_active":"2023-05-11T07:35:44.047465+0000","last_became_peered":"2023-05-11T07:35:44.047465+0000","last_unstale":"2023-05-11T07:35:45.089716+0000","last_undegraded":"2023-05-11T07:35:45.089716+0000","last_fullsized":"2023-05-11T07:35:45.089716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:59:10.577106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560876+0000","last_change":"2023-05-11T07:35:39.523143+0000","last_active":"2023-05-11T07:35:47.560876+0000","last_peered":"2023-05-11T07:35:47.560876+0000","last_clean":"2023-05-11T07:35:47.560876+0000","last_became_active":"2023-05-11T07:35:39.522833+0000","last_became_peered":"2023-05-11T07:35:39.522833+0000","last_unstale":"2023-05-11T07:35:47.560876+0000","last_undegraded":"2023-05-11T07:35:47.560876+0000","last_fullsized":"2023-05-11T07:35:47.560876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:43.170391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561462+0000","last_change":"2023-05-11T07:35:40.019416+0000","last_active":"2023-05-11T07:35:47.561462+0000","last_peered":"2023-05-11T07:35:47.561462+0000","last_clean":"2023-05-11T07:35:47.561462+0000","last_became_active":"2023-05-11T07:35:40.017783+0000","last_became_peered":"2023-05-11T07:35:40.017783+0000","last_unstale":"2023-05-11T07:35:47.561462+0000","last_undegraded":"2023-05-11T07:35:47.561462+0000","last_fullsized":"2023-05-11T07:35:47.561462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:40.343002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004455+0000","last_change":"2023-05-11T07:35:44.043607+0000","last_active":"2023-05-11T07:35:45.004455+0000","last_peered":"2023-05-11T07:35:45.004455+0000","last_clean":"2023-05-11T07:35:45.004455+0000","last_became_active":"2023-05-11T07:35:44.043204+0000","last_became_peered":"2023-05-11T07:35:44.043204+0000","last_unstale":"2023-05-11T07:35:45.004455+0000","last_undegraded":"2023-05-11T07:35:45.004455+0000","last_fullsized":"2023-05-11T07:35:45.004455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:57.120095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891506+0000","last_change":"2023-05-11T07:35:39.520690+0000","last_active":"2023-05-11T07:35:46.891506+0000","last_peered":"2023-05-11T07:35:46.891506+0000","last_clean":"2023-05-11T07:35:46.891506+0000","last_became_active":"2023-05-11T07:35:39.520360+0000","last_became_peered":"2023-05-11T07:35:39.520360+0000","last_unstale":"2023-05-11T07:35:46.891506+0000","last_undegraded":"2023-05-11T07:35:46.891506+0000","last_fullsized":"2023-05-11T07:35:46.891506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:07:45.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561931+0000","last_change":"2023-05-11T07:35:40.019241+0000","last_active":"2023-05-11T07:35:47.561931+0000","last_peered":"2023-05-11T07:35:47.561931+0000","last_clean":"2023-05-11T07:35:47.561931+0000","last_became_active":"2023-05-11T07:35:40.018965+0000","last_became_peered":"2023-05-11T07:35:40.018965+0000","last_unstale":"2023-05-11T07:35:47.561931+0000","last_undegraded":"2023-05-11T07:35:47.561931+0000","last_fullsized":"2023-05-11T07:35:47.561931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:05.166289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015716+0000","last_change":"2023-05-11T07:35:44.056735+0000","last_active":"2023-05-11T07:35:45.015716+0000","last_peered":"2023-05-11T07:35:45.015716+0000","last_clean":"2023-05-11T07:35:45.015716+0000","last_became_active":"2023-05-11T07:35:44.056344+0000","last_became_peered":"2023-05-11T07:35:44.056344+0000","last_unstale":"2023-05-11T07:35:45.015716+0000","last_undegraded":"2023-05-11T07:35:45.015716+0000","last_fullsized":"2023-05-11T07:35:45.015716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:05.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560559+0000","last_change":"2023-05-11T07:35:39.521039+0000","last_active":"2023-05-11T07:35:47.560559+0000","last_peered":"2023-05-11T07:35:47.560559+0000","last_clean":"2023-05-11T07:35:47.560559+0000","last_became_active":"2023-05-11T07:35:39.519579+0000","last_became_peered":"2023-05-11T07:35:39.519579+0000","last_unstale":"2023-05-11T07:35:47.560559+0000","last_undegraded":"2023-05-11T07:35:47.560559+0000","last_fullsized":"2023-05-11T07:35:47.560559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:17.898498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562159+0000","last_change":"2023-05-11T07:35:40.024176+0000","last_active":"2023-05-11T07:35:47.562159+0000","last_peered":"2023-05-11T07:35:47.562159+0000","last_clean":"2023-05-11T07:35:47.562159+0000","last_became_active":"2023-05-11T07:35:40.023913+0000","last_became_peered":"2023-05-11T07:35:40.023913+0000","last_unstale":"2023-05-11T07:35:47.562159+0000","last_undegraded":"2023-05-11T07:35:47.562159+0000","last_fullsized":"2023-05-11T07:35:47.562159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:45:40.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562016+0000","last_change":"2023-05-11T07:35:44.053961+0000","last_active":"2023-05-11T07:35:47.562016+0000","last_peered":"2023-05-11T07:35:47.562016+0000","last_clean":"2023-05-11T07:35:47.562016+0000","last_became_active":"2023-05-11T07:35:44.053562+0000","last_became_peered":"2023-05-11T07:35:44.053562+0000","last_unstale":"2023-05-11T07:35:47.562016+0000","last_undegraded":"2023-05-11T07:35:47.562016+0000","last_fullsized":"2023-05-11T07:35:47.562016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:43:09.942525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560794+0000","last_change":"2023-05-11T07:35:39.519635+0000","last_active":"2023-05-11T07:35:47.560794+0000","last_peered":"2023-05-11T07:35:47.560794+0000","last_clean":"2023-05-11T07:35:47.560794+0000","last_became_active":"2023-05-11T07:35:39.519358+0000","last_became_peered":"2023-05-11T07:35:39.519358+0000","last_unstale":"2023-05-11T07:35:47.560794+0000","last_undegraded":"2023-05-11T07:35:47.560794+0000","last_fullsized":"2023-05-11T07:35:47.560794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004912+0000","last_change":"2023-05-11T07:35:40.005569+0000","last_active":"2023-05-11T07:35:45.004912+0000","last_peered":"2023-05-11T07:35:45.004912+0000","last_clean":"2023-05-11T07:35:45.004912+0000","last_became_active":"2023-05-11T07:35:40.005265+0000","last_became_peered":"2023-05-11T07:35:40.005265+0000","last_unstale":"2023-05-11T07:35:45.004912+0000","last_undegraded":"2023-05-11T07:35:45.004912+0000","last_fullsized":"2023-05-11T07:35:45.004912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:05.664545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516637+0000","last_change":"2023-05-11T07:35:44.044625+0000","last_active":"2023-05-11T07:35:44.516637+0000","last_peered":"2023-05-11T07:35:44.516637+0000","last_clean":"2023-05-11T07:35:44.516637+0000","last_became_active":"2023-05-11T07:35:44.044209+0000","last_became_peered":"2023-05-11T07:35:44.044209+0000","last_unstale":"2023-05-11T07:35:44.516637+0000","last_undegraded":"2023-05-11T07:35:44.516637+0000","last_fullsized":"2023-05-11T07:35:44.516637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:05.083240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004520+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:35:45.004520+0000","last_peered":"2023-05-11T07:35:45.004520+0000","last_clean":"2023-05-11T07:35:45.004520+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:35:45.004520+0000","last_undegraded":"2023-05-11T07:35:45.004520+0000","last_fullsized":"2023-05-11T07:35:45.004520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:19.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015475+0000","last_change":"2023-05-11T07:35:39.507928+0000","last_active":"2023-05-11T07:35:45.015475+0000","last_peered":"2023-05-11T07:35:45.015475+0000","last_clean":"2023-05-11T07:35:45.015475+0000","last_became_active":"2023-05-11T07:35:39.507652+0000","last_became_peered":"2023-05-11T07:35:39.507652+0000","last_unstale":"2023-05-11T07:35:45.015475+0000","last_undegraded":"2023-05-11T07:35:45.015475+0000","last_fullsized":"2023-05-11T07:35:45.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:10.367809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004210+0000","last_change":"2023-05-11T07:35:40.023291+0000","last_active":"2023-05-11T07:35:45.004210+0000","last_peered":"2023-05-11T07:35:45.004210+0000","last_clean":"2023-05-11T07:35:45.004210+0000","last_became_active":"2023-05-11T07:35:40.023039+0000","last_became_peered":"2023-05-11T07:35:40.023039+0000","last_unstale":"2023-05-11T07:35:45.004210+0000","last_undegraded":"2023-05-11T07:35:45.004210+0000","last_fullsized":"2023-05-11T07:35:45.004210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:34.298746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516791+0000","last_change":"2023-05-11T07:35:44.056582+0000","last_active":"2023-05-11T07:35:44.516791+0000","last_peered":"2023-05-11T07:35:44.516791+0000","last_clean":"2023-05-11T07:35:44.516791+0000","last_became_active":"2023-05-11T07:35:44.055990+0000","last_became_peered":"2023-05-11T07:35:44.055990+0000","last_unstale":"2023-05-11T07:35:44.516791+0000","last_undegraded":"2023-05-11T07:35:44.516791+0000","last_fullsized":"2023-05-11T07:35:44.516791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:09.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014983+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:35:45.014983+0000","last_peered":"2023-05-11T07:35:45.014983+0000","last_clean":"2023-05-11T07:35:45.014983+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:35:45.014983+0000","last_undegraded":"2023-05-11T07:35:45.014983+0000","last_fullsized":"2023-05-11T07:35:45.014983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:04.852885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560659+0000","last_change":"2023-05-11T07:35:39.525461+0000","last_active":"2023-05-11T07:35:47.560659+0000","last_peered":"2023-05-11T07:35:47.560659+0000","last_clean":"2023-05-11T07:35:47.560659+0000","last_became_active":"2023-05-11T07:35:39.525087+0000","last_became_peered":"2023-05-11T07:35:39.525087+0000","last_unstale":"2023-05-11T07:35:47.560659+0000","last_undegraded":"2023-05-11T07:35:47.560659+0000","last_fullsized":"2023-05-11T07:35:47.560659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:32:39.463622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004389+0000","last_change":"2023-05-11T07:35:40.015281+0000","last_active":"2023-05-11T07:35:45.004389+0000","last_peered":"2023-05-11T07:35:45.004389+0000","last_clean":"2023-05-11T07:35:45.004389+0000","last_became_active":"2023-05-11T07:35:40.015024+0000","last_became_peered":"2023-05-11T07:35:40.015024+0000","last_unstale":"2023-05-11T07:35:45.004389+0000","last_undegraded":"2023-05-11T07:35:45.004389+0000","last_fullsized":"2023-05-11T07:35:45.004389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:25.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089964+0000","last_change":"2023-05-11T07:35:44.051357+0000","last_active":"2023-05-11T07:35:45.089964+0000","last_peered":"2023-05-11T07:35:45.089964+0000","last_clean":"2023-05-11T07:35:45.089964+0000","last_became_active":"2023-05-11T07:35:44.051006+0000","last_became_peered":"2023-05-11T07:35:44.051006+0000","last_unstale":"2023-05-11T07:35:45.089964+0000","last_undegraded":"2023-05-11T07:35:45.089964+0000","last_fullsized":"2023-05-11T07:35:45.089964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:52:35.255028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089456+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:35:45.089456+0000","last_peered":"2023-05-11T07:35:45.089456+0000","last_clean":"2023-05-11T07:35:45.089456+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:35:45.089456+0000","last_undegraded":"2023-05-11T07:35:45.089456+0000","last_fullsized":"2023-05-11T07:35:45.089456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:55:52.663792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004173+0000","last_change":"2023-05-11T07:35:39.519332+0000","last_active":"2023-05-11T07:35:45.004173+0000","last_peered":"2023-05-11T07:35:45.004173+0000","last_clean":"2023-05-11T07:35:45.004173+0000","last_became_active":"2023-05-11T07:35:39.518915+0000","last_became_peered":"2023-05-11T07:35:39.518915+0000","last_unstale":"2023-05-11T07:35:45.004173+0000","last_undegraded":"2023-05-11T07:35:45.004173+0000","last_fullsized":"2023-05-11T07:35:45.004173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004831+0000","last_change":"2023-05-11T07:35:40.029329+0000","last_active":"2023-05-11T07:35:45.004831+0000","last_peered":"2023-05-11T07:35:45.004831+0000","last_clean":"2023-05-11T07:35:45.004831+0000","last_became_active":"2023-05-11T07:35:40.029022+0000","last_became_peered":"2023-05-11T07:35:40.029022+0000","last_unstale":"2023-05-11T07:35:45.004831+0000","last_undegraded":"2023-05-11T07:35:45.004831+0000","last_fullsized":"2023-05-11T07:35:45.004831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518310+0000","last_change":"2023-05-11T07:35:44.049973+0000","last_active":"2023-05-11T07:35:44.518310+0000","last_peered":"2023-05-11T07:35:44.518310+0000","last_clean":"2023-05-11T07:35:44.518310+0000","last_became_active":"2023-05-11T07:35:44.049495+0000","last_became_peered":"2023-05-11T07:35:44.049495+0000","last_unstale":"2023-05-11T07:35:44.518310+0000","last_undegraded":"2023-05-11T07:35:44.518310+0000","last_fullsized":"2023-05-11T07:35:44.518310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:18.555450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015274+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:35:45.015274+0000","last_peered":"2023-05-11T07:35:45.015274+0000","last_clean":"2023-05-11T07:35:45.015274+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:35:45.015274+0000","last_undegraded":"2023-05-11T07:35:45.015274+0000","last_fullsized":"2023-05-11T07:35:45.015274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:03:52.797193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517992+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:35:44.517992+0000","last_peered":"2023-05-11T07:35:44.517992+0000","last_clean":"2023-05-11T07:35:44.517992+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:35:44.517992+0000","last_undegraded":"2023-05-11T07:35:44.517992+0000","last_fullsized":"2023-05-11T07:35:44.517992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:36:52.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561588+0000","last_change":"2023-05-11T07:35:39.510017+0000","last_active":"2023-05-11T07:35:47.561588+0000","last_peered":"2023-05-11T07:35:47.561588+0000","last_clean":"2023-05-11T07:35:47.561588+0000","last_became_active":"2023-05-11T07:35:39.509671+0000","last_became_peered":"2023-05-11T07:35:39.509671+0000","last_unstale":"2023-05-11T07:35:47.561588+0000","last_undegraded":"2023-05-11T07:35:47.561588+0000","last_fullsized":"2023-05-11T07:35:47.561588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:34.377733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891878+0000","last_change":"2023-05-11T07:35:40.008915+0000","last_active":"2023-05-11T07:35:46.891878+0000","last_peered":"2023-05-11T07:35:46.891878+0000","last_clean":"2023-05-11T07:35:46.891878+0000","last_became_active":"2023-05-11T07:35:40.008581+0000","last_became_peered":"2023-05-11T07:35:40.008581+0000","last_unstale":"2023-05-11T07:35:46.891878+0000","last_undegraded":"2023-05-11T07:35:46.891878+0000","last_fullsized":"2023-05-11T07:35:46.891878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:40:05.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015471+0000","last_change":"2023-05-11T07:35:44.057326+0000","last_active":"2023-05-11T07:35:45.015471+0000","last_peered":"2023-05-11T07:35:45.015471+0000","last_clean":"2023-05-11T07:35:45.015471+0000","last_became_active":"2023-05-11T07:35:44.056853+0000","last_became_peered":"2023-05-11T07:35:44.056853+0000","last_unstale":"2023-05-11T07:35:45.015471+0000","last_undegraded":"2023-05-11T07:35:45.015471+0000","last_fullsized":"2023-05-11T07:35:45.015471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:23.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518296+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:35:44.518296+0000","last_peered":"2023-05-11T07:35:44.518296+0000","last_clean":"2023-05-11T07:35:44.518296+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:35:44.518296+0000","last_undegraded":"2023-05-11T07:35:44.518296+0000","last_fullsized":"2023-05-11T07:35:44.518296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:17.235034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516272+0000","last_change":"2023-05-11T07:35:39.524833+0000","last_active":"2023-05-11T07:35:44.516272+0000","last_peered":"2023-05-11T07:35:44.516272+0000","last_clean":"2023-05-11T07:35:44.516272+0000","last_became_active":"2023-05-11T07:35:39.524447+0000","last_became_peered":"2023-05-11T07:35:39.524447+0000","last_unstale":"2023-05-11T07:35:44.516272+0000","last_undegraded":"2023-05-11T07:35:44.516272+0000","last_fullsized":"2023-05-11T07:35:44.516272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516309+0000","last_change":"2023-05-11T07:35:40.023349+0000","last_active":"2023-05-11T07:35:44.516309+0000","last_peered":"2023-05-11T07:35:44.516309+0000","last_clean":"2023-05-11T07:35:44.516309+0000","last_became_active":"2023-05-11T07:35:40.023100+0000","last_became_peered":"2023-05-11T07:35:40.023100+0000","last_unstale":"2023-05-11T07:35:44.516309+0000","last_undegraded":"2023-05-11T07:35:44.516309+0000","last_fullsized":"2023-05-11T07:35:44.516309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.824139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891965+0000","last_change":"2023-05-11T07:35:44.043637+0000","last_active":"2023-05-11T07:35:46.891965+0000","last_peered":"2023-05-11T07:35:46.891965+0000","last_clean":"2023-05-11T07:35:46.891965+0000","last_became_active":"2023-05-11T07:35:44.043165+0000","last_became_peered":"2023-05-11T07:35:44.043165+0000","last_unstale":"2023-05-11T07:35:46.891965+0000","last_undegraded":"2023-05-11T07:35:46.891965+0000","last_fullsized":"2023-05-11T07:35:46.891965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:49.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518831+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:35:44.518831+0000","last_peered":"2023-05-11T07:35:44.518831+0000","last_clean":"2023-05-11T07:35:44.518831+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:35:44.518831+0000","last_undegraded":"2023-05-11T07:35:44.518831+0000","last_fullsized":"2023-05-11T07:35:44.518831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:50:56.012444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004600+0000","last_change":"2023-05-11T07:35:39.518954+0000","last_active":"2023-05-11T07:35:45.004600+0000","last_peered":"2023-05-11T07:35:45.004600+0000","last_clean":"2023-05-11T07:35:45.004600+0000","last_became_active":"2023-05-11T07:35:39.518679+0000","last_became_peered":"2023-05-11T07:35:39.518679+0000","last_unstale":"2023-05-11T07:35:45.004600+0000","last_undegraded":"2023-05-11T07:35:45.004600+0000","last_fullsized":"2023-05-11T07:35:45.004600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516743+0000","last_change":"2023-05-11T07:35:40.027840+0000","last_active":"2023-05-11T07:35:44.516743+0000","last_peered":"2023-05-11T07:35:44.516743+0000","last_clean":"2023-05-11T07:35:44.516743+0000","last_became_active":"2023-05-11T07:35:40.027601+0000","last_became_peered":"2023-05-11T07:35:40.027601+0000","last_unstale":"2023-05-11T07:35:44.516743+0000","last_undegraded":"2023-05-11T07:35:44.516743+0000","last_fullsized":"2023-05-11T07:35:44.516743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561680+0000","last_change":"2023-05-11T07:35:44.057877+0000","last_active":"2023-05-11T07:35:47.561680+0000","last_peered":"2023-05-11T07:35:47.561680+0000","last_clean":"2023-05-11T07:35:47.561680+0000","last_became_active":"2023-05-11T07:35:44.057419+0000","last_became_peered":"2023-05-11T07:35:44.057419+0000","last_unstale":"2023-05-11T07:35:47.561680+0000","last_undegraded":"2023-05-11T07:35:47.561680+0000","last_fullsized":"2023-05-11T07:35:47.561680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:08:36.688411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561013+0000","last_change":"2023-05-11T07:35:39.520251+0000","last_active":"2023-05-11T07:35:47.561013+0000","last_peered":"2023-05-11T07:35:47.561013+0000","last_clean":"2023-05-11T07:35:47.561013+0000","last_became_active":"2023-05-11T07:35:39.519934+0000","last_became_peered":"2023-05-11T07:35:39.519934+0000","last_unstale":"2023-05-11T07:35:47.561013+0000","last_undegraded":"2023-05-11T07:35:47.561013+0000","last_fullsized":"2023-05-11T07:35:47.561013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:04.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004725+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:35:45.004725+0000","last_peered":"2023-05-11T07:35:45.004725+0000","last_clean":"2023-05-11T07:35:45.004725+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:35:45.004725+0000","last_undegraded":"2023-05-11T07:35:45.004725+0000","last_fullsized":"2023-05-11T07:35:45.004725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:14.281579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561109+0000","last_change":"2023-05-11T07:35:40.019926+0000","last_active":"2023-05-11T07:35:47.561109+0000","last_peered":"2023-05-11T07:35:47.561109+0000","last_clean":"2023-05-11T07:35:47.561109+0000","last_became_active":"2023-05-11T07:35:40.019675+0000","last_became_peered":"2023-05-11T07:35:40.019675+0000","last_unstale":"2023-05-11T07:35:47.561109+0000","last_undegraded":"2023-05-11T07:35:47.561109+0000","last_fullsized":"2023-05-11T07:35:47.561109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560939+0000","last_change":"2023-05-11T07:35:44.043124+0000","last_active":"2023-05-11T07:35:47.560939+0000","last_peered":"2023-05-11T07:35:47.560939+0000","last_clean":"2023-05-11T07:35:47.560939+0000","last_became_active":"2023-05-11T07:35:44.042657+0000","last_became_peered":"2023-05-11T07:35:44.042657+0000","last_unstale":"2023-05-11T07:35:47.560939+0000","last_undegraded":"2023-05-11T07:35:47.560939+0000","last_fullsized":"2023-05-11T07:35:47.560939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:36.711230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891959+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:35:46.891959+0000","last_peered":"2023-05-11T07:35:46.891959+0000","last_clean":"2023-05-11T07:35:46.891959+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:35:46.891959+0000","last_undegraded":"2023-05-11T07:35:46.891959+0000","last_fullsized":"2023-05-11T07:35:46.891959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:55:13.429347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516483+0000","last_change":"2023-05-11T07:35:39.522039+0000","last_active":"2023-05-11T07:35:44.516483+0000","last_peered":"2023-05-11T07:35:44.516483+0000","last_clean":"2023-05-11T07:35:44.516483+0000","last_became_active":"2023-05-11T07:35:39.521457+0000","last_became_peered":"2023-05-11T07:35:39.521457+0000","last_unstale":"2023-05-11T07:35:44.516483+0000","last_undegraded":"2023-05-11T07:35:44.516483+0000","last_fullsized":"2023-05-11T07:35:44.516483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:24.062361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561314+0000","last_change":"2023-05-11T07:35:40.019321+0000","last_active":"2023-05-11T07:35:47.561314+0000","last_peered":"2023-05-11T07:35:47.561314+0000","last_clean":"2023-05-11T07:35:47.561314+0000","last_became_active":"2023-05-11T07:35:40.019071+0000","last_became_peered":"2023-05-11T07:35:40.019071+0000","last_unstale":"2023-05-11T07:35:47.561314+0000","last_undegraded":"2023-05-11T07:35:47.561314+0000","last_fullsized":"2023-05-11T07:35:47.561314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:09.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004624+0000","last_change":"2023-05-11T07:35:44.056475+0000","last_active":"2023-05-11T07:35:45.004624+0000","last_peered":"2023-05-11T07:35:45.004624+0000","last_clean":"2023-05-11T07:35:45.004624+0000","last_became_active":"2023-05-11T07:35:44.056110+0000","last_became_peered":"2023-05-11T07:35:44.056110+0000","last_unstale":"2023-05-11T07:35:45.004624+0000","last_undegraded":"2023-05-11T07:35:45.004624+0000","last_fullsized":"2023-05-11T07:35:45.004624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:54.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516667+0000","last_change":"2023-05-11T07:35:39.525088+0000","last_active":"2023-05-11T07:35:44.516667+0000","last_peered":"2023-05-11T07:35:44.516667+0000","last_clean":"2023-05-11T07:35:44.516667+0000","last_became_active":"2023-05-11T07:35:39.524603+0000","last_became_peered":"2023-05-11T07:35:39.524603+0000","last_unstale":"2023-05-11T07:35:44.516667+0000","last_undegraded":"2023-05-11T07:35:44.516667+0000","last_fullsized":"2023-05-11T07:35:44.516667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089889+0000","last_change":"2023-05-11T07:35:40.008368+0000","last_active":"2023-05-11T07:35:45.089889+0000","last_peered":"2023-05-11T07:35:45.089889+0000","last_clean":"2023-05-11T07:35:45.089889+0000","last_became_active":"2023-05-11T07:35:40.006963+0000","last_became_peered":"2023-05-11T07:35:40.006963+0000","last_unstale":"2023-05-11T07:35:45.089889+0000","last_undegraded":"2023-05-11T07:35:45.089889+0000","last_fullsized":"2023-05-11T07:35:45.089889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:16:58.803321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518483+0000","last_change":"2023-05-11T07:35:44.056975+0000","last_active":"2023-05-11T07:35:44.518483+0000","last_peered":"2023-05-11T07:35:44.518483+0000","last_clean":"2023-05-11T07:35:44.518483+0000","last_became_active":"2023-05-11T07:35:44.056495+0000","last_became_peered":"2023-05-11T07:35:44.056495+0000","last_unstale":"2023-05-11T07:35:44.518483+0000","last_undegraded":"2023-05-11T07:35:44.518483+0000","last_fullsized":"2023-05-11T07:35:44.518483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:53.367006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015252+0000","last_change":"2023-05-11T07:35:39.521916+0000","last_active":"2023-05-11T07:35:45.015252+0000","last_peered":"2023-05-11T07:35:45.015252+0000","last_clean":"2023-05-11T07:35:45.015252+0000","last_became_active":"2023-05-11T07:35:39.521597+0000","last_became_peered":"2023-05-11T07:35:39.521597+0000","last_unstale":"2023-05-11T07:35:45.015252+0000","last_undegraded":"2023-05-11T07:35:45.015252+0000","last_fullsized":"2023-05-11T07:35:45.015252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:34.396540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561427+0000","last_change":"2023-05-11T07:35:40.017540+0000","last_active":"2023-05-11T07:35:47.561427+0000","last_peered":"2023-05-11T07:35:47.561427+0000","last_clean":"2023-05-11T07:35:47.561427+0000","last_became_active":"2023-05-11T07:35:40.016451+0000","last_became_peered":"2023-05-11T07:35:40.016451+0000","last_unstale":"2023-05-11T07:35:47.561427+0000","last_undegraded":"2023-05-11T07:35:47.561427+0000","last_fullsized":"2023-05-11T07:35:47.561427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:44:21.145951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015327+0000","last_change":"2023-05-11T07:35:44.052508+0000","last_active":"2023-05-11T07:35:45.015327+0000","last_peered":"2023-05-11T07:35:45.015327+0000","last_clean":"2023-05-11T07:35:45.015327+0000","last_became_active":"2023-05-11T07:35:44.052017+0000","last_became_peered":"2023-05-11T07:35:44.052017+0000","last_unstale":"2023-05-11T07:35:45.015327+0000","last_undegraded":"2023-05-11T07:35:45.015327+0000","last_fullsized":"2023-05-11T07:35:45.015327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015262+0000","last_change":"2023-05-11T07:35:39.521328+0000","last_active":"2023-05-11T07:35:45.015262+0000","last_peered":"2023-05-11T07:35:45.015262+0000","last_clean":"2023-05-11T07:35:45.015262+0000","last_became_active":"2023-05-11T07:35:39.521000+0000","last_became_peered":"2023-05-11T07:35:39.521000+0000","last_unstale":"2023-05-11T07:35:45.015262+0000","last_undegraded":"2023-05-11T07:35:45.015262+0000","last_fullsized":"2023-05-11T07:35:45.015262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.018737+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.017851+0000","last_became_peered":"2023-05-11T07:35:40.017851+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:34:37.153358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561068+0000","last_change":"2023-05-11T07:35:44.054974+0000","last_active":"2023-05-11T07:35:47.561068+0000","last_peered":"2023-05-11T07:35:47.561068+0000","last_clean":"2023-05-11T07:35:47.561068+0000","last_became_active":"2023-05-11T07:35:44.051992+0000","last_became_peered":"2023-05-11T07:35:44.051992+0000","last_unstale":"2023-05-11T07:35:47.561068+0000","last_undegraded":"2023-05-11T07:35:47.561068+0000","last_fullsized":"2023-05-11T07:35:47.561068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:01:14.299594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561390+0000","last_change":"2023-05-11T07:35:39.517443+0000","last_active":"2023-05-11T07:35:47.561390+0000","last_peered":"2023-05-11T07:35:47.561390+0000","last_clean":"2023-05-11T07:35:47.561390+0000","last_became_active":"2023-05-11T07:35:39.517129+0000","last_became_peered":"2023-05-11T07:35:39.517129+0000","last_unstale":"2023-05-11T07:35:47.561390+0000","last_undegraded":"2023-05-11T07:35:47.561390+0000","last_fullsized":"2023-05-11T07:35:47.561390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:48.847251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561320+0000","last_change":"2023-05-11T07:35:40.006173+0000","last_active":"2023-05-11T07:35:47.561320+0000","last_peered":"2023-05-11T07:35:47.561320+0000","last_clean":"2023-05-11T07:35:47.561320+0000","last_became_active":"2023-05-11T07:35:40.005890+0000","last_became_peered":"2023-05-11T07:35:40.005890+0000","last_unstale":"2023-05-11T07:35:47.561320+0000","last_undegraded":"2023-05-11T07:35:47.561320+0000","last_fullsized":"2023-05-11T07:35:47.561320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:36.177731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004231+0000","last_change":"2023-05-11T07:35:44.049707+0000","last_active":"2023-05-11T07:35:45.004231+0000","last_peered":"2023-05-11T07:35:45.004231+0000","last_clean":"2023-05-11T07:35:45.004231+0000","last_became_active":"2023-05-11T07:35:44.048969+0000","last_became_peered":"2023-05-11T07:35:44.048969+0000","last_unstale":"2023-05-11T07:35:45.004231+0000","last_undegraded":"2023-05-11T07:35:45.004231+0000","last_fullsized":"2023-05-11T07:35:45.004231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:27.337039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516740+0000","last_change":"2023-05-11T07:35:39.524299+0000","last_active":"2023-05-11T07:35:44.516740+0000","last_peered":"2023-05-11T07:35:44.516740+0000","last_clean":"2023-05-11T07:35:44.516740+0000","last_became_active":"2023-05-11T07:35:39.523715+0000","last_became_peered":"2023-05-11T07:35:39.523715+0000","last_unstale":"2023-05-11T07:35:44.516740+0000","last_undegraded":"2023-05-11T07:35:44.516740+0000","last_fullsized":"2023-05-11T07:35:44.516740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:50.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561653+0000","last_change":"2023-05-11T07:35:40.024550+0000","last_active":"2023-05-11T07:35:47.561653+0000","last_peered":"2023-05-11T07:35:47.561653+0000","last_clean":"2023-05-11T07:35:47.561653+0000","last_became_active":"2023-05-11T07:35:40.024275+0000","last_became_peered":"2023-05-11T07:35:40.024275+0000","last_unstale":"2023-05-11T07:35:47.561653+0000","last_undegraded":"2023-05-11T07:35:47.561653+0000","last_fullsized":"2023-05-11T07:35:47.561653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:34:28.815609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891614+0000","last_change":"2023-05-11T07:35:40.006241+0000","last_active":"2023-05-11T07:35:46.891614+0000","last_peered":"2023-05-11T07:35:46.891614+0000","last_clean":"2023-05-11T07:35:46.891614+0000","last_became_active":"2023-05-11T07:35:40.004809+0000","last_became_peered":"2023-05-11T07:35:40.004809+0000","last_unstale":"2023-05-11T07:35:46.891614+0000","last_undegraded":"2023-05-11T07:35:46.891614+0000","last_fullsized":"2023-05-11T07:35:46.891614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:12:57.760117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561474+0000","last_change":"2023-05-11T07:35:40.005112+0000","last_active":"2023-05-11T07:35:47.561474+0000","last_peered":"2023-05-11T07:35:47.561474+0000","last_clean":"2023-05-11T07:35:47.561474+0000","last_became_active":"2023-05-11T07:35:40.004879+0000","last_became_peered":"2023-05-11T07:35:40.004879+0000","last_unstale":"2023-05-11T07:35:47.561474+0000","last_undegraded":"2023-05-11T07:35:47.561474+0000","last_fullsized":"2023-05-11T07:35:47.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561826+0000","last_change":"2023-05-11T07:35:40.025239+0000","last_active":"2023-05-11T07:35:47.561826+0000","last_peered":"2023-05-11T07:35:47.561826+0000","last_clean":"2023-05-11T07:35:47.561826+0000","last_became_active":"2023-05-11T07:35:40.024971+0000","last_became_peered":"2023-05-11T07:35:40.024971+0000","last_unstale":"2023-05-11T07:35:47.561826+0000","last_undegraded":"2023-05-11T07:35:47.561826+0000","last_fullsized":"2023-05-11T07:35:47.561826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:24.724155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561353+0000","last_change":"2023-05-11T07:35:40.021603+0000","last_active":"2023-05-11T07:35:47.561353+0000","last_peered":"2023-05-11T07:35:47.561353+0000","last_clean":"2023-05-11T07:35:47.561353+0000","last_became_active":"2023-05-11T07:35:40.021312+0000","last_became_peered":"2023-05-11T07:35:40.021312+0000","last_unstale":"2023-05-11T07:35:47.561353+0000","last_undegraded":"2023-05-11T07:35:47.561353+0000","last_fullsized":"2023-05-11T07:35:47.561353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004544+0000","last_change":"2023-05-11T07:35:40.017015+0000","last_active":"2023-05-11T07:35:45.004544+0000","last_peered":"2023-05-11T07:35:45.004544+0000","last_clean":"2023-05-11T07:35:45.004544+0000","last_became_active":"2023-05-11T07:35:40.016304+0000","last_became_peered":"2023-05-11T07:35:40.016304+0000","last_unstale":"2023-05-11T07:35:45.004544+0000","last_undegraded":"2023-05-11T07:35:45.004544+0000","last_fullsized":"2023-05-11T07:35:45.004544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:53.819634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":713999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:36:09.074 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-11T07:36:09.075 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-11T07:36:09.075 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-11T07:36:09.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-11T07:36:09.076 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-11T07:36:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.287+0000 7f0d051ff700 1 Processor -- start 2023-05-11T07:36:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.287+0000 7f0d051ff700 1 -- start start 2023-05-11T07:36:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0d051ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0015a3e0 0x7f0d000cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0d051ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d000b5290 0x7f0d0015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0d051ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d000d0510 con 0x7f0d0015d880 2023-05-11T07:36:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0d051ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d000cda80 con 0x7f0d0015a3e0 2023-05-11T07:36:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0d051ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000cf4f0 con 0x7f0d000b5290 2023-05-11T07:36:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.288+0000 7f0cfed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0015a3e0 0x7f0d000cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0015a3e0 0x7f0d000cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41548/0 (socket says 172.21.15.144:41548) 2023-05-11T07:36:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 -- 172.21.15.144:0/1995794619 learned_addr learned my addr 172.21.15.144:0/1995794619 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cff59e700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d000b5290 0x7f0d0015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 -- 172.21.15.144:0/1995794619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d000b5290 msgr2=0x7f0d0015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d000b5290 0x7f0d0015dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 -- 172.21.15.144:0/1995794619 >> v1:172.21.15.144:6789/0 conn(0x7f0d0015d880 legacy=0x7f0d000b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 -- 172.21.15.144:0/1995794619 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000cf7d0 con 0x7f0d0015a3e0 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfed9d700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0015a3e0 0x7f0d000cffd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009920 tx=0x7f0cf0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeac9d6b72acf38 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfdd9b700 1 -- 172.21.15.144:0/1995794619 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000ba20 con 0x7f0d0015a3e0 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfdd9b700 1 -- 172.21.15.144:0/1995794619 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf000bb80 con 0x7f0d0015a3e0 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.289+0000 7f0cfdd9b700 1 -- 172.21.15.144:0/1995794619 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0009e70 con 0x7f0d0015a3e0 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 -- 172.21.15.144:0/1995794619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0015a3e0 msgr2=0x7f0d000cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0015a3e0 0x7f0d000cffd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009920 tx=0x7f0cf0009c30 comp rx=0 tx=0).stop 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 -- 172.21.15.144:0/1995794619 shutdown_connections 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0015a3e0 0x7f0d000cffd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 --2- 172.21.15.144:0/1995794619 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d000b5290 0x7f0d0015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 -- 172.21.15.144:0/1995794619 >> 172.21.15.144:0/1995794619 conn(0x7f0d0006ad30 msgr2=0x7f0d0006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 -- 172.21.15.144:0/1995794619 shutdown_connections 2023-05-11T07:36:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.290+0000 7f0d051ff700 1 -- 172.21.15.144:0/1995794619 wait complete. 2023-05-11T07:36:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.292+0000 7f0d051ff700 1 Processor -- start 2023-05-11T07:36:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.293+0000 7f0d051ff700 1 -- start start 2023-05-11T07:36:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 0x7f0d00156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 0x7f0d00157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001f2fb0 con 0x7f0d000b5290 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001f3290 con 0x7f0d0015d880 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0d051ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000b60b0 con 0x7f0d0015a3e0 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41564/0 (socket says 172.21.15.144:41564) 2023-05-11T07:36:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 -- 172.21.15.144:0/3845131213 learned_addr learned my addr 172.21.15.144:0/3845131213 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfe59c700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 0x7f0d00156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cff59e700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 0x7f0d00157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 -- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 msgr2=0x7f0d00156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 0x7f0d00156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 -- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 msgr2=0x7f0d00157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 0x7f0d00157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfed9d700 1 -- 172.21.15.144:0/3845131213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009550 con 0x7f0d000b5290 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cfe59c700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 0x7f0d00156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.294+0000 7f0cff59e700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 0x7f0d00157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0cfed9d700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c010 tx=0x7f0cf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0004400 con 0x7f0d000b5290 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf001f070 con 0x7f0d000b5290 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0015a7b0 con 0x7f0d000b5290 2023-05-11T07:36:09.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00038e0 con 0x7f0d000b5290 2023-05-11T07:36:09.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.295+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d000cfab0 con 0x7f0d000b5290 2023-05-11T07:36:09.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.296+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0015dd20 con 0x7f0d000b5290 2023-05-11T07:36:09.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.297+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cf0021030 con 0x7f0d000b5290 2023-05-11T07:36:09.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.298+0000 7f0ce77fe700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 0x7f0cec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.298+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0cf008ac20 con 0x7f0d000b5290 2023-05-11T07:36:09.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.298+0000 7f0cfe59c700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 0x7f0cec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.299+0000 7f0cfe59c700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 0x7f0cec06d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d00157a30 tx=0x7f0cf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.302+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0cf0055af0 con 0x7f0d000b5290 2023-05-11T07:36:09.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.551+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0d000b65d0 con 0x7f0d000b5290 2023-05-11T07:36:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.554+0000 7f0ce77fe700 1 -- 172.21.15.144:0/3845131213 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170846 (secure 0 0 0) 0x7f0d000b65d0 con 0x7f0d000b5290 2023-05-11T07:36:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:09.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 msgr2=0x7f0cec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 0x7f0cec06d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d00157a30 tx=0x7f0cf4009040 comp rx=0 tx=0).stop 2023-05-11T07:36:09.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 msgr2=0x7f0d000b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c010 tx=0x7f0cf0004750 comp rx=0 tx=0).stop 2023-05-11T07:36:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 shutdown_connections 2023-05-11T07:36:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0cec06ace0 0x7f0cec06d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0d0015d880 0x7f0d00157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d000b5290 0x7f0d000b68b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 --2- 172.21.15.144:0/3845131213 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0d0015a3e0 0x7f0d00156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.557+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 >> 172.21.15.144:0/3845131213 conn(0x7f0d0006ad30 msgr2=0x7f0d0015eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.558+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 shutdown_connections 2023-05-11T07:36:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.558+0000 7f0d051ff700 1 -- 172.21.15.144:0/3845131213 wait complete. 2023-05-11T07:36:09.578 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2010441590},{"type":"v1","addr":"172.21.15.144:6833","nonce":2010441590}]},"active_addr":"172.21.15.144:6833/2010441590","active_change":"2023-05-11T07:35:19.698612+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":744748260}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":50659044}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3471365559}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3882818234}]}]} 2023-05-11T07:36:09.583 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-11T07:36:09.584 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-11T07:36:09.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:09.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.766+0000 7ff6173ff700 1 Processor -- start 2023-05-11T07:36:09.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.766+0000 7ff6173ff700 1 -- start start 2023-05-11T07:36:09.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff6173ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff6100b52a0 0x7ff6100d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff6173ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61015cef0 con 0x7ff6100b87e0 2023-05-11T07:36:09.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff6173ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100cd760 con 0x7ff6100d02c0 2023-05-11T07:36:09.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff6173ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100b5a80 con 0x7ff6100b52a0 2023-05-11T07:36:09.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff61519b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff6100b87e0 0x7ff6100b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40708/0 (socket says 172.21.15.144:40708) 2023-05-11T07:36:09.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.767+0000 7ff61519b700 1 -- 172.21.15.144:0/1829054056 learned_addr learned my addr 172.21.15.144:0/1829054056 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff61499a700 1 --2- 172.21.15.144:0/1829054056 >> v2:172.21.15.145:3300/0 conn(0x7ff6100b52a0 0x7ff6100d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033688397 0 0) 0x7ff60c001110 con 0x7ff6100b87e0 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5fc0035b0 con 0x7ff6100b87e0 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff61499a700 1 -- 172.21.15.144:0/1829054056 >> v1:172.21.15.145:6789/0 conn(0x7ff6100d02c0 legacy=0x7ff6100d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff61499a700 1 -- 172.21.15.144:0/1829054056 >> v1:172.21.15.144:6789/0 conn(0x7ff6100b87e0 legacy=0x7ff6100b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016701407 0 0) 0x7ff5fc0035b0 con 0x7ff6100b87e0 2023-05-11T07:36:09.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.768+0000 7ff61499a700 1 -- 172.21.15.144:0/1829054056 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100d2d30 con 0x7ff6100b52a0 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff61499a700 1 --2- 172.21.15.144:0/1829054056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b52a0 0x7ff6100d2090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38ec6b7d6f80c80 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c001800 con 0x7ff6100b52a0 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff600004030 con 0x7ff6100b52a0 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff607fff700 1 -- 172.21.15.144:0/1829054056 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6000043c0 con 0x7ff6100b52a0 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 -- 172.21.15.144:0/1829054056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b52a0 msgr2=0x7ff6100d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 --2- 172.21.15.144:0/1829054056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b52a0 0x7ff6100d2090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:09.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 -- 172.21.15.144:0/1829054056 shutdown_connections 2023-05-11T07:36:09.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 --2- 172.21.15.144:0/1829054056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b52a0 0x7ff6100d2090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 -- 172.21.15.144:0/1829054056 >> 172.21.15.144:0/1829054056 conn(0x7ff61006acf0 msgr2=0x7ff61006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:09.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 -- 172.21.15.144:0/1829054056 shutdown_connections 2023-05-11T07:36:09.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.769+0000 7ff6173ff700 1 -- 172.21.15.144:0/1829054056 wait complete. 2023-05-11T07:36:09.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.771+0000 7ff6173ff700 1 Processor -- start 2023-05-11T07:36:09.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.771+0000 7ff6173ff700 1 -- start start 2023-05-11T07:36:09.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 0x7ff6101fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6100d02c0 0x7ff6101f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6101e67e0 con 0x7ff6100b52a0 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6101e6470 con 0x7ff6100b87e0 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.772+0000 7ff6173ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100ca1e0 con 0x7ff6100d02c0 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41572/0 (socket says 172.21.15.144:41572) 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 -- 172.21.15.144:0/3832832477 learned_addr learned my addr 172.21.15.144:0/3832832477 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61499a700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 0x7ff6101fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 -- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6100d02c0 msgr2=0x7ff6101f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6100d02c0 0x7ff6101f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 -- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 msgr2=0x7ff6101fa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 0x7ff6101fa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 -- 172.21.15.144:0/3832832477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000094a0 con 0x7ff6100b52a0 2023-05-11T07:36:09.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61499a700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 0x7ff6101fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:09.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff61519b700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c750 tx=0x7ff60c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c004c80 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c004de0 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0072f0 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.773+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6100cdc90 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.774+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6100cd9b0 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.775+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6100b8bb0 con 0x7ff6100b52a0 2023-05-11T07:36:09.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.776+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff60c007450 con 0x7ff6100b52a0 2023-05-11T07:36:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.776+0000 7ff605ffb700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 0x7ff5f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.777+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff60c0893d0 con 0x7ff6100b52a0 2023-05-11T07:36:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.777+0000 7ff61499a700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 0x7ff5f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.777+0000 7ff61499a700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 0x7ff5f406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.781+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff60c054180 con 0x7ff6100b52a0 2023-05-11T07:36:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.973+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff61015ced0 con 0x7ff6100b52a0 2023-05-11T07:36:09.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.975+0000 7ff605ffb700 1 -- 172.21.15.144:0/3832832477 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7ff60c007700 con 0x7ff6100b52a0 2023-05-11T07:36:09.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:09.979 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 msgr2=0x7ff5f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 0x7ff5f406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff600009840 tx=0x7ff600008030 comp rx=0 tx=0).stop 2023-05-11T07:36:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 msgr2=0x7ff610157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c750 tx=0x7ff60c00cb10 comp rx=0 tx=0).stop 2023-05-11T07:36:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 shutdown_connections 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff5f406ace0 0x7ff5f406d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff6100d02c0 0x7ff6101f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6100b52a0 0x7ff610157f30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 --2- 172.21.15.144:0/3832832477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6100b87e0 0x7ff6101fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 >> 172.21.15.144:0/3832832477 conn(0x7ff61006acf0 msgr2=0x7ff6100d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.977+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 shutdown_connections 2023-05-11T07:36:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:09.978+0000 7ff6173ff700 1 -- 172.21.15.144:0/3832832477 wait complete. 2023-05-11T07:36:09.998 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-11T07:36:09.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.179+0000 7f703a9ff700 1 Processor -- start 2023-05-11T07:36:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.180+0000 7f703a9ff700 1 -- start start 2023-05-11T07:36:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f703a9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 0x7f70340b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f703a9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70340d27a0 0x7f70340b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f703a9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703415cef0 con 0x7f70340d02c0 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f703a9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340b5a80 con 0x7f70340d27a0 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f703a9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340cdf70 con 0x7f70340b87e0 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f7038f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70340d27a0 0x7f70340b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f7038f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70340d27a0 0x7f70340b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41584/0 (socket says 172.21.15.144:41584) 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f7038f9c700 1 -- 172.21.15.144:0/2838592308 learned_addr learned my addr 172.21.15.144:0/2838592308 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.181+0000 7f7033fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 0x7f70340b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7038f9c700 1 -- 172.21.15.144:0/2838592308 >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 msgr2=0x7f70340b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7038f9c700 1 --2- 172.21.15.144:0/2838592308 >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 0x7f70340b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f70337fe700 1 -- 172.21.15.144:0/2838592308 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208470538 0 0) 0x7f701c001110 con 0x7f70340d02c0 2023-05-11T07:36:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7038f9c700 1 -- 172.21.15.144:0/2838592308 >> v1:172.21.15.145:6789/0 conn(0x7f70340d02c0 legacy=0x7f70340d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7038f9c700 1 -- 172.21.15.144:0/2838592308 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340cd760 con 0x7f70340d27a0 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7033fff700 1 --2- 172.21.15.144:0/2838592308 >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 0x7f70340b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f7038f9c700 1 --2- 172.21.15.144:0/2838592308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d27a0 0x7f70340b50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70340b5cb0 tx=0x7f702c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727a8527498f7197 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f70337fe700 1 -- 172.21.15.144:0/2838592308 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00e070 con 0x7f70340d27a0 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f70337fe700 1 -- 172.21.15.144:0/2838592308 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00b910 con 0x7f70340d27a0 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.182+0000 7f70337fe700 1 -- 172.21.15.144:0/2838592308 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00bcc0 con 0x7f70340d27a0 2023-05-11T07:36:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 -- 172.21.15.144:0/2838592308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d27a0 msgr2=0x7f70340b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 --2- 172.21.15.144:0/2838592308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d27a0 0x7f70340b50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70340b5cb0 tx=0x7f702c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 -- 172.21.15.144:0/2838592308 shutdown_connections 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 --2- 172.21.15.144:0/2838592308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d27a0 0x7f70340b50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 --2- 172.21.15.144:0/2838592308 >> v2:172.21.15.145:3300/0 conn(0x7f70340b87e0 0x7f70340b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 -- 172.21.15.144:0/2838592308 >> 172.21.15.144:0/2838592308 conn(0x7f703406acf0 msgr2=0x7f703406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 -- 172.21.15.144:0/2838592308 shutdown_connections 2023-05-11T07:36:10.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.183+0000 7f703a9ff700 1 -- 172.21.15.144:0/2838592308 wait complete. 2023-05-11T07:36:10.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.185+0000 7f703a9ff700 1 Processor -- start 2023-05-11T07:36:10.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.185+0000 7f703a9ff700 1 -- start start 2023-05-11T07:36:10.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b87e0 0x7f7034151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70340d27a0 0x7f70340b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70341580b0 con 0x7f70340d02c0 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70341f6de0 con 0x7f70340d27a0 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.186+0000 7f703a9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70341f28a0 con 0x7f70340b87e0 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41594/0 (socket says 172.21.15.144:41594) 2023-05-11T07:36:10.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 -- 172.21.15.144:0/4054896853 learned_addr learned my addr 172.21.15.144:0/4054896853 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f7033fff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b87e0 0x7f7034151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f7038f9c700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70340d27a0 0x7f70340b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 -- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b87e0 msgr2=0x7f7034151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b87e0 0x7f7034151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 -- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70340d27a0 msgr2=0x7f70340b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70340d27a0 0x7f70340b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 -- 172.21.15.144:0/4054896853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240094a0 con 0x7f70340d02c0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.187+0000 7f702bfff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c750 tx=0x7f701c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.188+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0054e0 con 0x7f70340d02c0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.188+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c003680 con 0x7f70340d02c0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.188+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c009b30 con 0x7f70340d02c0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.188+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c003a30 con 0x7f70340d02c0 2023-05-11T07:36:10.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.188+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70340cd9b0 con 0x7f70340d02c0 2023-05-11T07:36:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.189+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70340d2d30 con 0x7f70340d02c0 2023-05-11T07:36:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.190+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f701c003b90 con 0x7f70340d02c0 2023-05-11T07:36:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.191+0000 7f70317fa700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 0x7f701406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.191+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f701c088ad0 con 0x7f70340d02c0 2023-05-11T07:36:10.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.191+0000 7f7033fff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 0x7f701406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.191+0000 7f7033fff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 0x7f701406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70341f5dc0 tx=0x7f7024009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.195+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f701c057280 con 0x7f70340d02c0 2023-05-11T07:36:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.389+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70340cdc90 con 0x7f70340d02c0 2023-05-11T07:36:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.390+0000 7f70317fa700 1 -- 172.21.15.144:0/4054896853 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f701c056e10 con 0x7f70340d02c0 2023-05-11T07:36:10.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:10.395 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 msgr2=0x7f701406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 0x7f701406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70341f5dc0 tx=0x7f7024009210 comp rx=0 tx=0).stop 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 msgr2=0x7f7034156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c750 tx=0x7f701c00ca60 comp rx=0 tx=0).stop 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 shutdown_connections 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f701406ace0 0x7f701406d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f70340b87e0 0x7f7034151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70340d27a0 0x7f70340b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 --2- 172.21.15.144:0/4054896853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70340d02c0 0x7f7034156a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 >> 172.21.15.144:0/4054896853 conn(0x7f703406acf0 msgr2=0x7f70340b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 shutdown_connections 2023-05-11T07:36:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.393+0000 7f703a9ff700 1 -- 172.21.15.144:0/4054896853 wait complete. 2023-05-11T07:36:10.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-11T07:36:10.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-11T07:36:10.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-11T07:36:10.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-11T07:36:10.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-11T07:36:10.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-11T07:36:10.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-11T07:36:10.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-11T07:36:10.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.752+0000 7fe6617ff700 1 Processor -- start 2023-05-11T07:36:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.753+0000 7f0b18bff700 1 Processor -- start 2023-05-11T07:36:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.753+0000 7f0b18bff700 1 -- start start 2023-05-11T07:36:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.753+0000 7f3a1bdff700 1 Processor -- start 2023-05-11T07:36:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.753+0000 7f3a1bdff700 1 -- start start 2023-05-11T07:36:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.753+0000 7fe6617ff700 1 -- start start 2023-05-11T07:36:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7f3a1bdff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3a140ca830 0x7f3a141654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7f3a1bdff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a140b0720 0x7f3a140b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7f3a1bdff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b1060 con 0x7f3a14160fa0 2023-05-11T07:36:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7f3a1bdff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140caea0 con 0x7f3a140b0720 2023-05-11T07:36:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7f3a1bdff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140cb180 con 0x7f3a140ca830 2023-05-11T07:36:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.756+0000 7f3a1a39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a140b0720 0x7f3a140b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.756+0000 7f3a1a39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a140b0720 0x7f3a140b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41600/0 (socket says 172.21.15.144:41600) 2023-05-11T07:36:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.756+0000 7f3a1a39c700 1 -- 172.21.15.144:0/571424835 learned_addr learned my addr 172.21.15.144:0/571424835 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.756+0000 7f3a1939a700 1 --2- 172.21.15.144:0/571424835 >> v2:172.21.15.145:3300/0 conn(0x7f3a140ca830 0x7f3a141654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7fe6617ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe65c1650a0 0x7fe65c165510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7fe6617ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c0cc870 0x7fe65c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7fe6617ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c06d490 con 0x7fe65c160e10 2023-05-11T07:36:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7fe6617ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c164c50 con 0x7fe65c1650a0 2023-05-11T07:36:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.755+0000 7fe6617ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0cea30 con 0x7fe65c0cc870 2023-05-11T07:36:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7f0b18bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b140cbe30 0x7f0b140c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7f0b18bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b141588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7f0b18bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1415d0e0 con 0x7f0b140b0720 2023-05-11T07:36:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7f0b18bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1406c6d0 con 0x7f0b140cbe30 2023-05-11T07:36:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7f0b18bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1415fa80 con 0x7f0b140cacc0 2023-05-11T07:36:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7f3a1a39c700 1 -- 172.21.15.144:0/571424835 >> v2:172.21.15.145:3300/0 conn(0x7f3a140ca830 msgr2=0x7f3a141654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7f3a1a39c700 1 --2- 172.21.15.144:0/571424835 >> v2:172.21.15.145:3300/0 conn(0x7f3a140ca830 0x7f3a141654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7f3a1a39c700 1 -- 172.21.15.144:0/571424835 >> v1:172.21.15.145:6789/0 conn(0x7f3a14160fa0 legacy=0x7f3a14071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7f3a1a39c700 1 -- 172.21.15.144:0/571424835 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14164ca0 con 0x7f3a140b0720 2023-05-11T07:36:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.756+0000 7fe65a7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe65c1650a0 0x7fe65c165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe65c1650a0 0x7fe65c165510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41602/0 (socket says 172.21.15.144:41602) 2023-05-11T07:36:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 -- 172.21.15.144:0/3381587862 learned_addr learned my addr 172.21.15.144:0/3381587862 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fba239ff700 1 Processor -- start 2023-05-11T07:36:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65b7fe700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c0cc870 0x7fe65c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 -- 172.21.15.144:0/3381587862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c0cc870 msgr2=0x7fe65c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c0cc870 0x7fe65c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 -- 172.21.15.144:0/3381587862 >> v1:172.21.15.144:6789/0 conn(0x7fe65c160e10 legacy=0x7fe65c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fe65a7fc700 1 -- 172.21.15.144:0/3381587862 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0cb530 con 0x7fe65c1650a0 2023-05-11T07:36:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.758+0000 7fe65a7fc700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c1650a0 0x7fe65c165510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098f0 tx=0x7fe650009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e4210cbadd4905 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b1259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b140cbe30 0x7f0b140c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b11d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b141588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b1259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b140cbe30 0x7f0b140c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41608/0 (socket says 172.21.15.144:41608) 2023-05-11T07:36:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b1259c700 1 -- 172.21.15.144:0/2171375725 learned_addr learned my addr 172.21.15.144:0/2171375725 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f6725dff700 1 Processor -- start 2023-05-11T07:36:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fe659ffb700 1 -- 172.21.15.144:0/3381587862 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650004230 con 0x7fe65c1650a0 2023-05-11T07:36:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fe659ffb700 1 -- 172.21.15.144:0/3381587862 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650004390 con 0x7fe65c1650a0 2023-05-11T07:36:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fe659ffb700 1 -- 172.21.15.144:0/3381587862 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500036a0 con 0x7fe65c1650a0 2023-05-11T07:36:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b1259c700 1 -- 172.21.15.144:0/2171375725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 msgr2=0x7f0b141588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f0b1259c700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b141588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f0b1259c700 1 -- 172.21.15.144:0/2171375725 >> v1:172.21.15.144:6789/0 conn(0x7f0b140b0720 legacy=0x7f0b140cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f0b1259c700 1 -- 172.21.15.144:0/2171375725 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1415ca90 con 0x7f0b140cbe30 2023-05-11T07:36:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fe6617ff700 1 -- 172.21.15.144:0/3381587862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c1650a0 msgr2=0x7fe65c165510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c1650a0 0x7fe65c165510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098f0 tx=0x7fe650009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.757+0000 7fba239ff700 1 -- start start 2023-05-11T07:36:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fba239ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fba1c160e10 0x7fba1c0719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fba239ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 0x7fba1c1650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fba239ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c06d490 con 0x7fba1c1655e0 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fba239ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c164c50 con 0x7fba1c071ef0 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7fba239ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c0cea30 con 0x7fba1c160e10 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fba2179b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fba1c160e10 0x7fba1c0719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fba2179b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fba1c160e10 0x7fba1c0719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51632/0 (socket says 172.21.15.144:51632) 2023-05-11T07:36:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fba2179b700 1 -- 172.21.15.144:0/4131030238 learned_addr learned my addr 172.21.15.144:0/4131030238 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fba20f9a700 1 --2- 172.21.15.144:0/4131030238 >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 0x7fba1c1650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.759+0000 7f3a1a39c700 1 --2- 172.21.15.144:0/571424835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b0b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a140cde80 tx=0x7f3a04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a676bce260fcf744 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f3a18b99700 1 -- 172.21.15.144:0/571424835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004230 con 0x7f3a140b0720 2023-05-11T07:36:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f3a18b99700 1 -- 172.21.15.144:0/571424835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04004390 con 0x7f3a140b0720 2023-05-11T07:36:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f3a18b99700 1 -- 172.21.15.144:0/571424835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040036a0 con 0x7f3a140b0720 2023-05-11T07:36:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7fba2179b700 1 -- 172.21.15.144:0/4131030238 >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 msgr2=0x7fba1c1650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fba2179b700 1 --2- 172.21.15.144:0/4131030238 >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 0x7fba1c1650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fba2179b700 1 -- 172.21.15.144:0/4131030238 >> v1:172.21.15.144:6789/0 conn(0x7fba1c1655e0 legacy=0x7fba1c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fba2179b700 1 -- 172.21.15.144:0/4131030238 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0cb530 con 0x7fba1c160e10 2023-05-11T07:36:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fba20f9a700 1 --2- 172.21.15.144:0/4131030238 >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 0x7fba1c1650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f0b11d9b700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b141588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fe6617ff700 1 -- 172.21.15.144:0/3381587862 shutdown_connections 2023-05-11T07:36:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c0cc870 0x7fe65c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3381587862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c1650a0 0x7fe65c165510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fe6617ff700 1 -- 172.21.15.144:0/3381587862 >> 172.21.15.144:0/3381587862 conn(0x7fe65c0cb720 msgr2=0x7fe65c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7fba2179b700 1 --2- 172.21.15.144:0/4131030238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c0719b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba1c06fc10 tx=0x7fba1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d83f8d410a412a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7f3a1bdff700 1 -- 172.21.15.144:0/571424835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 msgr2=0x7f3a140b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/571424835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b0b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a140cde80 tx=0x7f3a04009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.761+0000 7f3a1bdff700 1 -- 172.21.15.144:0/571424835 shutdown_connections 2023-05-11T07:36:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/571424835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b0b20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/571424835 >> v2:172.21.15.145:3300/0 conn(0x7f3a140ca830 0x7f3a141654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f3a1bdff700 1 -- 172.21.15.144:0/571424835 >> 172.21.15.144:0/571424835 conn(0x7f3a1406af60 msgr2=0x7f3a140cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7fe6617ff700 1 -- 172.21.15.144:0/3381587862 shutdown_connections 2023-05-11T07:36:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.760+0000 7f6725dff700 1 -- start start 2023-05-11T07:36:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f0b1259c700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b140c92f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0098f0 tx=0x7f0b0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26b678be90b465 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f6725dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6720160ee0 0x7f672006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f6725dff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f672006b180 0x7f67200d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f6725dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200d0e80 con 0x7f672015c940 2023-05-11T07:36:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f6725dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672006b600 con 0x7f6720160ee0 2023-05-11T07:36:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7f6725dff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67200cdb00 con 0x7f672006b180 2023-05-11T07:36:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f0b1159a700 1 -- 172.21.15.144:0/2171375725 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00b8a0 con 0x7f0b140cbe30 2023-05-11T07:36:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f0b1159a700 1 -- 172.21.15.144:0/2171375725 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00ba00 con 0x7f0b140cbe30 2023-05-11T07:36:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f0b1159a700 1 -- 172.21.15.144:0/2171375725 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00bd90 con 0x7f0b140cbe30 2023-05-11T07:36:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 -- 172.21.15.144:0/2171375725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 msgr2=0x7f0b140c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b140c92f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0098f0 tx=0x7f0b0c009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f3a1bdff700 1 -- 172.21.15.144:0/571424835 shutdown_connections 2023-05-11T07:36:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f3a1bdff700 1 -- 172.21.15.144:0/571424835 wait complete. 2023-05-11T07:36:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7fba13fff700 1 -- 172.21.15.144:0/4131030238 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400e070 con 0x7fba1c160e10 2023-05-11T07:36:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7fba13fff700 1 -- 172.21.15.144:0/4131030238 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14003a20 con 0x7fba1c160e10 2023-05-11T07:36:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7fba13fff700 1 -- 172.21.15.144:0/4131030238 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14003dd0 con 0x7fba1c160e10 2023-05-11T07:36:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f672006b180 0x7f67200d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f672006b180 0x7f67200d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51648/0 (socket says 172.21.15.144:51648) 2023-05-11T07:36:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 -- 172.21.15.144:0/582126861 learned_addr learned my addr 172.21.15.144:0/582126861 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 -- 172.21.15.144:0/582126861 >> v2:172.21.15.144:3300/0 conn(0x7f6720160ee0 msgr2=0x7f672006ac40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T07:36:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 --2- 172.21.15.144:0/582126861 >> v2:172.21.15.144:3300/0 conn(0x7f6720160ee0 0x7f672006ac40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 -- 172.21.15.144:0/582126861 >> v1:172.21.15.145:6789/0 conn(0x7f672015c940 legacy=0x7f67200b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.763+0000 7f671ffff700 1 -- 172.21.15.144:0/582126861 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200cdde0 con 0x7f672006b180 2023-05-11T07:36:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f671ffff700 1 --2- 172.21.15.144:0/582126861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f67200d1920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67200d3100 tx=0x7f6718009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8893fdcfb5aae41e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 -- 172.21.15.144:0/2171375725 shutdown_connections 2023-05-11T07:36:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b140c92f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 --2- 172.21.15.144:0/2171375725 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b141588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f0b18bff700 1 -- 172.21.15.144:0/2171375725 >> 172.21.15.144:0/2171375725 conn(0x7f0b1406af60 msgr2=0x7f0b140cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7f3a1bdff700 1 Processor -- start 2023-05-11T07:36:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.762+0000 7fe6617ff700 1 -- 172.21.15.144:0/3381587862 wait complete. 2023-05-11T07:36:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7fe6617ff700 1 Processor -- start 2023-05-11T07:36:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7fba239ff700 1 -- 172.21.15.144:0/4131030238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 msgr2=0x7fba1c0719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7fba239ff700 1 --2- 172.21.15.144:0/4131030238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c0719b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba1c06fc10 tx=0x7fba1400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 -- 172.21.15.144:0/4131030238 shutdown_connections 2023-05-11T07:36:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 --2- 172.21.15.144:0/4131030238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c0719b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 --2- 172.21.15.144:0/4131030238 >> v2:172.21.15.144:3300/0 conn(0x7fba1c071ef0 0x7fba1c1650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 -- 172.21.15.144:0/4131030238 >> 172.21.15.144:0/4131030238 conn(0x7fba1c0cb720 msgr2=0x7fba1c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.764+0000 7f671effd700 1 -- 172.21.15.144:0/582126861 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718004230 con 0x7f672006b180 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7f671effd700 1 -- 172.21.15.144:0/582126861 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718004390 con 0x7f672006b180 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7f671effd700 1 -- 172.21.15.144:0/582126861 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180036a0 con 0x7f672006b180 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 -- 172.21.15.144:0/582126861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 msgr2=0x7f67200d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 --2- 172.21.15.144:0/582126861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f67200d1920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67200d3100 tx=0x7f6718009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 -- 172.21.15.144:0/582126861 shutdown_connections 2023-05-11T07:36:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 --2- 172.21.15.144:0/582126861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f67200d1920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 --2- 172.21.15.144:0/582126861 >> v2:172.21.15.144:3300/0 conn(0x7f6720160ee0 0x7f672006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f6725dff700 1 -- 172.21.15.144:0/582126861 >> 172.21.15.144:0/582126861 conn(0x7f67200d3180 msgr2=0x7f67200d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fe6617ff700 1 -- start start 2023-05-11T07:36:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c0cc870 0x7fe65c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c160e10 0x7fe65c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe65c1650a0 0x7fe65c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b2ee0 con 0x7fe65c0cc870 2023-05-11T07:36:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b2030 con 0x7fe65c1650a0 2023-05-11T07:36:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7fe6617ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b22d0 con 0x7fe65c160e10 2023-05-11T07:36:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 -- 172.21.15.144:0/4131030238 shutdown_connections 2023-05-11T07:36:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.765+0000 7fba239ff700 1 -- 172.21.15.144:0/4131030238 wait complete. 2023-05-11T07:36:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.766+0000 7f3a1bdff700 1 -- start start 2023-05-11T07:36:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7fe65b7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe65c1650a0 0x7fe65c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7fe65affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c0cc870 0x7fe65c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7fe65b7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe65c1650a0 0x7fe65c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51662/0 (socket says 172.21.15.144:51662) 2023-05-11T07:36:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7fe65b7fe700 1 -- 172.21.15.144:0/3716236764 learned_addr learned my addr 172.21.15.144:0/3716236764 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f6725dff700 1 -- 172.21.15.144:0/582126861 shutdown_connections 2023-05-11T07:36:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 0x7f3a14154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a14160fa0 0x7f3a14154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a141faee0 con 0x7f3a140b0720 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1415f220 con 0x7f3a14160fa0 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f3a1bdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a141fb300 con 0x7f3a140ca830 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 -- 172.21.15.144:0/3716236764 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c160e10 msgr2=0x7fe65c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe65c160e10 0x7fe65c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 -- 172.21.15.144:0/3716236764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe65c1650a0 msgr2=0x7fe65c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe65c1650a0 0x7fe65c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe650009550 con 0x7fe65c0cc870 2023-05-11T07:36:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7f0b18bff700 1 -- 172.21.15.144:0/2171375725 shutdown_connections 2023-05-11T07:36:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f3a1939a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 0x7f3a14154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f3a1939a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 0x7f3a14154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52176/0 (socket says 172.21.15.144:52176) 2023-05-11T07:36:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f3a1939a700 1 -- 172.21.15.144:0/2108709090 learned_addr learned my addr 172.21.15.144:0/2108709090 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f3a19b9b700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1a39c700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a14160fa0 0x7f3a14154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 -- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a14160fa0 msgr2=0x7f3a14154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3a14160fa0 0x7f3a14154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 -- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 msgr2=0x7f3a140b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a140b0720 0x7f3a140b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04009550 con 0x7f3a140ca830 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7f3a1939a700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 0x7f3a14154f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9b0 tx=0x7f3a1000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fe65affd700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c0cc870 0x7fe65c0b3af0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c400 tx=0x7fe64c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.767+0000 7fba239ff700 1 Processor -- start 2023-05-11T07:36:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7fba239ff700 1 -- start start 2023-05-11T07:36:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f6725dff700 1 -- 172.21.15.144:0/582126861 wait complete. 2023-05-11T07:36:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7f2d0dfff700 1 Processor -- start 2023-05-11T07:36:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba1c071ef0 0x7fba1c147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c1655e0 0x7fba1c147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c14aad0 con 0x7fba1c1655e0 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c14adb0 con 0x7fba1c160e10 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.769+0000 7fba239ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c14b090 con 0x7fba1c071ef0 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7fba2179b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba1c071ef0 0x7fba1c147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7fba20f9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7fba2179b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba1c071ef0 0x7fba1c147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52190/0 (socket says 172.21.15.144:52190) 2023-05-11T07:36:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7fba2179b700 1 -- 172.21.15.144:0/1438290598 learned_addr learned my addr 172.21.15.144:0/1438290598 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.768+0000 7f0b18bff700 1 -- 172.21.15.144:0/2171375725 wait complete. 2023-05-11T07:36:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7f2d0dfff700 1 -- start start 2023-05-11T07:36:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.770+0000 7f6725dff700 1 Processor -- start 2023-05-11T07:36:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7f0b18bff700 1 Processor -- start 2023-05-11T07:36:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011790 con 0x7fe65c0cc870 2023-05-11T07:36:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c0118f0 con 0x7fe65c0cc870 2023-05-11T07:36:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011c60 con 0x7fe65c0cc870 2023-05-11T07:36:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7f6725dff700 1 -- start start 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 -- 172.21.15.144:0/1438290598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba1c071ef0 msgr2=0x7fba1c147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fba1c071ef0 0x7fba1c147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 -- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c1655e0 msgr2=0x7fba1c147270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba1c1655e0 0x7fba1c147270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009b30 con 0x7fba1c160e10 2023-05-11T07:36:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7fba20f9a700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c1483c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0722c0 tx=0x7fba1800eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.771+0000 7f0b18bff700 1 -- start start 2023-05-11T07:36:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f672015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f672015c940 0x7f672015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f2d0dfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2d08160ee0 0x7f2d0806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f2d0dfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f2d0dfff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d080d0e80 con 0x7f2d0815c940 2023-05-11T07:36:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f2d0dfff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0806b600 con 0x7f2d08160ee0 2023-05-11T07:36:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f2d0dfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080cdb00 con 0x7f2d0806b180 2023-05-11T07:36:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c0cac90 con 0x7fe65c0cc870 2023-05-11T07:36:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c0720c0 con 0x7fe65c0cc870 2023-05-11T07:36:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6720160ee0 0x7f67201f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672015de60 con 0x7f6720160ee0 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672015ece0 con 0x7f672006b180 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.772+0000 7f6725dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67201f7940 con 0x7f672015c940 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b140b0720 0x7f0b1414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b1406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b141411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14070b70 con 0x7f0b140cbe30 2023-05-11T07:36:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1414e550 con 0x7f0b140b0720 2023-05-11T07:36:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f0b18bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c05c0 con 0x7f0b140cacc0 2023-05-11T07:36:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f2d06ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2d08160ee0 0x7f2d0806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f2d06ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2d08160ee0 0x7f2d0806ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51682/0 (socket says 172.21.15.144:51682) 2023-05-11T07:36:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f2d06ffd700 1 -- 172.21.15.144:0/4100698498 learned_addr learned my addr 172.21.15.144:0/4100698498 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f672015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f672015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51690/0 (socket says 172.21.15.144:51690) 2023-05-11T07:36:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f671f7fe700 1 -- 172.21.15.144:0/3931304661 learned_addr learned my addr 172.21.15.144:0/3931304661 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f671ffff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6720160ee0 0x7f67201f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f6716ffd700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f672015c940 0x7f672015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f2d07fff700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.773+0000 7f2d067fc700 1 -- 172.21.15.144:0/4100698498 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358562983 0 0) 0x7f2d080d0e80 con 0x7f2d0815c940 2023-05-11T07:36:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f2d067fc700 1 -- 172.21.15.144:0/4100698498 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf00035b0 con 0x7f2d0815c940 2023-05-11T07:36:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000c850 con 0x7f3a140ca830 2023-05-11T07:36:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000c9b0 con 0x7f3a140ca830 2023-05-11T07:36:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000cd20 con 0x7f3a140ca830 2023-05-11T07:36:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe65c0caf70 con 0x7fe65c0cc870 2023-05-11T07:36:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800c070 con 0x7fba1c160e10 2023-05-11T07:36:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f0b11d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b1406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f0b11d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b1406ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52228/0 (socket says 172.21.15.144:52228) 2023-05-11T07:36:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f0b11d9b700 1 -- 172.21.15.144:0/1635237786 learned_addr learned my addr 172.21.15.144:0/1635237786 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140cb460 con 0x7f3a140ca830 2023-05-11T07:36:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14164f80 con 0x7f3a140ca830 2023-05-11T07:36:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f0b1259c700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b140b0720 0x7f0b1414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f0b12d9d700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b141411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 -- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 msgr2=0x7f0b1406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0b140cacc0 0x7f0b1406ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 -- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 msgr2=0x7f0b141411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b140cbe30 0x7f0b141411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009550 con 0x7f0b140b0720 2023-05-11T07:36:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18013610 con 0x7fba1c160e10 2023-05-11T07:36:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18013980 con 0x7fba1c160e10 2023-05-11T07:36:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0caf70 con 0x7fba1c160e10 2023-05-11T07:36:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0cac90 con 0x7fba1c160e10 2023-05-11T07:36:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a141659e0 con 0x7f3a140ca830 2023-05-11T07:36:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f2d06ffd700 1 -- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 msgr2=0x7f2d080d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f671ffff700 1 -- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f672015c940 msgr2=0x7f672015f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f671ffff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f672015c940 0x7f672015f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f671ffff700 1 -- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 msgr2=0x7f672015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f671ffff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f672015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f2d06ffd700 1 -- 172.21.15.144:0/4100698498 >> v1:172.21.15.145:6789/0 conn(0x7f2d0815c940 legacy=0x7f2d080b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f2d06ffd700 1 -- 172.21.15.144:0/4100698498 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080cdde0 con 0x7f2d08160ee0 2023-05-11T07:36:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.774+0000 7f671ffff700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009550 con 0x7f6720160ee0 2023-05-11T07:36:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.775+0000 7f671f7fe700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f672006b180 0x7f672015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f0b1259c700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b140b0720 0x7f0b1414e010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c016000 tx=0x7f0b0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe64c01c460 con 0x7fe65c0cc870 2023-05-11T07:36:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d0806ac40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80098f0 tx=0x7f2cf8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b09d2d997e0e61 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.776+0000 7f671ffff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6720160ee0 0x7f67201f69e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6718015000 tx=0x7f6718004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c004590 con 0x7f0b140b0720 2023-05-11T07:36:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c0036a0 con 0x7f0b140b0720 2023-05-11T07:36:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003a50 con 0x7f0b140b0720 2023-05-11T07:36:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718011630 con 0x7f6720160ee0 2023-05-11T07:36:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718011790 con 0x7f6720160ee0 2023-05-11T07:36:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718011b20 con 0x7f6720160ee0 2023-05-11T07:36:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140cb430 con 0x7f0b140b0720 2023-05-11T07:36:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1415cd70 con 0x7f0b140b0720 2023-05-11T07:36:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7fe6437fe700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe64806adb0 0x7fe64806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe64c0894f0 con 0x7fe65c0cc870 2023-05-11T07:36:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7fe6437fe700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] conn(0x7fe648074a80 0x7fe648076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe648077580 con 0x7fe648074a80 2023-05-11T07:36:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe64c08bb10 con 0x7fe65c0cc870 2023-05-11T07:36:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67200d1400 con 0x7f6720160ee0 2023-05-11T07:36:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67200d1120 con 0x7f6720160ee0 2023-05-11T07:36:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba1c0cb250 con 0x7fba1c160e10 2023-05-11T07:36:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7fe65a7fc700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe64806adb0 0x7fe64806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67200b66e0 con 0x7f6720160ee0 2023-05-11T07:36:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f533a1ff700 1 Processor -- start 2023-05-11T07:36:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f533a1ff700 1 -- start start 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f2d067fc700 1 -- 172.21.15.144:0/4100698498 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8011830 con 0x7f2d08160ee0 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f2d067fc700 1 -- 172.21.15.144:0/4100698498 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8011990 con 0x7f2d08160ee0 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.777+0000 7f2d067fc700 1 -- 172.21.15.144:0/4100698498 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8011d20 con 0x7f2d08160ee0 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 -- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 msgr2=0x7f2d0806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d0806ac40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80098f0 tx=0x7f2cf8009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 -- 172.21.15.144:0/4100698498 shutdown_connections 2023-05-11T07:36:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/4100698498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d0806ac40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.778+0000 7f2d0dfff700 1 -- 172.21.15.144:0/4100698498 >> 172.21.15.144:0/4100698498 conn(0x7f2d080d3180 msgr2=0x7f2d080d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f2d0dfff700 1 -- 172.21.15.144:0/4100698498 shutdown_connections 2023-05-11T07:36:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f2d0dfff700 1 -- 172.21.15.144:0/4100698498 wait complete. 2023-05-11T07:36:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.780+0000 7fe65a7fc700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe64806adb0 0x7fe64806d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe65c071620 tx=0x7fe650010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.779+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a10013470 con 0x7f3a140ca830 2023-05-11T07:36:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.780+0000 7f3a0a7fc700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f39f806adb0 0x7f39f806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a10089b10 con 0x7f3a140ca830 2023-05-11T07:36:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f3a0a7fc700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] conn(0x7f39f8074a80 0x7f39f8076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39f8077580 con 0x7f39f8074a80 2023-05-11T07:36:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a10089ec0 con 0x7f3a140ca830 2023-05-11T07:36:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f533a1ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53340b0720 0x7f53340ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f533a1ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533406cc10 con 0x7f53340b0af0 2023-05-11T07:36:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f533a1ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53340ceaa0 con 0x7f53340b0720 2023-05-11T07:36:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f533a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340ae0a0 con 0x7f533406d050 2023-05-11T07:36:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f2d0dfff700 1 Processor -- start 2023-05-11T07:36:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b0c003bb0 con 0x7f0b140b0720 2023-05-11T07:36:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.782+0000 7f3a1a39c700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] conn(0x7f39f8074a80 0x7f39f8076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.782+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0af8000fc0 con 0x7f0b140b0720 2023-05-11T07:36:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7fe65b7fe700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] conn(0x7fe648074a80 0x7fe648076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.782+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6718021070 con 0x7f6720160ee0 2023-05-11T07:36:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.781+0000 7f2d0dfff700 1 -- start start 2023-05-11T07:36:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0815c940 0x7f2d0806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d08202240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0806f790 con 0x7f2d0815c940 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0806fa70 con 0x7f2d08160ee0 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d0dfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0806fd50 con 0x7f2d0806b180 2023-05-11T07:36:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f5332ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f5332ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52230/0 (socket says 172.21.15.144:52230) 2023-05-11T07:36:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f5332ffd700 1 -- 172.21.15.144:0/3896484274 learned_addr learned my addr 172.21.15.144:0/3896484274 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d08202240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d08202240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51702/0 (socket says 172.21.15.144:51702) 2023-05-11T07:36:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d07fff700 1 -- 172.21.15.144:0/3209028353 learned_addr learned my addr 172.21.15.144:0/3209028353 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0815c940 0x7f2d0806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f0b0affd700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0af406adb0 0x7f0af406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f5332ffd700 1 -- 172.21.15.144:0/3896484274 >> v2:172.21.15.144:3300/0 conn(0x7f53340b0720 msgr2=0x7f53340ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f5332ffd700 1 --2- 172.21.15.144:0/3896484274 >> v2:172.21.15.144:3300/0 conn(0x7f53340b0720 0x7f53340ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f5332ffd700 1 -- 172.21.15.144:0/3896484274 >> v1:172.21.15.144:6789/0 conn(0x7f53340b0af0 legacy=0x7f5334160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f5332ffd700 1 -- 172.21.15.144:0/3896484274 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340ae380 con 0x7f533406d050 2023-05-11T07:36:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.783+0000 7f3a1a39c700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] conn(0x7f39f8074a80 0x7f39f8076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f3a19b9b700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f39f806adb0 0x7f39f806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f2d06ffd700 1 -- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 msgr2=0x7f2d080c6c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-11T07:36:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2d0806b180 0x7f2d080c6c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f2d06ffd700 1 -- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 msgr2=0x7f2d08202240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d08160ee0 0x7f2d08202240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0b0c08a850 con 0x7f0b140b0720 2023-05-11T07:36:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f0b11d9b700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0af406adb0 0x7f0af406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f0b0affd700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] conn(0x7f0af4074a00 0x7f0af4076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f2d06ffd700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009550 con 0x7f2d0815c940 2023-05-11T07:36:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0af4077500 con 0x7f0af4074a00 2023-05-11T07:36:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b0c08cdb0 con 0x7f0b140b0720 2023-05-11T07:36:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f2d06ffd700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0815c940 0x7f2d0806ee90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8016000 tx=0x7f2cf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f5332ffd700 1 --2- 172.21.15.144:0/3896484274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53240098f0 tx=0x7f5324009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39192cde6369eee server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.784+0000 7f671cff9700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f670006adb0 0x7f670006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f671808b1d0 con 0x7f6720160ee0 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f671cff9700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] conn(0x7f6700074a80 0x7f6700076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6700077580 con 0x7f6700074a80 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f671808b580 con 0x7f6720160ee0 2023-05-11T07:36:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f671f7fe700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f670006adb0 0x7f670006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f53327fc700 1 -- 172.21.15.144:0/3896484274 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324004230 con 0x7f533406d050 2023-05-11T07:36:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== osd.1 v2:172.21.15.144:6800/571896629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f39f8077580 con 0x7f39f8074a80 2023-05-11T07:36:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f3a19b9b700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f39f806adb0 0x7f39f806d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a141647e0 tx=0x7f3a0c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f6716ffd700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] conn(0x7f6700074a80 0x7f6700076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f53327fc700 1 -- 172.21.15.144:0/3896484274 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324004390 con 0x7f533406d050 2023-05-11T07:36:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f53327fc700 1 -- 172.21.15.144:0/3896484274 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240036a0 con 0x7f533406d050 2023-05-11T07:36:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7fe65b7fe700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] conn(0x7fe648074a80 0x7fe648076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7f0b12d9d700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] conn(0x7f0af4074a00 0x7f0af4076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f0b11d9b700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0af406adb0 0x7f0af406d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b14145a10 tx=0x7f0b04009930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.786+0000 7f671f7fe700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f670006adb0 0x7f670006d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6710004a00 tx=0x7f6710004380 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004590 con 0x7f2d0815c940 2023-05-11T07:36:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.785+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba18013ae0 con 0x7fba1c160e10 2023-05-11T07:36:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fba11ffb700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fba0006adb0 0x7fba0006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba18089660 con 0x7fba1c160e10 2023-05-11T07:36:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== osd.2 v2:172.21.15.144:6808/1362938709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe648077580 con 0x7fe648074a80 2023-05-11T07:36:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fba11ffb700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] conn(0x7fba00074a80 0x7fba00076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba00077580 con 0x7fba00074a80 2023-05-11T07:36:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba18089a10 con 0x7fba1c160e10 2023-05-11T07:36:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf801e070 con 0x7f2d0815c940 2023-05-11T07:36:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80038a0 con 0x7f2d0815c940 2023-05-11T07:36:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d080d1400 con 0x7f2d0815c940 2023-05-11T07:36:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.787+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d080d1120 con 0x7f2d0815c940 2023-05-11T07:36:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.788+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d080b66e0 con 0x7f2d0815c940 2023-05-11T07:36:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.789+0000 7fba21f9c700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] conn(0x7fba00074a80 0x7fba00076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 -- 172.21.15.144:0/3896484274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 msgr2=0x7f533406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 --2- 172.21.15.144:0/3896484274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53240098f0 tx=0x7f5324009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7fba2179b700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fba0006adb0 0x7fba0006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7fba21f9c700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] conn(0x7fba00074a80 0x7fba00076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 -- 172.21.15.144:0/3896484274 shutdown_connections 2023-05-11T07:36:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 --2- 172.21.15.144:0/3896484274 >> v2:172.21.15.144:3300/0 conn(0x7f53340b0720 0x7f53340ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 --2- 172.21.15.144:0/3896484274 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f533406d050 0x7f533406c0d0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53240098f0 tx=0x7f5324009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f533a1ff700 1 -- 172.21.15.144:0/3896484274 >> 172.21.15.144:0/3896484274 conn(0x7f533406af60 msgr2=0x7f53340cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.791+0000 7f6716ffd700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] conn(0x7f6700074a80 0x7f6700076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.790+0000 7f0b12d9d700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] conn(0x7f0af4074a00 0x7f0af4076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.791+0000 7fba2179b700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fba0006adb0 0x7fba0006d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba14009440 tx=0x7fba14009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.791+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cf8003a00 con 0x7f2d0815c940 2023-05-11T07:36:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f533a1ff700 1 -- 172.21.15.144:0/3896484274 shutdown_connections 2023-05-11T07:36:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== osd.3 v2:172.21.15.144:6820/3116446647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fba00077580 con 0x7fba00074a80 2023-05-11T07:36:10.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== osd.4 v2:172.21.15.145:6800/2918131950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6700077580 con 0x7f6700074a80 2023-05-11T07:36:10.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f533a1ff700 1 -- 172.21.15.144:0/3896484274 wait complete. 2023-05-11T07:36:10.850 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== osd.0 v2:172.21.15.144:6816/1768750950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0af4077500 con 0x7f0af4074a00 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f2ceffff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2cf406adb0 0x7f2cf406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.792+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2cf808afb0 con 0x7f2d0815c940 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.793+0000 7f2ceffff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] conn(0x7f2cf4074a80 0x7f2cf4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.793+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cf4077580 con 0x7f2cf4074a80 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.793+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf808b360 con 0x7f2d0815c940 2023-05-11T07:36:10.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.793+0000 7f2d07fff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] conn(0x7f2cf4074a80 0x7f2cf4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.794+0000 7f2d077fe700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2cf406adb0 0x7f2cf406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.795+0000 7f2d07fff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] conn(0x7f2cf4074a80 0x7f2cf4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.795+0000 7f533a1ff700 1 Processor -- start 2023-05-11T07:36:10.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.795+0000 7f533a1ff700 1 -- start start 2023-05-11T07:36:10.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.795+0000 7f2d077fe700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2cf406adb0 0x7f2cf406d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d00002100 tx=0x7f2d00001710 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.796+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== osd.6 v2:172.21.15.145:6808/344526761 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2cf4077580 con 0x7f2cf4074a80 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53340b0720 0x7f5334160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53340b0af0 0x7f533414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 0x7f5334200960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334150930 con 0x7f5334203aa0 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334150650 con 0x7f53340b0af0 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.797+0000 7f533a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5334202fc0 con 0x7f53340b0720 2023-05-11T07:36:10.854 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.798+0000 7f5333fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 0x7f5334200960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.798+0000 7f5333fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 0x7f5334200960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41682/0 (socket says 172.21.15.144:41682) 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.798+0000 7f5333fff700 1 -- 172.21.15.144:0/464685974 learned_addr learned my addr 172.21.15.144:0/464685974 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.798+0000 7f5332ffd700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53340b0af0 0x7f533414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.798+0000 7f53337fe700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53340b0720 0x7f5334160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 -- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53340b0720 msgr2=0x7f5334160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f53340b0720 0x7f5334160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.855 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 -- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53340b0af0 msgr2=0x7f533414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53340b0af0 0x7f533414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009550 con 0x7f5334203aa0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.799+0000 7f5333fff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 0x7f5334200960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f532800b3e0 tx=0x7f532800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.800+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011620 con 0x7f5334203aa0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.800+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53280117a0 con 0x7f5334203aa0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.800+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328011b50 con 0x7f5334203aa0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.801+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340ce470 con 0x7f5334203aa0 2023-05-11T07:36:10.856 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.801+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340ce7c0 con 0x7f5334203aa0 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.802+0000 7f9fc89ff700 1 Processor -- start 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.803+0000 7f9fc89ff700 1 -- start start 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f9fc89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f9fc89ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9fc40cacc0 0x7f9fc406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f9fc89ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc415d0e0 con 0x7f9fc4158ad0 2023-05-11T07:36:10.857 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f9fc89ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc415c7b0 con 0x7f9fc40cacc0 2023-05-11T07:36:10.858 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f9fc89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc415ca90 con 0x7f9fc40b0e30 2023-05-11T07:36:10.858 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.805+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5328011cb0 con 0x7f5334203aa0 2023-05-11T07:36:10.858 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.806+0000 7f9fc1d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.806+0000 7f9fc1d9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52266/0 (socket says 172.21.15.144:52266) 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.806+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1621132193 learned_addr learned my addr 172.21.15.144:0/1621132193 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.807+0000 7f9fc2d9d700 1 --2- 172.21.15.144:0/1621132193 >> v2:172.21.15.144:3300/0 conn(0x7f9fc40cacc0 0x7f9fc406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.808+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1621132193 >> v2:172.21.15.144:3300/0 conn(0x7f9fc40cacc0 msgr2=0x7f9fc406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.808+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1621132193 >> v2:172.21.15.144:3300/0 conn(0x7f9fc40cacc0 0x7f9fc406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.808+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1621132193 >> v1:172.21.15.144:6789/0 conn(0x7f9fc4158ad0 legacy=0x7f9fc40b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.808+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1621132193 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc415cd70 con 0x7f9fc40b0e30 2023-05-11T07:36:10.859 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.808+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1621132193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80088f0 tx=0x7f9fb800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26ad8bedfcc66b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.809+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5334202e40 con 0x7f5334203aa0 2023-05-11T07:36:10.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.809+0000 7f531bfff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f532006adb0 0x7f532006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.809+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5328089630 con 0x7f5334203aa0 2023-05-11T07:36:10.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.810+0000 7f531bfff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] conn(0x7f5320074a00 0x7f5320076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.810+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5320077500 con 0x7f5320074a00 2023-05-11T07:36:10.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.810+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5328009210 con 0x7f5334203aa0 2023-05-11T07:36:10.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.810+0000 7f53337fe700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f532006adb0 0x7f532006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.810+0000 7f5332ffd700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] conn(0x7f5320074a00 0x7f5320076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.811+0000 7f9fc159a700 1 -- 172.21.15.144:0/1621132193 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8010070 con 0x7f9fc40b0e30 2023-05-11T07:36:10.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.811+0000 7f9fc159a700 1 -- 172.21.15.144:0/1621132193 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb800d9d0 con 0x7f9fc40b0e30 2023-05-11T07:36:10.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.811+0000 7f9fc159a700 1 -- 172.21.15.144:0/1621132193 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb800dd60 con 0x7f9fc40b0e30 2023-05-11T07:36:10.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.811+0000 7f5332ffd700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] conn(0x7f5320074a00 0x7f5320076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.812+0000 7f53337fe700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f532006adb0 0x7f532006d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53340b4b80 tx=0x7f532c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.812+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1621132193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 msgr2=0x7f9fc40c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.812+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1621132193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80088f0 tx=0x7f9fb800d330 comp rx=0 tx=0).stop 2023-05-11T07:36:10.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== osd.5 v2:172.21.15.145:6816/1971378360 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5320077500 con 0x7f5320074a00 2023-05-11T07:36:10.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1621132193 shutdown_connections 2023-05-11T07:36:10.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1621132193 >> v2:172.21.15.144:3300/0 conn(0x7f9fc40cacc0 0x7f9fc406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1621132193 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40b0e30 0x7f9fc40c92f0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80088f0 tx=0x7f9fb800d330 comp rx=0 tx=0).stop 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1621132193 >> 172.21.15.144:0/1621132193 conn(0x7f9fc406af60 msgr2=0x7f9fc40cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.813+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1621132193 shutdown_connections 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.814+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1621132193 wait complete. 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.816+0000 7f9fc89ff700 1 Processor -- start 2023-05-11T07:36:10.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.817+0000 7f9fc89ff700 1 -- start start 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fc40cacc0 0x7f9fc40c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc4158ad0 0x7f9fc40c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40c4430 0x7f9fc41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c6700 con 0x7f9fc4158ad0 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c69a0 con 0x7f9fc40cacc0 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.818+0000 7f9fc89ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c6c80 con 0x7f9fc40c4430 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.819+0000 7f9fc2d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40c4430 0x7f9fc41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.819+0000 7f9fc2d9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40c4430 0x7f9fc41552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52274/0 (socket says 172.21.15.144:52274) 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.819+0000 7f9fc2d9d700 1 -- 172.21.15.144:0/1601356715 learned_addr learned my addr 172.21.15.144:0/1601356715 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.819+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc4158ad0 0x7f9fc40c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.819+0000 7f9fc259c700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fc40cacc0 0x7f9fc40c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40c4430 msgr2=0x7f9fc41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9fc40c4430 0x7f9fc41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fc40cacc0 msgr2=0x7f9fc40c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9fc40cacc0 0x7f9fc40c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80085d0 con 0x7f9fc4158ad0 2023-05-11T07:36:10.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.820+0000 7f9fc1d9b700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc4158ad0 0x7f9fc40c5d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8019000 tx=0x7f9fb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.822+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8004250 con 0x7f9fc4158ad0 2023-05-11T07:36:10.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.822+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80043b0 con 0x7f9fc4158ad0 2023-05-11T07:36:10.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.822+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80036a0 con 0x7f9fc4158ad0 2023-05-11T07:36:10.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.823+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 --> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a140744c0 con 0x7f39f8074a80 2023-05-11T07:36:10.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.823+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc40cb100 con 0x7f9fc4158ad0 2023-05-11T07:36:10.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.823+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc40cb430 con 0x7f9fc4158ad0 2023-05-11T07:36:10.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.824+0000 7f3a0a7fc700 1 -- 172.21.15.144:0/2108709090 <== osd.1 v2:172.21.15.144:6800/571896629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a140744c0 con 0x7f39f8074a80 2023-05-11T07:36:10.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.825+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fc40c6b10 con 0x7f9fc4158ad0 2023-05-11T07:36:10.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.825+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 --> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67200cf830 con 0x7f6700074a80 2023-05-11T07:36:10.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.825+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 --> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe65c162500 con 0x7fe648074a80 2023-05-11T07:36:10.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] conn(0x7f39f8074a80 msgr2=0x7f39f8076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6800/571896629,v1:172.21.15.144:6801/571896629] conn(0x7f39f8074a80 0x7f39f8076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f39f806adb0 msgr2=0x7f39f806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f39f806adb0 0x7f39f806d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a141647e0 tx=0x7f3a0c00d040 comp rx=0 tx=0).stop 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 msgr2=0x7f3a14154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 --2- 172.21.15.144:0/2108709090 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3a140ca830 0x7f3a14154f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9b0 tx=0x7f3a1000ecc0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1a39c700 1 -- 172.21.15.144:0/2108709090 reap_dead start 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 shutdown_connections 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.826+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 >> 172.21.15.144:0/2108709090 conn(0x7f3a1406af60 msgr2=0x7f3a1415ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.827+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 shutdown_connections 2023-05-11T07:36:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.827+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fb8003800 con 0x7f9fc4158ad0 2023-05-11T07:36:10.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.827+0000 7fe6437fe700 1 -- 172.21.15.144:0/3716236764 <== osd.2 v2:172.21.15.144:6808/1362938709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe65c162500 con 0x7fe648074a80 2023-05-11T07:36:10.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.827+0000 7f3a1bdff700 1 -- 172.21.15.144:0/2108709090 wait complete. 2023-05-11T07:36:10.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.828+0000 7f9fb2ffd700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9fa406adb0 0x7f9fa406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.828+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fb808aea0 con 0x7f9fc4158ad0 2023-05-11T07:36:10.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.828+0000 7f9fb2ffd700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] conn(0x7f9fa4074a80 0x7f9fa4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:10.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.828+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fa4077580 con 0x7f9fa4074a80 2023-05-11T07:36:10.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.828+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb808b250 con 0x7f9fc4158ad0 2023-05-11T07:36:10.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] conn(0x7fe648074a80 msgr2=0x7fe648076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6808/1362938709,v1:172.21.15.144:6809/1362938709] conn(0x7fe648074a80 0x7fe648076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7f9fc259c700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9fa406adb0 0x7f9fa406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7f9fc2d9d700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] conn(0x7f9fa4074a80 0x7f9fa4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:10.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 --> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba1c0744c0 con 0x7fba00074a80 2023-05-11T07:36:10.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 --> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0af8002d40 con 0x7f0af4074a00 2023-05-11T07:36:10.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe64806adb0 msgr2=0x7fe64806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe64806adb0 0x7fe64806d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe65c071620 tx=0x7fe650010000 comp rx=0 tx=0).stop 2023-05-11T07:36:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c0cc870 msgr2=0x7fe65c0b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe6617ff700 1 --2- 172.21.15.144:0/3716236764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe65c0cc870 0x7fe65c0b3af0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c400 tx=0x7fe64c00c7c0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.829+0000 7fe65b7fe700 1 -- 172.21.15.144:0/3716236764 reap_dead start 2023-05-11T07:36:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.830+0000 7f9fc259c700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9fa406adb0 0x7f9fa406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.830+0000 7f0b0affd700 1 -- 172.21.15.144:0/1635237786 <== osd.0 v2:172.21.15.144:6816/1768750950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0af8002d40 con 0x7f0af4074a00 2023-05-11T07:36:10.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.830+0000 7f671cff9700 1 -- 172.21.15.144:0/3931304661 <== osd.4 v2:172.21.15.145:6800/2918131950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67200cf830 con 0x7f6700074a80 2023-05-11T07:36:10.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.830+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 shutdown_connections 2023-05-11T07:36:10.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.830+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 >> 172.21.15.144:0/3716236764 conn(0x7fe65c0cb720 msgr2=0x7fe65c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7fba11ffb700 1 -- 172.21.15.144:0/1438290598 <== osd.3 v2:172.21.15.144:6820/3116446647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba1c0744c0 con 0x7fba00074a80 2023-05-11T07:36:10.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] conn(0x7f0af4074a00 msgr2=0x7f0af4076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6816/1768750950,v1:172.21.15.144:6817/1768750950] conn(0x7f0af4074a00 0x7f0af4076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] conn(0x7f6700074a80 msgr2=0x7f6700076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.145:6800/2918131950,v1:172.21.15.145:6801/2918131950] conn(0x7f6700074a80 0x7f6700076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f670006adb0 msgr2=0x7f670006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f670006adb0 0x7f670006d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6710004a00 tx=0x7f6710004380 comp rx=0 tx=0).stop 2023-05-11T07:36:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6720160ee0 msgr2=0x7f67201f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f6725dff700 1 --2- 172.21.15.144:0/3931304661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6720160ee0 0x7f67201f69e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6718015000 tx=0x7f6718004750 comp rx=0 tx=0).stop 2023-05-11T07:36:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0af406adb0 msgr2=0x7f0af406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0af406adb0 0x7f0af406d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b14145a10 tx=0x7f0b04009930 comp rx=0 tx=0).stop 2023-05-11T07:36:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b140b0720 msgr2=0x7f0b1414e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b18bff700 1 --2- 172.21.15.144:0/1635237786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b140b0720 0x7f0b1414e010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c016000 tx=0x7f0b0c004750 comp rx=0 tx=0).stop 2023-05-11T07:36:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] conn(0x7fba00074a80 msgr2=0x7fba00076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7fba239ff700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6820/3116446647,v1:172.21.15.144:6822/3116446647] conn(0x7fba00074a80 0x7fba00076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f0b12d9d700 1 -- 172.21.15.144:0/1635237786 reap_dead start 2023-05-11T07:36:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 shutdown_connections 2023-05-11T07:36:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 >> 172.21.15.144:0/1635237786 conn(0x7f0b1406af60 msgr2=0x7f0b140ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.831+0000 7f671ffff700 1 -- 172.21.15.144:0/3931304661 reap_dead start 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fba0006adb0 msgr2=0x7fba0006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fba0006adb0 0x7fba0006d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba14009440 tx=0x7fba14009000 comp rx=0 tx=0).stop 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 msgr2=0x7fba1c1483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 --2- 172.21.15.144:0/1438290598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fba1c160e10 0x7fba1c1483c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0722c0 tx=0x7fba1800eac0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba21f9c700 1 -- 172.21.15.144:0/1438290598 reap_dead start 2023-05-11T07:36:10.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 shutdown_connections 2023-05-11T07:36:10.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 >> 172.21.15.144:0/1438290598 conn(0x7fba1c0cb720 msgr2=0x7fba1c0aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 shutdown_connections 2023-05-11T07:36:10.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 >> 172.21.15.144:0/3931304661 conn(0x7f67200d3180 msgr2=0x7f67200d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 shutdown_connections 2023-05-11T07:36:10.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 shutdown_connections 2023-05-11T07:36:10.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7f6725dff700 1 -- 172.21.15.144:0/3931304661 wait complete. 2023-05-11T07:36:10.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.832+0000 7fe6617ff700 1 -- 172.21.15.144:0/3716236764 wait complete. 2023-05-11T07:36:10.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.833+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 shutdown_connections 2023-05-11T07:36:10.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.833+0000 7f0b18bff700 1 -- 172.21.15.144:0/1635237786 wait complete. 2023-05-11T07:36:10.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.833+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 --> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d080744c0 con 0x7f2cf4074a80 2023-05-11T07:36:10.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.833+0000 7f9fc2d9d700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] conn(0x7f9fa4074a80 0x7f9fa4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:10.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.834+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 shutdown_connections 2023-05-11T07:36:10.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.834+0000 7fba239ff700 1 -- 172.21.15.144:0/1438290598 wait complete. 2023-05-11T07:36:10.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.834+0000 7f2ceffff700 1 -- 172.21.15.144:0/3209028353 <== osd.6 v2:172.21.15.145:6808/344526761 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d080744c0 con 0x7f2cf4074a80 2023-05-11T07:36:10.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.834+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== osd.7 v2:172.21.15.145:6822/3419647756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9fa4077580 con 0x7f9fa4074a80 2023-05-11T07:36:10.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] conn(0x7f2cf4074a80 msgr2=0x7f2cf4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.145:6808/344526761,v1:172.21.15.145:6809/344526761] conn(0x7f2cf4074a80 0x7f2cf4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2cf406adb0 msgr2=0x7f2cf406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2cf406adb0 0x7f2cf406d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d00002100 tx=0x7f2d00001710 comp rx=0 tx=0).stop 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0815c940 msgr2=0x7f2d0806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.836+0000 7f2d0dfff700 1 --2- 172.21.15.144:0/3209028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0815c940 0x7f2d0806ee90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8016000 tx=0x7f2cf8004750 comp rx=0 tx=0).stop 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.847+0000 7f2d07fff700 1 -- 172.21.15.144:0/3209028353 reap_dead start 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.847+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 shutdown_connections 2023-05-11T07:36:10.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.847+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 >> 172.21.15.144:0/3209028353 conn(0x7f2d080d3180 msgr2=0x7f2d0815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.847+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 shutdown_connections 2023-05-11T07:36:10.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.847+0000 7f2d0dfff700 1 -- 172.21.15.144:0/3209028353 wait complete. 2023-05-11T07:36:10.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.849+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 --> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53340b0f70 con 0x7f5320074a00 2023-05-11T07:36:10.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.850+0000 7f531bfff700 1 -- 172.21.15.144:0/464685974 <== osd.5 v2:172.21.15.145:6816/1971378360 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53340b0f70 con 0x7f5320074a00 2023-05-11T07:36:10.892 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:10.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-11T07:36:10.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.853+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] conn(0x7f5320074a00 msgr2=0x7f5320076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.853+0000 7f533a1ff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.145:6816/1971378360,v1:172.21.15.145:6817/1971378360] conn(0x7f5320074a00 0x7f5320076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.854+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f532006adb0 msgr2=0x7f532006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.854+0000 7f533a1ff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f532006adb0 0x7f532006d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53340b4b80 tx=0x7f532c00d040 comp rx=0 tx=0).stop 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.854+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 msgr2=0x7f5334200960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.854+0000 7f533a1ff700 1 --2- 172.21.15.144:0/464685974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334203aa0 0x7f5334200960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f532800b3e0 tx=0x7f532800b6f0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.854+0000 7f5333fff700 1 -- 172.21.15.144:0/464685974 reap_dead start 2023-05-11T07:36:10.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.855+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 shutdown_connections 2023-05-11T07:36:10.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.855+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 >> 172.21.15.144:0/464685974 conn(0x7f533406af60 msgr2=0x7f53340ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.855+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 shutdown_connections 2023-05-11T07:36:10.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.855+0000 7f533a1ff700 1 -- 172.21.15.144:0/464685974 wait complete. 2023-05-11T07:36:10.895 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2023-05-11T07:36:10.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-11T07:36:10.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.865+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 --> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fc415d570 con 0x7f9fa4074a80 2023-05-11T07:36:10.901 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:10.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-11T07:36:10.902 INFO:teuthology.orchestra.run.smithi144.stdout:60129542156 2023-05-11T07:36:10.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-11T07:36:10.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fb2ffd700 1 -- 172.21.15.144:0/1601356715 <== osd.7 v2:172.21.15.145:6822/3419647756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fc415d570 con 0x7f9fa4074a80 2023-05-11T07:36:10.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] conn(0x7f9fa4074a80 msgr2=0x7f9fa4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.145:6822/3419647756,v1:172.21.15.145:6824/3419647756] conn(0x7f9fa4074a80 0x7f9fa4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:10.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9fa406adb0 msgr2=0x7f9fa406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9fa406adb0 0x7f9fa406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4007fd0 tx=0x7f9fb4009040 comp rx=0 tx=0).stop 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc4158ad0 msgr2=0x7f9fc40c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 --2- 172.21.15.144:0/1601356715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fc4158ad0 0x7f9fc40c5d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8019000 tx=0x7f9fb8004750 comp rx=0 tx=0).stop 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc2d9d700 1 -- 172.21.15.144:0/1601356715 reap_dead start 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 shutdown_connections 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.869+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 >> 172.21.15.144:0/1601356715 conn(0x7f9fc406af60 msgr2=0x7f9fc406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.870+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 shutdown_connections 2023-05-11T07:36:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:10.870+0000 7f9fc89ff700 1 -- 172.21.15.144:0/1601356715 wait complete. 2023-05-11T07:36:10.906 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:10.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-11T07:36:10.907 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:10.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-11T07:36:10.908 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:10.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-11T07:36:10.909 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:10.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-11T07:36:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.258+0000 7ff7951ff700 1 Processor -- start 2023-05-11T07:36:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.258+0000 7ff7951ff700 1 -- start start 2023-05-11T07:36:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.260+0000 7ff7951ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff7900c92f0 0x7ff7900cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.260+0000 7ff7951ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7900cb200 con 0x7ff7900b0e30 2023-05-11T07:36:11.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.260+0000 7ff7951ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79015d0e0 con 0x7ff790158ad0 2023-05-11T07:36:11.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.260+0000 7ff7951ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900c96f0 con 0x7ff7900c92f0 2023-05-11T07:36:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.261+0000 7ff78e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff7900b0e30 0x7ff79006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40762/0 (socket says 172.21.15.144:40762) 2023-05-11T07:36:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.261+0000 7ff78e59c700 1 -- 172.21.15.144:0/2683583974 learned_addr learned my addr 172.21.15.144:0/2683583974 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.262+0000 7ff78f59e700 1 --2- 172.21.15.144:0/2683583974 >> v2:172.21.15.145:3300/0 conn(0x7ff7900c92f0 0x7ff7900cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.262+0000 7ff78dd9b700 1 -- 172.21.15.144:0/2683583974 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617385470 0 0) 0x7ff79015d0e0 con 0x7ff790158ad0 2023-05-11T07:36:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.262+0000 7ff78dd9b700 1 -- 172.21.15.144:0/2683583974 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7780057c0 con 0x7ff790158ad0 2023-05-11T07:36:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.263+0000 7ff78f59e700 1 -- 172.21.15.144:0/2683583974 >> v1:172.21.15.145:6789/0 conn(0x7ff790158ad0 legacy=0x7ff7900b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.263+0000 7ff78f59e700 1 -- 172.21.15.144:0/2683583974 >> v1:172.21.15.144:6789/0 conn(0x7ff7900b0e30 legacy=0x7ff79006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.263+0000 7ff78f59e700 1 -- 172.21.15.144:0/2683583974 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79015c7b0 con 0x7ff7900c92f0 2023-05-11T07:36:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.263+0000 7ff78f59e700 1 --2- 172.21.15.144:0/2683583974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7900c92f0 0x7ff7900cacc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff78400a9e0 tx=0x7ff78400acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8fef1f46fd7f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.263+0000 7ff78dd9b700 1 -- 172.21.15.144:0/2683583974 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78400cb30 con 0x7ff7900c92f0 2023-05-11T07:36:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.264+0000 7ff78dd9b700 1 -- 172.21.15.144:0/2683583974 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400cc90 con 0x7ff7900c92f0 2023-05-11T07:36:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.264+0000 7ff78dd9b700 1 -- 172.21.15.144:0/2683583974 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78400ae20 con 0x7ff7900c92f0 2023-05-11T07:36:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.264+0000 7ff7951ff700 1 -- 172.21.15.144:0/2683583974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7900c92f0 msgr2=0x7ff7900cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.264+0000 7ff7951ff700 1 --2- 172.21.15.144:0/2683583974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7900c92f0 0x7ff7900cacc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff78400a9e0 tx=0x7ff78400acf0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.266+0000 7ff7951ff700 1 -- 172.21.15.144:0/2683583974 shutdown_connections 2023-05-11T07:36:11.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.266+0000 7ff7951ff700 1 --2- 172.21.15.144:0/2683583974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7900c92f0 0x7ff7900cacc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.266+0000 7ff7951ff700 1 -- 172.21.15.144:0/2683583974 >> 172.21.15.144:0/2683583974 conn(0x7ff79006af60 msgr2=0x7ff7900cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.266+0000 7ff7951ff700 1 -- 172.21.15.144:0/2683583974 shutdown_connections 2023-05-11T07:36:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.267+0000 7f1b1ddff700 1 Processor -- start 2023-05-11T07:36:11.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.266+0000 7ff7951ff700 1 -- 172.21.15.144:0/2683583974 wait complete. 2023-05-11T07:36:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.269+0000 7ff7951ff700 1 Processor -- start 2023-05-11T07:36:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.269+0000 7ff7951ff700 1 -- start start 2023-05-11T07:36:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 0x7ff790149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 0x7ff79006fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff790158ad0 0x7ff790070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015b8f0 con 0x7ff7900c92f0 2023-05-11T07:36:11.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015ad00 con 0x7ff790158ad0 2023-05-11T07:36:11.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7ff7951ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015bd10 con 0x7ff7900b0e30 2023-05-11T07:36:11.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.268+0000 7f1b1ddff700 1 -- start start 2023-05-11T07:36:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.270+0000 7f1b1ddff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b18160ee0 0x7f1b1806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.270+0000 7f1b1ddff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b1806b180 0x7f1b180d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.270+0000 7f1b1ddff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b180d0e80 con 0x7f1b1815c940 2023-05-11T07:36:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.270+0000 7f1b1ddff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1806b600 con 0x7f1b18160ee0 2023-05-11T07:36:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.270+0000 7f1b1ddff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b180cdb00 con 0x7f1b1806b180 2023-05-11T07:36:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7f1b177fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f1b1815c940 0x7f1b180b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:59774/0 (socket says 172.21.15.144:59774) 2023-05-11T07:36:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.271+0000 7f1b177fe700 1 -- 172.21.15.144:0/187198526 learned_addr learned my addr 172.21.15.144:0/187198526 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.273+0000 7ff78ed9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 0x7ff790149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.273+0000 7ff78ed9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 0x7ff790149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52280/0 (socket says 172.21.15.144:52280) 2023-05-11T07:36:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.273+0000 7ff78ed9d700 1 -- 172.21.15.144:0/1719032808 learned_addr learned my addr 172.21.15.144:0/1719032808 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.273+0000 7ff78e59c700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 0x7ff79006fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.273+0000 7ff78f59e700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff790158ad0 0x7ff790070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b17fff700 1 --2- 172.21.15.144:0/187198526 >> v2:172.21.15.145:3300/0 conn(0x7f1b1806b180 0x7f1b180d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b16ffd700 1 -- 172.21.15.144:0/187198526 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847201132 0 0) 0x7f1b180d0e80 con 0x7f1b1815c940 2023-05-11T07:36:11.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b16ffd700 1 -- 172.21.15.144:0/187198526 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af80035b0 con 0x7f1b1815c940 2023-05-11T07:36:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b17fff700 1 -- 172.21.15.144:0/187198526 >> v2:172.21.15.144:3300/0 conn(0x7f1b18160ee0 msgr2=0x7f1b1806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b17fff700 1 --2- 172.21.15.144:0/187198526 >> v2:172.21.15.144:3300/0 conn(0x7f1b18160ee0 0x7f1b1806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b17fff700 1 -- 172.21.15.144:0/187198526 >> v1:172.21.15.145:6789/0 conn(0x7f1b1815c940 legacy=0x7f1b180b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.272+0000 7f1b17fff700 1 -- 172.21.15.144:0/187198526 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180cdde0 con 0x7f1b1806b180 2023-05-11T07:36:11.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 -- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 msgr2=0x7ff790149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 0x7ff790149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 -- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff790158ad0 msgr2=0x7ff790070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff790158ad0 0x7ff790070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 -- 172.21.15.144:0/1719032808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78400a640 con 0x7ff7900c92f0 2023-05-11T07:36:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7ff78e59c700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 0x7ff79006fd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c7f0 tx=0x7ff78800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.274+0000 7f1b17fff700 1 --2- 172.21.15.144:0/187198526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1806b180 0x7f1b180d1920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b180d3100 tx=0x7f1b1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e39d2ad7b85e6467 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7f1b16ffd700 1 -- 172.21.15.144:0/187198526 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000e070 con 0x7f1b1806b180 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7f1b16ffd700 1 -- 172.21.15.144:0/187198526 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1000bb20 con 0x7f1b1806b180 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7f1b16ffd700 1 -- 172.21.15.144:0/187198526 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10012430 con 0x7f1b1806b180 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 -- 172.21.15.144:0/187198526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1806b180 msgr2=0x7f1b180d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/187198526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1806b180 0x7f1b180d1920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b180d3100 tx=0x7f1b1000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 -- 172.21.15.144:0/187198526 shutdown_connections 2023-05-11T07:36:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/187198526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1806b180 0x7f1b180d1920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/187198526 >> v2:172.21.15.144:3300/0 conn(0x7f1b18160ee0 0x7f1b1806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7f1b1ddff700 1 -- 172.21.15.144:0/187198526 >> 172.21.15.144:0/187198526 conn(0x7f1b180d3180 msgr2=0x7f1b180d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788012830 con 0x7ff7900c92f0 2023-05-11T07:36:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788012990 con 0x7ff7900c92f0 2023-05-11T07:36:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.275+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788012d00 con 0x7ff7900c92f0 2023-05-11T07:36:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79015cd70 con 0x7ff7900c92f0 2023-05-11T07:36:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.276+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79015ca90 con 0x7ff7900c92f0 2023-05-11T07:36:11.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.277+0000 7f1b1ddff700 1 -- 172.21.15.144:0/187198526 shutdown_connections 2023-05-11T07:36:11.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.278+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7900cb430 con 0x7ff7900c92f0 2023-05-11T07:36:11.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.277+0000 7f1b1ddff700 1 -- 172.21.15.144:0/187198526 wait complete. 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.280+0000 7f1b1ddff700 1 Processor -- start 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.280+0000 7f1b1ddff700 1 -- start start 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.281+0000 7f1b1ddff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1806b180 0x7f1b1814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b1ddff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1815c940 0x7f1b1815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b1ddff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b1ddff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b180cb580 con 0x7f1b1806b180 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b1ddff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1815d6f0 con 0x7f1b1815c940 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b1ddff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1815d970 con 0x7f1b18160ee0 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b17fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b17fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52286/0 (socket says 172.21.15.144:52286) 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f1b17fff700 1 -- 172.21.15.144:0/89023218 learned_addr learned my addr 172.21.15.144:0/89023218 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.281+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff788007020 con 0x7ff7900c92f0 2023-05-11T07:36:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7ff7777fe700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 0x7ff77c071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff788089c20 con 0x7ff7900c92f0 2023-05-11T07:36:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7f1b17fff700 1 -- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1815c940 msgr2=0x7f1b1815ecf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-11T07:36:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7f1b17fff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1815c940 0x7f1b1815ecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7f1b17fff700 1 -- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1806b180 msgr2=0x7f1b1814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7f1b17fff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1806b180 0x7f1b1814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.283+0000 7f1b17fff700 1 -- 172.21.15.144:0/89023218 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10009a70 con 0x7f1b18160ee0 2023-05-11T07:36:11.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.284+0000 7ff78ed9d700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 0x7ff77c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.282+0000 7f63545ff700 1 Processor -- start 2023-05-11T07:36:11.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.284+0000 7f1b17fff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b1806b740 tx=0x7f1b10004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.284+0000 7f63545ff700 1 -- start start 2023-05-11T07:36:11.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.285+0000 7f90ffdff700 1 Processor -- start 2023-05-11T07:36:11.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.285+0000 7f90ffdff700 1 -- start start 2023-05-11T07:36:11.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.285+0000 7ff78ed9d700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 0x7ff77c071670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7800011e0 tx=0x7ff780009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.286+0000 7f37fc3ff700 1 Processor -- start 2023-05-11T07:36:11.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.285+0000 7f4c4a1ff700 1 Processor -- start 2023-05-11T07:36:11.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.285+0000 7f4c4a1ff700 1 -- start start 2023-05-11T07:36:11.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.286+0000 7fd2f49ff700 1 Processor -- start 2023-05-11T07:36:11.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.286+0000 7fd2f49ff700 1 -- start start 2023-05-11T07:36:11.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.286+0000 7f37fc3ff700 1 -- start start 2023-05-11T07:36:11.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f90ffdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cbe30 0x7f90f80c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100048e0 con 0x7f1b18160ee0 2023-05-11T07:36:11.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10020070 con 0x7f1b18160ee0 2023-05-11T07:36:11.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100276c0 con 0x7f1b18160ee0 2023-05-11T07:36:11.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1ed21ff700 1 Processor -- start 2023-05-11T07:36:11.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1ed21ff700 1 -- start start 2023-05-11T07:36:11.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f63545ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f634c160fa0 0x7f634c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f63545ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f634c0b0720 0x7f634c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f63545ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0b1060 con 0x7f634c071ad0 2023-05-11T07:36:11.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f63545ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c165bb0 con 0x7f634c160fa0 2023-05-11T07:36:11.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f63545ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0caea0 con 0x7f634c0b0720 2023-05-11T07:36:11.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f90ffdff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90f80b0720 0x7f90f80b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f90ffdff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80b10c0 con 0x7f90f80cacc0 2023-05-11T07:36:11.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f90ffdff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f806c6d0 con 0x7f90f80b0720 2023-05-11T07:36:11.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f90ffdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f815d0e0 con 0x7f90f80cbe30 2023-05-11T07:36:11.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b180d1400 con 0x7f1b18160ee0 2023-05-11T07:36:11.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.287+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b180d1120 con 0x7f1b18160ee0 2023-05-11T07:36:11.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f90fe39c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90f80b0720 0x7f90f80b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f90fe39c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f90f80b0720 0x7f90f80b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51758/0 (socket says 172.21.15.144:51758) 2023-05-11T07:36:11.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f90fe39c700 1 -- 172.21.15.144:0/1618072596 learned_addr learned my addr 172.21.15.144:0/1618072596 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f6352b9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f634c0b0720 0x7f634c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f6352b9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f634c0b0720 0x7f634c0b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51760/0 (socket says 172.21.15.144:51760) 2023-05-11T07:36:11.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f6352b9c700 1 -- 172.21.15.144:0/1561012588 learned_addr learned my addr 172.21.15.144:0/1561012588 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f37f4160e10 0x7f37f40719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f4071ef0 0x7f37f41650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37f41655e0 0x7f37f40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f4164c50 con 0x7f37f41655e0 2023-05-11T07:36:11.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7fd2f49ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2f01599e0 0x7fd2f00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f406d490 con 0x7f37f4160e10 2023-05-11T07:36:11.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f37fc3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40cea30 con 0x7f37f4071ef0 2023-05-11T07:36:11.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.288+0000 7f90fdb9b700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cbe30 0x7f90f80c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff788054a50 con 0x7ff7900c92f0 2023-05-11T07:36:11.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af00052f0 con 0x7f1b18160ee0 2023-05-11T07:36:11.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f1ed21ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f1ed21ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1ecc0cacc0 0x7f1ecc158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f1ed21ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0cb4a0 con 0x7f1ecc06dec0 2023-05-11T07:36:11.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f1ed21ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc15d5d0 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f1ed21ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc159060 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f37fa99c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37f41655e0 0x7f37f40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f37fa99c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37f41655e0 0x7f37f40cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41740/0 (socket says 172.21.15.144:41740) 2023-05-11T07:36:11.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f37fa99c700 1 -- 172.21.15.144:0/3614371338 learned_addr learned my addr 172.21.15.144:0/3614371338 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2f49ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd2f00cdef0 0x7fd2f0164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2f49ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f015e200 con 0x7fd2f00ca020 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2f49ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f015a100 con 0x7fd2f01599e0 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2f49ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f015a3e0 con 0x7fd2f00cdef0 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2eed9d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd2f00cdef0 0x7fd2f0164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2eed9d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd2f00cdef0 0x7fd2f0164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51774/0 (socket says 172.21.15.144:51774) 2023-05-11T07:36:11.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7fd2eed9d700 1 -- 172.21.15.144:0/233429340 learned_addr learned my addr 172.21.15.144:0/233429340 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7fd2eed9d700 1 -- 172.21.15.144:0/233429340 >> v2:172.21.15.144:3300/0 conn(0x7fd2f01599e0 msgr2=0x7fd2f00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7fd2eed9d700 1 --2- 172.21.15.144:0/233429340 >> v2:172.21.15.144:3300/0 conn(0x7fd2f01599e0 0x7fd2f00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7fd2eed9d700 1 -- 172.21.15.144:0/233429340 >> v1:172.21.15.145:6789/0 conn(0x7fd2f00ca020 legacy=0x7fd2f00b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7fd2eed9d700 1 -- 172.21.15.144:0/233429340 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f015a6c0 con 0x7fd2f00cdef0 2023-05-11T07:36:11.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f37fa19b700 1 --2- 172.21.15.144:0/3614371338 >> v2:172.21.15.145:3300/0 conn(0x7f37f4160e10 0x7f37f40719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7fd2eed9d700 1 --2- 172.21.15.144:0/233429340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f00cdef0 0x7fd2f0164940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00c9270 tx=0x7fd2e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd0b7ceac64d18b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37f999a700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f4071ef0 0x7f37f41650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f1ecaffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f1ecaffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52324/0 (socket says 172.21.15.144:52324) 2023-05-11T07:36:11.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 -- 172.21.15.144:0/3614371338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f4071ef0 msgr2=0x7f37f41650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f4071ef0 0x7f37f41650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 -- 172.21.15.144:0/3614371338 >> v2:172.21.15.145:3300/0 conn(0x7f37f4160e10 msgr2=0x7f37f40719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f90fe39c700 1 -- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cbe30 msgr2=0x7f90f80c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f90fe39c700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cbe30 0x7f90f80c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f90fe39c700 1 -- 172.21.15.144:0/1618072596 >> v1:172.21.15.144:6789/0 conn(0x7f90f80cacc0 legacy=0x7f90f81588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.289+0000 7f90fe39c700 1 -- 172.21.15.144:0/1618072596 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8159000 con 0x7f90f80b0720 2023-05-11T07:36:11.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f1ecaffd700 1 -- 172.21.15.144:0/2453472840 learned_addr learned my addr 172.21.15.144:0/2453472840 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f1ecbfff700 1 --2- 172.21.15.144:0/2453472840 >> v2:172.21.15.145:3300/0 conn(0x7f1ecc0cacc0 0x7f1ecc158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f6352b9c700 1 -- 172.21.15.144:0/1561012588 >> v2:172.21.15.144:3300/0 conn(0x7f634c160fa0 msgr2=0x7f634c0ca830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T07:36:11.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f6352b9c700 1 --2- 172.21.15.144:0/1561012588 >> v2:172.21.15.144:3300/0 conn(0x7f634c160fa0 0x7f634c0ca830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 --2- 172.21.15.144:0/3614371338 >> v2:172.21.15.145:3300/0 conn(0x7f37f4160e10 0x7f37f40719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 -- 172.21.15.144:0/3614371338 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40cb530 con 0x7f37f41655e0 2023-05-11T07:36:11.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f90fe39c700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f80b0b80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009e50 tx=0x7f90f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a1b12ac668b0f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f6352b9c700 1 -- 172.21.15.144:0/1561012588 >> v1:172.21.15.144:6789/0 conn(0x7f634c071ad0 legacy=0x7f634c1654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f6352b9c700 1 -- 172.21.15.144:0/1561012588 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0cb180 con 0x7f634c0b0720 2023-05-11T07:36:11.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.290+0000 7f6352b9c700 1 --2- 172.21.15.144:0/1561012588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c0b0720 0x7f634c0b0b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f634c0cc800 tx=0x7f634400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631028a56779dc8d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f6351399700 1 -- 172.21.15.144:0/1561012588 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400e070 con 0x7f634c0b0720 2023-05-11T07:36:11.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f6351399700 1 -- 172.21.15.144:0/1561012588 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344003a20 con 0x7f634c0b0720 2023-05-11T07:36:11.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f6351399700 1 -- 172.21.15.144:0/1561012588 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344003dd0 con 0x7f634c0b0720 2023-05-11T07:36:11.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f90fcb99700 1 -- 172.21.15.144:0/1618072596 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000e070 con 0x7f90f80b0720 2023-05-11T07:36:11.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f90fcb99700 1 -- 172.21.15.144:0/1618072596 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0003a20 con 0x7f90f80b0720 2023-05-11T07:36:11.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f90fcb99700 1 -- 172.21.15.144:0/1618072596 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0003dd0 con 0x7f90f80b0720 2023-05-11T07:36:11.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7fd2ed59a700 1 -- 172.21.15.144:0/233429340 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800e070 con 0x7fd2f00cdef0 2023-05-11T07:36:11.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7fd2ed59a700 1 -- 172.21.15.144:0/233429340 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800b9c0 con 0x7fd2f00cdef0 2023-05-11T07:36:11.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7fd2ed59a700 1 -- 172.21.15.144:0/233429340 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800bd70 con 0x7fd2f00cdef0 2023-05-11T07:36:11.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f1ecaffd700 1 -- 172.21.15.144:0/2453472840 >> v2:172.21.15.145:3300/0 conn(0x7f1ecc0cacc0 msgr2=0x7f1ecc158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f1ecaffd700 1 --2- 172.21.15.144:0/2453472840 >> v2:172.21.15.145:3300/0 conn(0x7f1ecc0cacc0 0x7f1ecc158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f1ecaffd700 1 -- 172.21.15.144:0/2453472840 >> v1:172.21.15.144:6789/0 conn(0x7f1ecc06dec0 legacy=0x7f1ecc0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f1ecaffd700 1 -- 172.21.15.144:0/2453472840 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0cdce0 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 -- 172.21.15.144:0/1561012588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c0b0720 msgr2=0x7f634c0b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 --2- 172.21.15.144:0/1561012588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c0b0720 0x7f634c0b0b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f634c0cc800 tx=0x7f634400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.291+0000 7f37fa99c700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f41655e0 0x7f37f40cc870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37f406fc10 tx=0x7f37ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba0849fa044943e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 -- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 msgr2=0x7f90f80b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f80b0b80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009e50 tx=0x7f90f000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 -- 172.21.15.144:0/233429340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f00cdef0 msgr2=0x7fd2f0164940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/233429340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f00cdef0 0x7fd2f0164940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00c9270 tx=0x7fd2e800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 -- 172.21.15.144:0/233429340 shutdown_connections 2023-05-11T07:36:11.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/233429340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f00cdef0 0x7fd2f0164940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/233429340 >> v2:172.21.15.144:3300/0 conn(0x7fd2f01599e0 0x7fd2f00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7fd2f49ff700 1 -- 172.21.15.144:0/233429340 >> 172.21.15.144:0/233429340 conn(0x7fd2f00cb720 msgr2=0x7fd2f00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 -- 172.21.15.144:0/1618072596 shutdown_connections 2023-05-11T07:36:11.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f80b0b80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 --2- 172.21.15.144:0/1618072596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cbe30 0x7f90f80c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.323 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f90ffdff700 1 -- 172.21.15.144:0/1618072596 >> 172.21.15.144:0/1618072596 conn(0x7f90f806af60 msgr2=0x7f90f80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f1ecaffd700 1 --2- 172.21.15.144:0/2453472840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009e50 tx=0x7f1ebc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419093416f261da3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b10012430 con 0x7f1b18160ee0 2023-05-11T07:36:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 -- 172.21.15.144:0/1561012588 shutdown_connections 2023-05-11T07:36:11.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 --2- 172.21.15.144:0/1561012588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c0b0720 0x7f634c0b0b20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 --2- 172.21.15.144:0/1561012588 >> v2:172.21.15.144:3300/0 conn(0x7f634c160fa0 0x7f634c0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f63545ff700 1 -- 172.21.15.144:0/1561012588 >> 172.21.15.144:0/1561012588 conn(0x7f634c06af60 msgr2=0x7f634c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f1b14ff9700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 0x7f1afc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f37f9199700 1 -- 172.21.15.144:0/3614371338 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00e070 con 0x7f37f41655e0 2023-05-11T07:36:11.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f37f9199700 1 -- 172.21.15.144:0/3614371338 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec00b9c0 con 0x7f37f41655e0 2023-05-11T07:36:11.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.292+0000 7f37f9199700 1 -- 172.21.15.144:0/3614371338 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00bd70 con 0x7f37f41655e0 2023-05-11T07:36:11.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f37fc3ff700 1 -- 172.21.15.144:0/3614371338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f41655e0 msgr2=0x7f37f40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f41655e0 0x7f37f40cc870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37f406fc10 tx=0x7f37ec00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7fd2f49ff700 1 -- 172.21.15.144:0/233429340 shutdown_connections 2023-05-11T07:36:11.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c44158d90 0x7f4c4415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c4406dec0 0x7f4c440b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c440cacc0 0x7f4c440b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4415d5d0 con 0x7f4c4406dec0 2023-05-11T07:36:11.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440cb4a0 con 0x7f4c440cacc0 2023-05-11T07:36:11.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f4c4a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440cb1c0 con 0x7f4c44158d90 2023-05-11T07:36:11.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b10022070 con 0x7f1b18160ee0 2023-05-11T07:36:11.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f63545ff700 1 -- 172.21.15.144:0/1561012588 shutdown_connections 2023-05-11T07:36:11.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f90ffdff700 1 -- 172.21.15.144:0/1618072596 shutdown_connections 2023-05-11T07:36:11.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f90ffdff700 1 -- 172.21.15.144:0/1618072596 wait complete. 2023-05-11T07:36:11.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f4c43fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c440cacc0 0x7f4c440b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f4c43fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4c440cacc0 0x7f4c440b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51788/0 (socket says 172.21.15.144:51788) 2023-05-11T07:36:11.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f4c43fff700 1 -- 172.21.15.144:0/793821039 learned_addr learned my addr 172.21.15.144:0/793821039 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f1b177fe700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 0x7f1afc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f4c437fe700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c44158d90 0x7f4c4415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f37fc3ff700 1 -- 172.21.15.144:0/3614371338 shutdown_connections 2023-05-11T07:36:11.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f41655e0 0x7f37f40cc870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/3614371338 >> v2:172.21.15.145:3300/0 conn(0x7f37f4160e10 0x7f37f40719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/3614371338 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f4071ef0 0x7f37f41650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f37fc3ff700 1 -- 172.21.15.144:0/3614371338 >> 172.21.15.144:0/3614371338 conn(0x7f37f40cb720 msgr2=0x7f37f40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.294+0000 7f4c42ffd700 1 --2- 172.21.15.144:0/793821039 >> v2:172.21.15.144:3300/0 conn(0x7f4c4406dec0 0x7f4c440b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.293+0000 7fd2f49ff700 1 -- 172.21.15.144:0/233429340 wait complete. 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 -- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c44158d90 msgr2=0x7f4c4415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c44158d90 0x7f4c4415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 -- 172.21.15.144:0/793821039 >> v2:172.21.15.144:3300/0 conn(0x7f4c4406dec0 msgr2=0x7f4c440b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 --2- 172.21.15.144:0/793821039 >> v2:172.21.15.144:3300/0 conn(0x7f4c4406dec0 0x7f4c440b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 -- 172.21.15.144:0/793821039 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440cdce0 con 0x7f4c440cacc0 2023-05-11T07:36:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f37fc3ff700 1 -- 172.21.15.144:0/3614371338 shutdown_connections 2023-05-11T07:36:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f4c43fff700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c440b0c60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c4415c630 tx=0x7f4c34009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187d7a8cc9fbee88 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f37fc3ff700 1 -- 172.21.15.144:0/3614371338 wait complete. 2023-05-11T07:36:11.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.295+0000 7f63545ff700 1 -- 172.21.15.144:0/1561012588 wait complete. 2023-05-11T07:36:11.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.296+0000 7f90ffdff700 1 Processor -- start 2023-05-11T07:36:11.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.296+0000 7fd2f49ff700 1 Processor -- start 2023-05-11T07:36:11.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7fd2f49ff700 1 -- start start 2023-05-11T07:36:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.296+0000 7f4c427fc700 1 -- 172.21.15.144:0/793821039 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011830 con 0x7f4c440cacc0 2023-05-11T07:36:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7f4c427fc700 1 -- 172.21.15.144:0/793821039 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34011990 con 0x7f4c440cacc0 2023-05-11T07:36:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7f4c427fc700 1 -- 172.21.15.144:0/793821039 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011d20 con 0x7f4c440cacc0 2023-05-11T07:36:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7f63545ff700 1 Processor -- start 2023-05-11T07:36:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f37fc3ff700 1 Processor -- start 2023-05-11T07:36:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7f63545ff700 1 -- start start 2023-05-11T07:36:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 msgr2=0x7f4c440b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c440b0c60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c4415c630 tx=0x7f4c34009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f00ca020 0x7fd2f00c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2f00cdef0 0x7fd2f015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00c8ba0 con 0x7fd2f00ca020 2023-05-11T07:36:11.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f015ca70 con 0x7fd2f01599e0 2023-05-11T07:36:11.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7fd2f49ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f014e040 con 0x7fd2f00cdef0 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.297+0000 7f90ffdff700 1 -- start start 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f81f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f80cbe30 0x7f90f80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8157890 con 0x7f90f80cbe30 2023-05-11T07:36:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81fa990 con 0x7f90f80b0720 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f90ffdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81fac70 con 0x7f90f80cacc0 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/793821039 shutdown_connections 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c440b0c60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/793821039 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c44158d90 0x7f4c4415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/793821039 >> v2:172.21.15.144:3300/0 conn(0x7f4c4406dec0 0x7f4c440b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/793821039 >> 172.21.15.144:0/793821039 conn(0x7f4c440cb720 msgr2=0x7f4c440cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 0x7f634c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 0x7f634c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c160fa0 0x7f634c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b31a0 con 0x7f634c160fa0 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b2590 con 0x7f634c071ad0 2023-05-11T07:36:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f63545ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b2870 con 0x7f634c0b0720 2023-05-11T07:36:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.296+0000 7f1b177fe700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 0x7f1afc06d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b080016b0 tx=0x7f1b080079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f635239b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 0x7f634c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f635239b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 0x7f634c154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51800/0 (socket says 172.21.15.144:51800) 2023-05-11T07:36:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f635239b700 1 -- 172.21.15.144:0/4236149283 learned_addr learned my addr 172.21.15.144:0/4236149283 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.298+0000 7f37fc3ff700 1 -- start start 2023-05-11T07:36:11.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7fd2eed9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7fd2eed9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51794/0 (socket says 172.21.15.144:51794) 2023-05-11T07:36:11.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7fd2eed9d700 1 -- 172.21.15.144:0/2419874835 learned_addr learned my addr 172.21.15.144:0/2419874835 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7fd2ee59c700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f00ca020 0x7fd2f00c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1b10056720 con 0x7f1b18160ee0 2023-05-11T07:36:11.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f37fc3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f4071ef0 0x7f37f4163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f37fc3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f41655e0 0x7f37f41f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f37fc3ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fc3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4161370 con 0x7f37f4071ef0 2023-05-11T07:36:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fc3ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41f57b0 con 0x7f37f414fe00 2023-05-11T07:36:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fc3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41f5a60 con 0x7f37f41655e0 2023-05-11T07:36:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/793821039 shutdown_connections 2023-05-11T07:36:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/793821039 wait complete. 2023-05-11T07:36:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f1eca7fc700 1 -- 172.21.15.144:0/2453472840 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00e070 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f1eca7fc700 1 -- 172.21.15.144:0/2453472840 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc003a20 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f1eca7fc700 1 -- 172.21.15.144:0/2453472840 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003dd0 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f6352b9c700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c160fa0 0x7f634c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52338/0 (socket says 172.21.15.144:52338) 2023-05-11T07:36:11.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 -- 172.21.15.144:0/2032156439 learned_addr learned my addr 172.21.15.144:0/2032156439 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fdb9b700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f81f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 -- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 msgr2=0x7f90f81f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f81f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 -- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f80cbe30 msgr2=0x7f90f80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.299+0000 7f90fd39a700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f80cbe30 0x7f90f80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f90fd39a700 1 -- 172.21.15.144:0/2032156439 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009b30 con 0x7f90f80cacc0 2023-05-11T07:36:11.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f90fd39a700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00b4a0 tx=0x7f90ec00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fa99c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fa99c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51812/0 (socket says 172.21.15.144:51812) 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fa99c700 1 -- 172.21.15.144:0/772153641 learned_addr learned my addr 172.21.15.144:0/772153641 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f37fa19b700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f4071ef0 0x7f37f4163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37f999a700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f41655e0 0x7f37f41f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 -- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f41655e0 msgr2=0x7f37f41f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f41655e0 0x7f37f41f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 -- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f4071ef0 msgr2=0x7f37f4163cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f4071ef0 0x7f37f4163cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 -- 172.21.15.144:0/772153641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec009b30 con 0x7f37f414fe00 2023-05-11T07:36:11.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011830 con 0x7f90f80cacc0 2023-05-11T07:36:11.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec011990 con 0x7f90f80cacc0 2023-05-11T07:36:11.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011d40 con 0x7f90f80cacc0 2023-05-11T07:36:11.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f37fa99c700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00b370 tx=0x7f37ec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f815cd70 con 0x7f90f80cacc0 2023-05-11T07:36:11.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f815ca90 con 0x7f90f80cacc0 2023-05-11T07:36:11.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.300+0000 7f6351b9a700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 0x7f634c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f6351b9a700 1 -- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 msgr2=0x7f634c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f6351b9a700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 0x7f634c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f6351b9a700 1 -- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c160fa0 msgr2=0x7f634c0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f6351b9a700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c160fa0 0x7f634c0b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.301+0000 7f6351b9a700 1 -- 172.21.15.144:0/4236149283 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009b30 con 0x7f634c0b0720 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f6351b9a700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 0x7f634c0b1af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c400 tx=0x7f633c00c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec004250 con 0x7f37f414fe00 2023-05-11T07:36:11.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec0043b0 con 0x7f37f414fe00 2023-05-11T07:36:11.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7fd2edd9b700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2f00cdef0 0x7fd2f015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7fd2eed9d700 1 -- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2f00cdef0 msgr2=0x7fd2f015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7fd2eed9d700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2f00cdef0 0x7fd2f015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7fd2eed9d700 1 -- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f00ca020 msgr2=0x7fd2f00c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec004760 con 0x7f37f414fe00 2023-05-11T07:36:11.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40caf70 con 0x7f37f414fe00 2023-05-11T07:36:11.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.302+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40cac90 con 0x7f37f414fe00 2023-05-11T07:36:11.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7fd2eed9d700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f00ca020 0x7fd2f00c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7fd2eed9d700 1 -- 172.21.15.144:0/2419874835 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8009b30 con 0x7fd2f01599e0 2023-05-11T07:36:11.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f4c4a1ff700 1 Processor -- start 2023-05-11T07:36:11.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f4c4a1ff700 1 -- start start 2023-05-11T07:36:11.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f1ed21ff700 1 -- 172.21.15.144:0/2453472840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 msgr2=0x7f1ecc15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/2453472840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009e50 tx=0x7f1ebc00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:11.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.304+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f40cb250 con 0x7f37f414fe00 2023-05-11T07:36:11.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011790 con 0x7f634c0b0720 2023-05-11T07:36:11.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.303+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c011910 con 0x7f634c0b0720 2023-05-11T07:36:11.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.304+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011cc0 con 0x7f634c0b0720 2023-05-11T07:36:11.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.304+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c164f80 con 0x7f634c0b0720 2023-05-11T07:36:11.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.304+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c164ca0 con 0x7f634c0b0720 2023-05-11T07:36:11.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7fd2eed9d700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8012000 tx=0x7fd2e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7f1ed21ff700 1 -- 172.21.15.144:0/2453472840 shutdown_connections 2023-05-11T07:36:11.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/2453472840 >> v2:172.21.15.145:3300/0 conn(0x7f1ecc0cacc0 0x7f1ecc158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/2453472840 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0b0e30 0x7f1ecc15d090 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7f1ed21ff700 1 -- 172.21.15.144:0/2453472840 >> 172.21.15.144:0/2453472840 conn(0x7f1ecc0cb720 msgr2=0x7f1ecc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c0cb460 con 0x7f634c0b0720 2023-05-11T07:36:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.305+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80cb430 con 0x7f90f80cacc0 2023-05-11T07:36:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f1ed21ff700 1 -- 172.21.15.144:0/2453472840 shutdown_connections 2023-05-11T07:36:11.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f1ed21ff700 1 -- 172.21.15.144:0/2453472840 wait complete. 2023-05-11T07:36:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90ec01a400 con 0x7f90f80cacc0 2023-05-11T07:36:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f90f67fc700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 0x7f90e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f4c4a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 0x7f4c4414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 0x7f4c4414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.306+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 0x7f4c4414a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52392/0 (socket says 172.21.15.144:52392) 2023-05-11T07:36:11.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c4a1ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90ec089720 con 0x7f90f80cacc0 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c42ffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c4a1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c44158d90 0x7f4c440cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c4a1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415a6f0 con 0x7f4c44158d90 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c4a1ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415a9d0 con 0x7f4c440cacc0 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c4a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415acb0 con 0x7f4c4406dec0 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c42ffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51816/0 (socket says 172.21.15.144:51816) 2023-05-11T07:36:11.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f4c42ffd700 1 -- 172.21.15.144:0/821923209 learned_addr learned my addr 172.21.15.144:0/821923209 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f1ed21ff700 1 Processor -- start 2023-05-11T07:36:11.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.308+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f633c01c460 con 0x7f634c0b0720 2023-05-11T07:36:11.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c43fff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c44158d90 0x7f4c440cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 -- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 msgr2=0x7f4c4414a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 0x7f4c4414a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 -- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c44158d90 msgr2=0x7f4c440cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c44158d90 0x7f4c440cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 -- 172.21.15.144:0/821923209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009550 con 0x7f4c440cacc0 2023-05-11T07:36:11.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f1ed21ff700 1 -- start start 2023-05-11T07:36:11.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37ec01b430 con 0x7f37f414fe00 2023-05-11T07:36:11.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.309+0000 7f4c42ffd700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d800 tx=0x7f4c3800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38012630 con 0x7f4c440cacc0 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38012790 con 0x7f4c440cacc0 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38012b20 con 0x7f4c440cacc0 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c440ce2a0 con 0x7f4c440cacc0 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c440cdfc0 con 0x7f4c440cacc0 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ecc06dec0 0x7f1ecc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ecc0b0e30 0x7f1ecc0c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc15c1c0 con 0x7f1ecc06dec0 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c8c20 con 0x7f1ecc0b0e30 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f1ed21ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c8790 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52406/0 (socket says 172.21.15.144:52406) 2023-05-11T07:36:11.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 -- 172.21.15.144:0/544929491 learned_addr learned my addr 172.21.15.144:0/544929491 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecaffd700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ecc0b0e30 0x7f1ecc0c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7f90fdb9b700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 0x7f90e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f90fdb9b700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 0x7f90e406d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009930 tx=0x7f90e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 -- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ecc0b0e30 msgr2=0x7f1ecc0c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ecc0b0e30 0x7f1ecc0c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 -- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ecc06dec0 msgr2=0x7f1ecc15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ecc06dec0 0x7f1ecc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7f1ecbfff700 1 -- 172.21.15.144:0/544929491 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc009b30 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80042d0 con 0x7fd2f01599e0 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8004430 con 0x7fd2f01599e0 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.310+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80047c0 con 0x7fd2f01599e0 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f0159db0 con 0x7fd2f01599e0 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.311+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f015a9a0 con 0x7fd2f01599e0 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.312+0000 7f6342ffd700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 0x7f633006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.312+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f633c0893f0 con 0x7f634c0b0720 2023-05-11T07:36:11.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.312+0000 7f635239b700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 0x7f633006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.312+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f90ec054570 con 0x7f90f80cacc0 2023-05-11T07:36:11.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.313+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c240052f0 con 0x7f4c440cacc0 2023-05-11T07:36:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.312+0000 7f1ecbfff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400e820 tx=0x7f1ec400ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.313+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f00b0e30 con 0x7fd2f01599e0 2023-05-11T07:36:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.315+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c38012c80 con 0x7f4c440cacc0 2023-05-11T07:36:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.313+0000 7f635239b700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 0x7f633006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6348009a80 tx=0x7f6348009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.314+0000 7f37eaffd700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 0x7f37d806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.314+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37ec08b1b0 con 0x7f37f414fe00 2023-05-11T07:36:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.314+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f37ec08b590 con 0x7f37f414fe00 2023-05-11T07:36:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.315+0000 7f37fa19b700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 0x7f37d806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.316+0000 7f37fa19b700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 0x7f37d806d290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37e4006b20 tx=0x7f37e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.315+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2e801b430 con 0x7fd2f01599e0 2023-05-11T07:36:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4009550 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4013680 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4013a10 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f4c2bfff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 0x7f4c3006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c380892f0 con 0x7f4c440cacc0 2023-05-11T07:36:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7fd2deffd700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 0x7fd2d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd2e808aa50 con 0x7fd2f01599e0 2023-05-11T07:36:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc0ce2a0 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.317+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc0cdfc0 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.319+0000 7fd2ee59c700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 0x7fd2d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.320+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac0052f0 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.320+0000 7f4c437fe700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 0x7f4c3006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.320+0000 7fd2ee59c700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 0x7fd2d006d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006fd0 tx=0x7fd2e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.320+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c380541d0 con 0x7f4c440cacc0 2023-05-11T07:36:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.321+0000 7f4c437fe700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 0x7f4c3006d1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0113e0 tx=0x7f4c3c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.320+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f633c054190 con 0x7f634c0b0720 2023-05-11T07:36:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.322+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ec4013b70 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.323+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd2e8059310 con 0x7fd2f01599e0 2023-05-11T07:36:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.323+0000 7f1eb3fff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 0x7f1eb806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.323+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ec40898d0 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.324+0000 7f1ecb7fe700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 0x7f1eb806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.325+0000 7f1ecb7fe700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 0x7f1eb806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0003df0 tx=0x7f1ec0007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.326+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1ec4058100 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.732+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff79015ba30 con 0x7ff7900c92f0 2023-05-11T07:36:11.741 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2023-05-11T07:36:11.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.734+0000 7ff7777fe700 1 -- 172.21.15.144:0/1719032808 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff79015ba30 con 0x7ff7900c92f0 2023-05-11T07:36:11.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.738+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 msgr2=0x7ff77c071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.738+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 0x7ff77c071670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7800011e0 tx=0x7ff780009040 comp rx=0 tx=0).stop 2023-05-11T07:36:11.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.738+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 msgr2=0x7ff79006fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.738+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 0x7ff79006fd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c7f0 tx=0x7ff78800cbb0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 shutdown_connections 2023-05-11T07:36:11.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff77c06f1c0 0x7ff77c071670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff7900b0e30 0x7ff790149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff790158ad0 0x7ff790070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 --2- 172.21.15.144:0/1719032808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7900c92f0 0x7ff79006fd10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 >> 172.21.15.144:0/1719032808 conn(0x7ff79006af60 msgr2=0x7ff790157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 shutdown_connections 2023-05-11T07:36:11.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.740+0000 7ff7951ff700 1 -- 172.21.15.144:0/1719032808 wait complete. 2023-05-11T07:36:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.752+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1af00055a0 con 0x7f1b18160ee0 2023-05-11T07:36:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.754+0000 7f1b14ff9700 1 -- 172.21.15.144:0/89023218 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b10059d40 con 0x7f1b18160ee0 2023-05-11T07:36:11.761 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2023-05-11T07:36:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.759+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 msgr2=0x7f1afc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.759+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 0x7f1afc06d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b080016b0 tx=0x7f1b080079c0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.759+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 msgr2=0x7f1b180cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.759+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b1806b740 tx=0x7f1b10004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f634c0744c0 con 0x7f634c0b0720 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 shutdown_connections 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1afc06adb0 0x7f1afc06d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b18160ee0 0x7f1b180cb950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1806b180 0x7f1b1814e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 --2- 172.21.15.144:0/89023218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b1815c940 0x7f1b1815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 >> 172.21.15.144:0/89023218 conn(0x7f1b180d3180 msgr2=0x7f1b180b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 shutdown_connections 2023-05-11T07:36:11.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.765+0000 7f1b1ddff700 1 -- 172.21.15.144:0/89023218 wait complete. 2023-05-11T07:36:11.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.766+0000 7f6342ffd700 1 -- 172.21.15.144:0/4236149283 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f633c0577b0 con 0x7f634c0b0720 2023-05-11T07:36:11.770 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2023-05-11T07:36:11.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.1 2023-05-11T07:36:11.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.769+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f90f81fb750 con 0x7f90f80cacc0 2023-05-11T07:36:11.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.769+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd2f00b1700 con 0x7fd2f01599e0 2023-05-11T07:36:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f90f67fc700 1 -- 172.21.15.144:0/2032156439 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90f81fb750 con 0x7f90f80cacc0 2023-05-11T07:36:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f37f41f5f50 con 0x7f37f414fe00 2023-05-11T07:36:11.774 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2023-05-11T07:36:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 msgr2=0x7f633006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 0x7f633006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6348009a80 tx=0x7f6348009190 comp rx=0 tx=0).stop 2023-05-11T07:36:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 msgr2=0x7f634c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 0x7f634c0b1af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c400 tx=0x7f633c00c710 comp rx=0 tx=0).stop 2023-05-11T07:36:11.775 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2023-05-11T07:36:11.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7f37eaffd700 1 -- 172.21.15.144:0/772153641 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37ec055fe0 con 0x7f37f414fe00 2023-05-11T07:36:11.776 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2023-05-11T07:36:11.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.770+0000 7fd2deffd700 1 -- 172.21.15.144:0/2419874835 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2e8058ea0 con 0x7fd2f01599e0 2023-05-11T07:36:11.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 shutdown_connections 2023-05-11T07:36:11.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f633006adb0 0x7f633006d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c160fa0 0x7f634c0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f634c071ad0 0x7f634c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 --2- 172.21.15.144:0/4236149283 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f634c0b0720 0x7f634c0b1af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 >> 172.21.15.144:0/4236149283 conn(0x7f634c06af60 msgr2=0x7f634c0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 shutdown_connections 2023-05-11T07:36:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.771+0000 7f63545ff700 1 -- 172.21.15.144:0/4236149283 wait complete. 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 msgr2=0x7f90e406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 0x7f90e406d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009930 tx=0x7f90e8008040 comp rx=0 tx=0).stop 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 msgr2=0x7f90f8157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00b4a0 tx=0x7f90ec00b860 comp rx=0 tx=0).stop 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 shutdown_connections 2023-05-11T07:36:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f90e406adb0 0x7f90e406d260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90f80cbe30 0x7f90f80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90f80b0720 0x7f90f81f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 --2- 172.21.15.144:0/2032156439 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f90f80cacc0 0x7f90f8157350 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.774+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 >> 172.21.15.144:0/2032156439 conn(0x7f90f806af60 msgr2=0x7f90f80cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 msgr2=0x7f37d806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 0x7f37d806d290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37e4006b20 tx=0x7f37e4008040 comp rx=0 tx=0).stop 2023-05-11T07:36:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 msgr2=0x7f37f40b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00b370 tx=0x7f37ec004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 shutdown_connections 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 shutdown_connections 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37d806ade0 0x7f37d806d290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37f414fe00 0x7f37f40b1af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37f4071ef0 0x7f37f4163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 --2- 172.21.15.144:0/772153641 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f37f41655e0 0x7f37f41f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 >> 172.21.15.144:0/772153641 conn(0x7f37f40cb720 msgr2=0x7f37f415ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 msgr2=0x7fd2d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 0x7fd2d006d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006fd0 tx=0x7fd2e0008040 comp rx=0 tx=0).stop 2023-05-11T07:36:11.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 msgr2=0x7fd2f00c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8012000 tx=0x7fd2e8004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.775+0000 7f90ffdff700 1 -- 172.21.15.144:0/2032156439 wait complete. 2023-05-11T07:36:11.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 shutdown_connections 2023-05-11T07:36:11.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd2d006adb0 0x7fd2d006d260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f01599e0 0x7fd2f00c3ce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f00ca020 0x7fd2f00c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 --2- 172.21.15.144:0/2419874835 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd2f00cdef0 0x7fd2f015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 >> 172.21.15.144:0/2419874835 conn(0x7fd2f00cb720 msgr2=0x7fd2f0157970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c24005870 con 0x7f4c440cacc0 2023-05-11T07:36:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 shutdown_connections 2023-05-11T07:36:11.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7fd2f49ff700 1 -- 172.21.15.144:0/2419874835 wait complete. 2023-05-11T07:36:11.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 shutdown_connections 2023-05-11T07:36:11.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.776+0000 7f37fc3ff700 1 -- 172.21.15.144:0/772153641 wait complete. 2023-05-11T07:36:11.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.777+0000 7f4c2bfff700 1 -- 172.21.15.144:0/821923209 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c380577f0 con 0x7f4c440cacc0 2023-05-11T07:36:11.787 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2023-05-11T07:36:11.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 msgr2=0x7f4c3006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 0x7f4c3006d1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0113e0 tx=0x7f4c3c00b040 comp rx=0 tx=0).stop 2023-05-11T07:36:11.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 msgr2=0x7f4c4415b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d800 tx=0x7f4c3800db10 comp rx=0 tx=0).stop 2023-05-11T07:36:11.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1eac005870 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 shutdown_connections 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4c3006ad30 0x7f4c3006d1e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4c4406dec0 0x7f4c4414a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c44158d90 0x7f4c440cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 --2- 172.21.15.144:0/821923209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c440cacc0 0x7f4c4415b790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 >> 172.21.15.144:0/821923209 conn(0x7f4c440cb720 msgr2=0x7f4c440cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.780+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 shutdown_connections 2023-05-11T07:36:11.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.781+0000 7f4c4a1ff700 1 -- 172.21.15.144:0/821923209 wait complete. 2023-05-11T07:36:11.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.788+0000 7f1eb3fff700 1 -- 172.21.15.144:0/544929491 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ec4057c90 con 0x7f1ecc0cacc0 2023-05-11T07:36:11.793 INFO:teuthology.orchestra.run.smithi144.stdout:60129542156 2023-05-11T07:36:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 msgr2=0x7f1eb806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 0x7f1eb806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0003df0 tx=0x7f1ec0007a40 comp rx=0 tx=0).stop 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 msgr2=0x7f1ecc0c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400e820 tx=0x7f1ec400ebe0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 shutdown_connections 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1eb806adb0 0x7f1eb806d260 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0003df0 tx=0x7f1ec0007a40 comp rx=0 tx=0).stop 2023-05-11T07:36:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1ecc0cacc0 0x7f1ecc0c1230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ecc06dec0 0x7f1ecc15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 --2- 172.21.15.144:0/544929491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ecc0b0e30 0x7f1ecc0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.794+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 >> 172.21.15.144:0/544929491 conn(0x7f1ecc0cb720 msgr2=0x7f1ecc0ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.795+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 shutdown_connections 2023-05-11T07:36:11.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:11.795+0000 7f1ed21ff700 1 -- 172.21.15.144:0/544929491 wait complete. 2023-05-11T07:36:11.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2023-05-11T07:36:11.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.7 2023-05-11T07:36:11.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.2 2023-05-11T07:36:11.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.5 2023-05-11T07:36:11.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.6 2023-05-11T07:36:11.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.3 2023-05-11T07:36:11.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.0 2023-05-11T07:36:11.823 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:12.773 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-11T07:36:12.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-11T07:36:12.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-11T07:36:12.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-11T07:36:12.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-11T07:36:12.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-11T07:36:12.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-11T07:36:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.060+0000 7efda97ff700 1 Processor -- start 2023-05-11T07:36:13.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.060+0000 7efda97ff700 1 -- start start 2023-05-11T07:36:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.063+0000 7efda97ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 0x7efda40ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.063+0000 7efda97ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 0x7efda4164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.063+0000 7efda97ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda406ead0 con 0x7efda406a6a0 2023-05-11T07:36:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.063+0000 7efda97ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40cfc00 con 0x7efda406e680 2023-05-11T07:36:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.063+0000 7efda97ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda406cc10 con 0x7efda406a2d0 2023-05-11T07:36:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.064+0000 7efda37fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 0x7efda4164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.064+0000 7efda37fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 0x7efda4164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51826/0 (socket says 172.21.15.144:51826) 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.064+0000 7efda37fe700 1 -- 172.21.15.144:0/105652339 learned_addr learned my addr 172.21.15.144:0/105652339 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.064+0000 7efda2ffd700 1 --2- 172.21.15.144:0/105652339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 0x7efda40ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda1ffb700 1 -- 172.21.15.144:0/105652339 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990120900 0 0) 0x7efd98001110 con 0x7efda406a6a0 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda2ffd700 1 -- 172.21.15.144:0/105652339 >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 msgr2=0x7efda4164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda2ffd700 1 --2- 172.21.15.144:0/105652339 >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 0x7efda4164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda2ffd700 1 -- 172.21.15.144:0/105652339 >> v1:172.21.15.145:6789/0 conn(0x7efda406a6a0 legacy=0x7efda406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda2ffd700 1 -- 172.21.15.144:0/105652339 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda406cef0 con 0x7efda406a2d0 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.065+0000 7efda2ffd700 1 --2- 172.21.15.144:0/105652339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 0x7efda40ce9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009d90 tx=0x7efd9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d39251150b16bf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.066+0000 7efda1ffb700 1 -- 172.21.15.144:0/105652339 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e070 con 0x7efda406a2d0 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.066+0000 7efda1ffb700 1 -- 172.21.15.144:0/105652339 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00bb20 con 0x7efda406a2d0 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.066+0000 7efda1ffb700 1 -- 172.21.15.144:0/105652339 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c012430 con 0x7efda406a2d0 2023-05-11T07:36:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 -- 172.21.15.144:0/105652339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 msgr2=0x7efda40ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 --2- 172.21.15.144:0/105652339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 0x7efda40ce9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009d90 tx=0x7efd9c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 -- 172.21.15.144:0/105652339 shutdown_connections 2023-05-11T07:36:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 --2- 172.21.15.144:0/105652339 >> v2:172.21.15.145:3300/0 conn(0x7efda406e680 0x7efda4164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 --2- 172.21.15.144:0/105652339 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a2d0 0x7efda40ce9f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 -- 172.21.15.144:0/105652339 >> 172.21.15.144:0/105652339 conn(0x7efda40cc830 msgr2=0x7efda40ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.067+0000 7efda97ff700 1 -- 172.21.15.144:0/105652339 shutdown_connections 2023-05-11T07:36:13.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.068+0000 7efda97ff700 1 -- 172.21.15.144:0/105652339 wait complete. 2023-05-11T07:36:13.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.070+0000 7efda97ff700 1 Processor -- start 2023-05-11T07:36:13.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.071+0000 7efda97ff700 1 -- start start 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda406a2d0 0x7efda415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda406e680 0x7efda40bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40c31c0 con 0x7efda406e680 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40bf440 con 0x7efda406a2d0 2023-05-11T07:36:13.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.072+0000 7efda97ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40beb10 con 0x7efda406a6a0 2023-05-11T07:36:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.073+0000 7efda27fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52418/0 (socket says 172.21.15.144:52418) 2023-05-11T07:36:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 -- 172.21.15.144:0/3925352475 learned_addr learned my addr 172.21.15.144:0/3925352475 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda37fe700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda406e680 0x7efda40bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda2ffd700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda406a2d0 0x7efda415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 -- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda406a2d0 msgr2=0x7efda415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda406a2d0 0x7efda415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 -- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda406e680 msgr2=0x7efda40bf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda406e680 0x7efda40bf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.074+0000 7efda27fc700 1 -- 172.21.15.144:0/3925352475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c009a70 con 0x7efda406a6a0 2023-05-11T07:36:13.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.075+0000 7efda27fc700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c780 tx=0x7efd9800ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.076+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd980054e0 con 0x7efda406a6a0 2023-05-11T07:36:13.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.076+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda406d4b0 con 0x7efda406a6a0 2023-05-11T07:36:13.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.076+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda406d1d0 con 0x7efda406a6a0 2023-05-11T07:36:13.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.076+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98003680 con 0x7efda406a6a0 2023-05-11T07:36:13.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.076+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98003a30 con 0x7efda406a6a0 2023-05-11T07:36:13.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.080+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd98003b90 con 0x7efda406a6a0 2023-05-11T07:36:13.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.082+0000 7efd8b7fe700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 0x7efd9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.082+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd98088910 con 0x7efda406a6a0 2023-05-11T07:36:13.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.083+0000 7efda2ffd700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 0x7efd9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.084+0000 7efda2ffd700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 0x7efd9006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.084+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840052f0 con 0x7efda406a6a0 2023-05-11T07:36:13.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.091+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efd98057200 con 0x7efda406a6a0 2023-05-11T07:36:13.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.111+0000 7f370b5ff700 1 Processor -- start 2023-05-11T07:36:13.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.111+0000 7f370b5ff700 1 -- start start 2023-05-11T07:36:13.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 0x7f370406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 0x7f370406b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37040d1400 con 0x7f3704164950 2023-05-11T07:36:13.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37040cdf90 con 0x7f37040b6340 2023-05-11T07:36:13.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.113+0000 7f370b5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040ce270 con 0x7f3704160d60 2023-05-11T07:36:13.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f3708b9a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 0x7f370406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52426/0 (socket says 172.21.15.144:52426) 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 -- 172.21.15.144:0/1377783847 learned_addr learned my addr 172.21.15.144:0/1377783847 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 -- 172.21.15.144:0/1377783847 >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 msgr2=0x7f370406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 0x7f370406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f3709b9c700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 0x7f370406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 -- 172.21.15.144:0/1377783847 >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 msgr2=0x7f370406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 0x7f370406b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.114+0000 7f370939b700 1 -- 172.21.15.144:0/1377783847 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040ce550 con 0x7f3704160d60 2023-05-11T07:36:13.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f3709b9c700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 0x7f370406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:13.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f3708b9a700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 0x7f370406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:13.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7fe9059ff700 1 Processor -- start 2023-05-11T07:36:13.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f370939b700 1 --2- 172.21.15.144:0/1377783847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f37040d3e60 tx=0x7f370000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=158ba565b001593d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7fe9059ff700 1 -- start start 2023-05-11T07:36:13.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f36fbfff700 1 -- 172.21.15.144:0/1377783847 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000e070 con 0x7f3704160d60 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f36fbfff700 1 -- 172.21.15.144:0/1377783847 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370000b9c0 con 0x7f3704160d60 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.115+0000 7f36fbfff700 1 -- 172.21.15.144:0/1377783847 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000bd70 con 0x7f3704160d60 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.116+0000 7f370b5ff700 1 -- 172.21.15.144:0/1377783847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 msgr2=0x7f37040cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.116+0000 7f370b5ff700 1 --2- 172.21.15.144:0/1377783847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f37040d3e60 tx=0x7f370000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 -- 172.21.15.144:0/1377783847 shutdown_connections 2023-05-11T07:36:13.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.144:3300/0 conn(0x7f3704164950 0x7f370406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 --2- 172.21.15.144:0/1377783847 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f37040cd740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 --2- 172.21.15.144:0/1377783847 >> v2:172.21.15.145:3300/0 conn(0x7f37040b6340 0x7f370406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 -- 172.21.15.144:0/1377783847 >> 172.21.15.144:0/1377783847 conn(0x7f37040d3180 msgr2=0x7f37040d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 -- 172.21.15.144:0/1377783847 shutdown_connections 2023-05-11T07:36:13.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7fe9059ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe900160e10 0x7fe9000719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7fe9059ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90006d490 con 0x7fe9000cc870 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7fe9059ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000cea30 con 0x7fe900071ef0 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7fe9059ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe900164c50 con 0x7fe900160e10 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.118+0000 7fe8fe7fc700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7fe900071ef0 0x7fe9001650a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:59802/0 (socket says 172.21.15.144:59802) 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.118+0000 7fe8fe7fc700 1 -- 172.21.15.144:0/645733599 learned_addr learned my addr 172.21.15.144:0/645733599 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:13.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.119+0000 7fe8feffd700 1 --2- 172.21.15.144:0/645733599 >> v2:172.21.15.144:3300/0 conn(0x7fe900160e10 0x7fe9000719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.117+0000 7f370b5ff700 1 -- 172.21.15.144:0/1377783847 wait complete. 2023-05-11T07:36:13.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7fe8fdffb700 1 -- 172.21.15.144:0/645733599 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391288238 0 0) 0x7fe9000cea30 con 0x7fe900071ef0 2023-05-11T07:36:13.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7fe8fdffb700 1 -- 172.21.15.144:0/645733599 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ec0035b0 con 0x7fe900071ef0 2023-05-11T07:36:13.125 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7f370b5ff700 1 Processor -- start 2023-05-11T07:36:13.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7fe8feffd700 1 -- 172.21.15.144:0/645733599 >> v1:172.21.15.145:6789/0 conn(0x7fe900071ef0 legacy=0x7fe9001650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7fe8feffd700 1 -- 172.21.15.144:0/645733599 >> v1:172.21.15.144:6789/0 conn(0x7fe9000cc870 legacy=0x7fe9000b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.120+0000 7fe8feffd700 1 -- 172.21.15.144:0/645733599 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000cb530 con 0x7fe900160e10 2023-05-11T07:36:13.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.121+0000 7fe8feffd700 1 --2- 172.21.15.144:0/645733599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe900160e10 0x7fe9000719b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009840 tx=0x7fe8f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a573e77a265ded server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.121+0000 7f370b5ff700 1 -- start start 2023-05-11T07:36:13.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.121+0000 7fe8fdffb700 1 -- 172.21.15.144:0/645733599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0004230 con 0x7fe900160e10 2023-05-11T07:36:13.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.121+0000 7fe8fdffb700 1 -- 172.21.15.144:0/645733599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0004390 con 0x7fe900160e10 2023-05-11T07:36:13.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.121+0000 7fe8fdffb700 1 -- 172.21.15.144:0/645733599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00036a0 con 0x7fe900160e10 2023-05-11T07:36:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7fe9059ff700 1 -- 172.21.15.144:0/645733599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe900160e10 msgr2=0x7fe9000719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7fe9059ff700 1 --2- 172.21.15.144:0/645733599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe900160e10 0x7fe9000719b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009840 tx=0x7fe8f0009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37040b6340 0x7f37040c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f370415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37041fef90 con 0x7f3704164950 2023-05-11T07:36:13.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c9880 con 0x7f37040b6340 2023-05-11T07:36:13.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7f370b5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c82a0 con 0x7f3704160d60 2023-05-11T07:36:13.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7fe9059ff700 1 -- 172.21.15.144:0/645733599 shutdown_connections 2023-05-11T07:36:13.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.122+0000 7fe9059ff700 1 --2- 172.21.15.144:0/645733599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe900160e10 0x7fe9000719b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7fe9059ff700 1 -- 172.21.15.144:0/645733599 >> 172.21.15.144:0/645733599 conn(0x7fe9000cb720 msgr2=0x7fe9000cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7fe9059ff700 1 -- 172.21.15.144:0/645733599 shutdown_connections 2023-05-11T07:36:13.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7f3709b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7f3709b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41840/0 (socket says 172.21.15.144:41840) 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7f3709b9c700 1 -- 172.21.15.144:0/4135607423 learned_addr learned my addr 172.21.15.144:0/4135607423 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7f3708b9a700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f370415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.124+0000 7f3709b9c700 1 -- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 msgr2=0x7f370415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.124+0000 7f3709b9c700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f370415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.124+0000 7f3709b9c700 1 -- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37040b6340 msgr2=0x7f37040c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.124+0000 7f3709b9c700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37040b6340 0x7f37040c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.124+0000 7f3709b9c700 1 -- 172.21.15.144:0/4135607423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700009b30 con 0x7f3704164950 2023-05-11T07:36:13.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.123+0000 7fe9059ff700 1 -- 172.21.15.144:0/645733599 wait complete. 2023-05-11T07:36:13.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7f3709b9c700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c7f0 tx=0x7f36fc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7fe9059ff700 1 Processor -- start 2023-05-11T07:36:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc011800 con 0x7f3704164950 2023-05-11T07:36:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc011960 con 0x7f3704164950 2023-05-11T07:36:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc011d10 con 0x7f3704164950 2023-05-11T07:36:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7fe9059ff700 1 -- start start 2023-05-11T07:36:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9000cc870 0x7fe9000b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe900160e10 0x7fe9000b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c70f0 con 0x7fe9000cc870 2023-05-11T07:36:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c5d70 con 0x7fe900071ef0 2023-05-11T07:36:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7fe9059ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c6050 con 0x7fe900160e10 2023-05-11T07:36:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.125+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704161130 con 0x7f3704164950 2023-05-11T07:36:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.126+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040cdc80 con 0x7f3704164950 2023-05-11T07:36:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040ce830 con 0x7f3704164950 2023-05-11T07:36:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51866/0 (socket says 172.21.15.144:51866) 2023-05-11T07:36:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 -- 172.21.15.144:0/1317143513 learned_addr learned my addr 172.21.15.144:0/1317143513 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 -- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe900160e10 msgr2=0x7fe9000b3d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe900160e10 0x7fe9000b3d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.127+0000 7fe8feffd700 1 -- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9000cc870 msgr2=0x7fe9000b3810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.128+0000 7fe8fe7fc700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9000cc870 0x7fe9000b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.128+0000 7fe8feffd700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9000cc870 0x7fe9000b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.129+0000 7fe8feffd700 1 -- 172.21.15.144:0/1317143513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00094a0 con 0x7fe900071ef0 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.130+0000 7fe8feffd700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00090b0 tx=0x7fe8f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.131+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0003df0 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.131+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f001f070 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.131+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0011870 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.131+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9000caf70 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.131+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9000cac90 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.132+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9000cb250 con 0x7fe900071ef0 2023-05-11T07:36:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.133+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36fc024480 con 0x7f3704164950 2023-05-11T07:36:13.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.133+0000 7ff23f9ff700 1 Processor -- start 2023-05-11T07:36:13.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.134+0000 7f36f9ffb700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 0x7f36e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.134+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36fc089ba0 con 0x7f3704164950 2023-05-11T07:36:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.134+0000 7ff23f9ff700 1 -- start start 2023-05-11T07:36:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.135+0000 7ff23f9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2380cbe30 0x7ff2380c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.135+0000 7ff23f9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380b0e30 0x7ff238158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.135+0000 7ff23f9ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23815d0e0 con 0x7ff2380cacc0 2023-05-11T07:36:13.140 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.136+0000 7ff23f9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23806c6d0 con 0x7ff2380cbe30 2023-05-11T07:36:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.136+0000 7ff23f9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff238159010 con 0x7ff2380b0e30 2023-05-11T07:36:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.136+0000 7ff23cf9a700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff2380cacc0 0x7ff2380b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40792/0 (socket says 172.21.15.144:40792) 2023-05-11T07:36:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.136+0000 7ff23cf9a700 1 -- 172.21.15.144:0/976322722 learned_addr learned my addr 172.21.15.144:0/976322722 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.136+0000 7ff23d79b700 1 --2- 172.21.15.144:0/976322722 >> v2:172.21.15.144:3300/0 conn(0x7ff2380cbe30 0x7ff2380c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7ff23d79b700 1 -- 172.21.15.144:0/976322722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380b0e30 msgr2=0x7ff238158ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-11T07:36:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7ff23d79b700 1 --2- 172.21.15.144:0/976322722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380b0e30 0x7ff238158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7ff23d79b700 1 -- 172.21.15.144:0/976322722 >> v1:172.21.15.144:6789/0 conn(0x7ff2380cacc0 legacy=0x7ff2380b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7ff23d79b700 1 -- 172.21.15.144:0/976322722 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23815c7b0 con 0x7ff2380cbe30 2023-05-11T07:36:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.135+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8f0021030 con 0x7fe900071ef0 2023-05-11T07:36:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7fe8f7fff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 0x7fe8e006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8f008af60 con 0x7fe900071ef0 2023-05-11T07:36:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.137+0000 7ff23d79b700 1 --2- 172.21.15.144:0/976322722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cbe30 0x7ff2380c92f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff234009840 tx=0x7ff234009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1a8b5ce8fe992 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7ff22ffff700 1 -- 172.21.15.144:0/976322722 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234011830 con 0x7ff2380cbe30 2023-05-11T07:36:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7ff22ffff700 1 -- 172.21.15.144:0/976322722 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234011990 con 0x7ff2380cbe30 2023-05-11T07:36:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7ff22ffff700 1 -- 172.21.15.144:0/976322722 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234011d20 con 0x7ff2380cbe30 2023-05-11T07:36:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f36fc0549d0 con 0x7f3704164950 2023-05-11T07:36:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7fe8fe7fc700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 0x7fe8e006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.138+0000 7f370939b700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 0x7f36e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 -- 172.21.15.144:0/976322722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cbe30 msgr2=0x7ff2380c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/976322722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cbe30 0x7ff2380c92f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff234009840 tx=0x7ff234009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:13.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7f370939b700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 0x7f36e806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f3700010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7fe8fe7fc700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 0x7fe8e006d290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe9000af760 tx=0x7fe8e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 -- 172.21.15.144:0/976322722 shutdown_connections 2023-05-11T07:36:13.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/976322722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cbe30 0x7ff2380c92f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/976322722 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380b0e30 0x7ff238158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.139+0000 7ff23f9ff700 1 -- 172.21.15.144:0/976322722 >> 172.21.15.144:0/976322722 conn(0x7ff23806af60 msgr2=0x7ff2380cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.140+0000 7ff23f9ff700 1 -- 172.21.15.144:0/976322722 shutdown_connections 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.140+0000 7ff23f9ff700 1 -- 172.21.15.144:0/976322722 wait complete. 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.143+0000 7ff23f9ff700 1 Processor -- start 2023-05-11T07:36:13.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.141+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe8f00b72d0 con 0x7fe900071ef0 2023-05-11T07:36:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.143+0000 7ff23f9ff700 1 -- start start 2023-05-11T07:36:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.144+0000 7fd04efff700 1 Processor -- start 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.144+0000 7ff23f9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2380b0e30 0x7ff23814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.144+0000 7ff23f9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cacc0 0x7ff23815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23f9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23f9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380c78a0 con 0x7ff2380cacc0 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23f9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381f7190 con 0x7ff2380b0e30 2023-05-11T07:36:13.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23f9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380c7410 con 0x7ff2380cbe30 2023-05-11T07:36:13.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.144+0000 7fd04efff700 1 -- start start 2023-05-11T07:36:13.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23df9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23df9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52436/0 (socket says 172.21.15.144:52436) 2023-05-11T07:36:13.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23df9c700 1 -- 172.21.15.144:0/1265001065 learned_addr learned my addr 172.21.15.144:0/1265001065 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.145+0000 7ff23d79b700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2380b0e30 0x7ff23814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 -- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2380b0e30 msgr2=0x7ff23814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2380b0e30 0x7ff23814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 -- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cacc0 msgr2=0x7ff23815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cacc0 0x7ff23815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 -- 172.21.15.144:0/1265001065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340094a0 con 0x7ff2380cbe30 2023-05-11T07:36:13.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7fd04efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd04815c940 0x7fd048160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7fd04efff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0480b5fd0 0x7fd04806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7fd04efff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480d0e80 con 0x7fd0480b6420 2023-05-11T07:36:13.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7fd04efff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd048161420 con 0x7fd0480b5fd0 2023-05-11T07:36:13.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7fd04efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cdb00 con 0x7fd04815c940 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.146+0000 7ff23df9c700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b7e0 tx=0x7ff23000baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230010800 con 0x7ff2380cbe30 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff230010980 con 0x7ff2380cbe30 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230010d30 con 0x7ff2380cbe30 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23815cd70 con 0x7ff2380cbe30 2023-05-11T07:36:13.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23815ca90 con 0x7ff2380cbe30 2023-05-11T07:36:13.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0480b5fd0 0x7fd04806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0480b5fd0 0x7fd04806ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41884/0 (socket says 172.21.15.144:41884) 2023-05-11T07:36:13.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 -- 172.21.15.144:0/2869135878 learned_addr learned my addr 172.21.15.144:0/2869135878 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 -- 172.21.15.144:0/2869135878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd04815c940 msgr2=0x7fd048160ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-11T07:36:13.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 --2- 172.21.15.144:0/2869135878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd04815c940 0x7fd048160ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.147+0000 7fd047fff700 1 -- 172.21.15.144:0/2869135878 >> v1:172.21.15.145:6789/0 conn(0x7fd0480b6420 legacy=0x7fd0480d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.148+0000 7fd047fff700 1 -- 172.21.15.144:0/2869135878 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0480cdde0 con 0x7fd0480b5fd0 2023-05-11T07:36:13.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.148+0000 7fd047fff700 1 --2- 172.21.15.144:0/2869135878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0480b5fd0 0x7fd04806ac40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0340098f0 tx=0x7fd034009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcf8802509905a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.148+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2380cb140 con 0x7ff2380cbe30 2023-05-11T07:36:13.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.149+0000 7fd0477fe700 1 -- 172.21.15.144:0/2869135878 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004230 con 0x7fd0480b5fd0 2023-05-11T07:36:13.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.149+0000 7fd0477fe700 1 -- 172.21.15.144:0/2869135878 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034004390 con 0x7fd0480b5fd0 2023-05-11T07:36:13.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.149+0000 7fd0477fe700 1 -- 172.21.15.144:0/2869135878 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340036a0 con 0x7fd0480b5fd0 2023-05-11T07:36:13.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.150+0000 7fd04efff700 1 -- 172.21.15.144:0/2869135878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0480b5fd0 msgr2=0x7fd04806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.150+0000 7fd04efff700 1 --2- 172.21.15.144:0/2869135878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0480b5fd0 0x7fd04806ac40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0340098f0 tx=0x7fd034009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:13.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.151+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff230021350 con 0x7ff2380cbe30 2023-05-11T07:36:13.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 -- 172.21.15.144:0/2869135878 shutdown_connections 2023-05-11T07:36:13.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 --2- 172.21.15.144:0/2869135878 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd04815c940 0x7fd048160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 --2- 172.21.15.144:0/2869135878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0480b5fd0 0x7fd04806ac40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 -- 172.21.15.144:0/2869135878 >> 172.21.15.144:0/2869135878 conn(0x7fd0480d3180 msgr2=0x7fd0480d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 -- 172.21.15.144:0/2869135878 shutdown_connections 2023-05-11T07:36:13.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.152+0000 7fd04efff700 1 -- 172.21.15.144:0/2869135878 wait complete. 2023-05-11T07:36:13.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.153+0000 7ff22dffb700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 0x7ff21c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.153+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff230089900 con 0x7ff2380cbe30 2023-05-11T07:36:13.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.153+0000 7ff23d79b700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 0x7ff21c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.154+0000 7ff23d79b700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 0x7ff21c06d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2340090b0 tx=0x7ff23401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.155+0000 7fd04efff700 1 Processor -- start 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff2300546a0 con 0x7ff2380cbe30 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.155+0000 7fd04efff700 1 -- start start 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.156+0000 7fd04efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.156+0000 7fd04efff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0480b6420 0x7fd04806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04efff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04815c940 0x7fd0480ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04efff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd048145600 con 0x7fd04815c940 2023-05-11T07:36:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04efff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd048144ca0 con 0x7fd0480b6420 2023-05-11T07:36:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd048144f80 con 0x7fd0480b5fd0 2023-05-11T07:36:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04cd9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04cd9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52462/0 (socket says 172.21.15.144:52462) 2023-05-11T07:36:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.157+0000 7fd04cd9b700 1 -- 172.21.15.144:0/13548263 learned_addr learned my addr 172.21.15.144:0/13548263 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04d59c700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04815c940 0x7fd0480ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd047fff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0480b6420 0x7fd04806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04cd9b700 1 -- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0480b6420 msgr2=0x7fd04806aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04cd9b700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0480b6420 0x7fd04806aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04cd9b700 1 -- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04815c940 msgr2=0x7fd0480ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04cd9b700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04815c940 0x7fd0480ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.158+0000 7fd04cd9b700 1 -- 172.21.15.144:0/13548263 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009550 con 0x7fd0480b5fd0 2023-05-11T07:36:13.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.159+0000 7fd04cd9b700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00b470 tx=0x7fd03c00b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.159+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c011830 con 0x7fd0480b5fd0 2023-05-11T07:36:13.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c011990 con 0x7fd0480b5fd0 2023-05-11T07:36:13.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c011d40 con 0x7fd0480b5fd0 2023-05-11T07:36:13.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0480d1400 con 0x7fd0480b5fd0 2023-05-11T07:36:13.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0480d1120 con 0x7fd0480b5fd0 2023-05-11T07:36:13.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7f571c5ff700 1 Processor -- start 2023-05-11T07:36:13.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.160+0000 7f571c5ff700 1 -- start start 2023-05-11T07:36:13.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.161+0000 7f571c5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57140b88d0 0x7f57140cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.162+0000 7f571c5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5714162900 con 0x7f571406b3b0 2023-05-11T07:36:13.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.162+0000 7f571c5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57140b5530 con 0x7f57140cd6a0 2023-05-11T07:36:13.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.162+0000 7f571c5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57140cdd50 con 0x7f57140b88d0 2023-05-11T07:36:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.163+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0280052f0 con 0x7fd0480b5fd0 2023-05-11T07:36:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.163+0000 7f571a39b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57140b88d0 0x7f57140cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.163+0000 7f571a39b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57140b88d0 0x7f57140cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41890/0 (socket says 172.21.15.144:41890) 2023-05-11T07:36:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.163+0000 7f571a39b700 1 -- 172.21.15.144:0/3886926737 learned_addr learned my addr 172.21.15.144:0/3886926737 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.164+0000 7f5719399700 1 -- 172.21.15.144:0/3886926737 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99715348 0 0) 0x7f5714162900 con 0x7f571406b3b0 2023-05-11T07:36:13.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.164+0000 7f571a39b700 1 -- 172.21.15.144:0/3886926737 >> v1:172.21.15.145:6789/0 conn(0x7f57140cd6a0 legacy=0x7f571406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.164+0000 7f571a39b700 1 -- 172.21.15.144:0/3886926737 >> v1:172.21.15.144:6789/0 conn(0x7f571406b3b0 legacy=0x7f5714164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.164+0000 7f571a39b700 1 -- 172.21.15.144:0/3886926737 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140b59c0 con 0x7f57140b88d0 2023-05-11T07:36:13.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.164+0000 7f571a39b700 1 --2- 172.21.15.144:0/3886926737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140b88d0 0x7f57140cf120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f57040098f0 tx=0x7f5704009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851e135c5e9c00ae server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.165+0000 7f5719399700 1 -- 172.21.15.144:0/3886926737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400b8a0 con 0x7f57140b88d0 2023-05-11T07:36:13.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.165+0000 7f5719399700 1 -- 172.21.15.144:0/3886926737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400ba00 con 0x7f57140b88d0 2023-05-11T07:36:13.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.165+0000 7f5719399700 1 -- 172.21.15.144:0/3886926737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400bd70 con 0x7f57140b88d0 2023-05-11T07:36:13.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.165+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd03c01a400 con 0x7fd0480b5fd0 2023-05-11T07:36:13.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.166+0000 7f571c5ff700 1 -- 172.21.15.144:0/3886926737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140b88d0 msgr2=0x7f57140cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.166+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3886926737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140b88d0 0x7f57140cf120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f57040098f0 tx=0x7f5704009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:13.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.166+0000 7f571c5ff700 1 -- 172.21.15.144:0/3886926737 shutdown_connections 2023-05-11T07:36:13.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.166+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3886926737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140b88d0 0x7f57140cf120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.166+0000 7f571c5ff700 1 -- 172.21.15.144:0/3886926737 >> 172.21.15.144:0/3886926737 conn(0x7f5714072620 msgr2=0x7f57140cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.167+0000 7fd0457fa700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 0x7fd02c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.167+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd03c089770 con 0x7fd0480b5fd0 2023-05-11T07:36:13.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.168+0000 7f571c5ff700 1 -- 172.21.15.144:0/3886926737 shutdown_connections 2023-05-11T07:36:13.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.168+0000 7fd047fff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 0x7fd02c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.168+0000 7f571c5ff700 1 -- 172.21.15.144:0/3886926737 wait complete. 2023-05-11T07:36:13.173 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.170+0000 7fd047fff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 0x7fd02c06d260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd034009c40 tx=0x7fd034008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.171+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd03c054510 con 0x7fd0480b5fd0 2023-05-11T07:36:13.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.171+0000 7f571c5ff700 1 Processor -- start 2023-05-11T07:36:13.176 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.172+0000 7f571c5ff700 1 -- start start 2023-05-11T07:36:13.176 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 0x7f57141fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57140b88d0 0x7f57140b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 0x7f57140cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c99e0 con 0x7f57140cd6a0 2023-05-11T07:36:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141fad10 con 0x7f57140b88d0 2023-05-11T07:36:13.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.173+0000 7f571c5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140b6c00 con 0x7f571406b3b0 2023-05-11T07:36:13.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.174+0000 7f571ab9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 0x7f57140cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.174+0000 7f571ab9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 0x7f57140cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41904/0 (socket says 172.21.15.144:41904) 2023-05-11T07:36:13.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.174+0000 7f571ab9c700 1 -- 172.21.15.144:0/3037683486 learned_addr learned my addr 172.21.15.144:0/3037683486 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.174+0000 7f571a39b700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 0x7f57141fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 -- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57140b88d0 msgr2=0x7f57140b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57140b88d0 0x7f57140b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 -- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 msgr2=0x7f57140cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 0x7f57140cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 -- 172.21.15.144:0/3037683486 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009550 con 0x7f571406b3b0 2023-05-11T07:36:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.175+0000 7f571a39b700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 0x7f57141fa7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5704016000 tx=0x7f5704004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.176+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004590 con 0x7f571406b3b0 2023-05-11T07:36:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.176+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57040036a0 con 0x7f571406b3b0 2023-05-11T07:36:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.176+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140b4c00 con 0x7f571406b3b0 2023-05-11T07:36:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.176+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704003a30 con 0x7f571406b3b0 2023-05-11T07:36:13.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.176+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140cf800 con 0x7f571406b3b0 2023-05-11T07:36:13.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.179+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140b4ee0 con 0x7f571406b3b0 2023-05-11T07:36:13.186 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.183+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5704003b90 con 0x7f571406b3b0 2023-05-11T07:36:13.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.186+0000 7f07269ff700 1 Processor -- start 2023-05-11T07:36:13.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.186+0000 7f07269ff700 1 -- start start 2023-05-11T07:36:13.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.186+0000 7f570affd700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 0x7f56f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.186+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f570408a9b0 con 0x7f571406b3b0 2023-05-11T07:36:13.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.186+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f57040b62d0 con 0x7f571406b3b0 2023-05-11T07:36:13.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.187+0000 7f5719b9a700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 0x7f56f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.188+0000 7f5719b9a700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 0x7f56f806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f571415a0f0 tx=0x7f5710007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.191+0000 7f07269ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f072015d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.191+0000 7f07269ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f07200cacc0 0x7f0720158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.191+0000 7f07269ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07200cb4a0 con 0x7f072006dec0 2023-05-11T07:36:13.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.191+0000 7f07269ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072015d5d0 con 0x7f07200cacc0 2023-05-11T07:36:13.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.191+0000 7f07269ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0720159060 con 0x7f07200b0e30 2023-05-11T07:36:13.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.192+0000 7f071ffff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f072006dec0 0x7f07200b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40814/0 (socket says 172.21.15.144:40814) 2023-05-11T07:36:13.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.192+0000 7f071ffff700 1 -- 172.21.15.144:0/2459163858 learned_addr learned my addr 172.21.15.144:0/2459163858 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:13.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.192+0000 7f071f7fe700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f072015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.192+0000 7f0724f9c700 1 --2- 172.21.15.144:0/2459163858 >> v2:172.21.15.144:3300/0 conn(0x7f07200cacc0 0x7f0720158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.193+0000 7f0724f9c700 1 -- 172.21.15.144:0/2459163858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 msgr2=0x7f072015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.193+0000 7f0724f9c700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f072015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.193+0000 7f0724f9c700 1 -- 172.21.15.144:0/2459163858 >> v1:172.21.15.144:6789/0 conn(0x7f072006dec0 legacy=0x7f07200b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.193+0000 7f0724f9c700 1 -- 172.21.15.144:0/2459163858 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200cdce0 con 0x7f07200cacc0 2023-05-11T07:36:13.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.194+0000 7f0724f9c700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f0720158b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0718009d90 tx=0x7f071800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e69a327d93da19 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.195+0000 7f071effd700 1 -- 172.21.15.144:0/2459163858 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800e070 con 0x7f07200cacc0 2023-05-11T07:36:13.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.195+0000 7f071effd700 1 -- 172.21.15.144:0/2459163858 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718003a20 con 0x7f07200cacc0 2023-05-11T07:36:13.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.195+0000 7f071effd700 1 -- 172.21.15.144:0/2459163858 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718003dd0 con 0x7f07200cacc0 2023-05-11T07:36:13.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 -- 172.21.15.144:0/2459163858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 msgr2=0x7f0720158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f0720158b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0718009d90 tx=0x7f071800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 -- 172.21.15.144:0/2459163858 shutdown_connections 2023-05-11T07:36:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f0720158b20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 --2- 172.21.15.144:0/2459163858 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f072015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.196+0000 7f07269ff700 1 -- 172.21.15.144:0/2459163858 >> 172.21.15.144:0/2459163858 conn(0x7f07200cb720 msgr2=0x7f07200cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.197+0000 7f07269ff700 1 -- 172.21.15.144:0/2459163858 shutdown_connections 2023-05-11T07:36:13.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.197+0000 7f07269ff700 1 -- 172.21.15.144:0/2459163858 wait complete. 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.199+0000 7f07269ff700 1 Processor -- start 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.200+0000 7f07269ff700 1 -- start start 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072006dec0 0x7f07200c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f07200ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720169a20 con 0x7f07200cacc0 2023-05-11T07:36:13.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07201f8d30 con 0x7f072006dec0 2023-05-11T07:36:13.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.201+0000 7f07269ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07201f8750 con 0x7f07200b0e30 2023-05-11T07:36:13.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.202+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.202+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52482/0 (socket says 172.21.15.144:52482) 2023-05-11T07:36:13.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.202+0000 7f071f7fe700 1 -- 172.21.15.144:0/799315501 learned_addr learned my addr 172.21.15.144:0/799315501 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.202+0000 7f0724f9c700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f07200ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.202+0000 7f071ffff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072006dec0 0x7f07200c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.203+0000 7f071f7fe700 1 -- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072006dec0 msgr2=0x7f07200c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.203+0000 7f071f7fe700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072006dec0 0x7f07200c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.203+0000 7f071f7fe700 1 -- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 msgr2=0x7f07200ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.203+0000 7f071f7fe700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f07200ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.203+0000 7f071f7fe700 1 -- 172.21.15.144:0/799315501 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0718009a70 con 0x7f07200b0e30 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f071f7fe700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f071000e900 tx=0x7f071000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000ee50 con 0x7f07200b0e30 2023-05-11T07:36:13.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000c850 con 0x7f07200b0e30 2023-05-11T07:36:13.209 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000cc00 con 0x7f07200b0e30 2023-05-11T07:36:13.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07200ce2a0 con 0x7f07200b0e30 2023-05-11T07:36:13.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.204+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07200cdfc0 con 0x7f07200b0e30 2023-05-11T07:36:13.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.206+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07200c9510 con 0x7f07200b0e30 2023-05-11T07:36:13.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.208+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0710013470 con 0x7f07200b0e30 2023-05-11T07:36:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.210+0000 7f071cff9700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 0x7f070c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.210+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07100897e0 con 0x7f07200b0e30 2023-05-11T07:36:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.211+0000 7f071ffff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 0x7f070c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.212+0000 7f071ffff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 0x7f070c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07200b4bf0 tx=0x7f0714007d70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.215+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0710057f90 con 0x7f07200b0e30 2023-05-11T07:36:13.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.400+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57140744c0 con 0x7f571406b3b0 2023-05-11T07:36:13.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.401+0000 7f570affd700 1 -- 172.21.15.144:0/3037683486 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57040559b0 con 0x7f571406b3b0 2023-05-11T07:36:13.405 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:13.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 msgr2=0x7f56f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 0x7f56f806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f571415a0f0 tx=0x7f5710007a20 comp rx=0 tx=0).stop 2023-05-11T07:36:13.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 msgr2=0x7f57141fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 0x7f57141fa7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5704016000 tx=0x7f5704004750 comp rx=0 tx=0).stop 2023-05-11T07:36:13.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 shutdown_connections 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f56f806ace0 0x7f56f806d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f571406b3b0 0x7f57141fa7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57140cd6a0 0x7f57140cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 --2- 172.21.15.144:0/3037683486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57140b88d0 0x7f57140b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.404+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 >> 172.21.15.144:0/3037683486 conn(0x7f5714072620 msgr2=0x7f571406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.405+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 shutdown_connections 2023-05-11T07:36:13.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.405+0000 7f571c5ff700 1 -- 172.21.15.144:0/3037683486 wait complete. 2023-05-11T07:36:13.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.3 2023-05-11T07:36:13.427 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.505+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd840055a0 con 0x7efda406a6a0 2023-05-11T07:36:13.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.506+0000 7efd8b7fe700 1 -- 172.21.15.144:0/3925352475 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd98017030 con 0x7efda406a6a0 2023-05-11T07:36:13.512 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:13.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.509+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 msgr2=0x7efd9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.509+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 0x7efd9006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c011000 comp rx=0 tx=0).stop 2023-05-11T07:36:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.509+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 msgr2=0x7efda40c3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.509+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c780 tx=0x7efd9800ca90 comp rx=0 tx=0).stop 2023-05-11T07:36:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 shutdown_connections 2023-05-11T07:36:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efd9006ace0 0x7efd9006d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda406e680 0x7efda40bf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda406a2d0 0x7efda415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 --2- 172.21.15.144:0/3925352475 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efda406a6a0 0x7efda40c3850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 >> 172.21.15.144:0/3925352475 conn(0x7efda40cc830 msgr2=0x7efda40ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 shutdown_connections 2023-05-11T07:36:13.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.510+0000 7efda97ff700 1 -- 172.21.15.144:0/3925352475 wait complete. 2023-05-11T07:36:13.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-05-11T07:36:13.541 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.569+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f37040744c0 con 0x7f3704164950 2023-05-11T07:36:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.569+0000 7f36f9ffb700 1 -- 172.21.15.144:0/4135607423 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36fc057ff0 con 0x7f3704164950 2023-05-11T07:36:13.573 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2023-05-11T07:36:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 msgr2=0x7f36e806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 0x7f36e806d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3700009fd0 tx=0x7f3700010000 comp rx=0 tx=0).stop 2023-05-11T07:36:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 msgr2=0x7f37040c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c7f0 tx=0x7f36fc00cb00 comp rx=0 tx=0).stop 2023-05-11T07:36:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 shutdown_connections 2023-05-11T07:36:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f36e806adb0 0x7f36e806d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3704164950 0x7f37040c6c60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f37040b6340 0x7f37040c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 --2- 172.21.15.144:0/4135607423 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3704160d60 0x7f370415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 >> 172.21.15.144:0/4135607423 conn(0x7f37040d3180 msgr2=0x7f370415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 shutdown_connections 2023-05-11T07:36:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.572+0000 7f370b5ff700 1 -- 172.21.15.144:0/4135607423 wait complete. 2023-05-11T07:36:13.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.584+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9000cb250 con 0x7fe900071ef0 2023-05-11T07:36:13.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.585+0000 7fe8f7fff700 1 -- 172.21.15.144:0/1317143513 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8f0055d90 con 0x7fe900071ef0 2023-05-11T07:36:13.589 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 msgr2=0x7fe8e006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 0x7fe8e006d290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe9000af760 tx=0x7fe8e8009040 comp rx=0 tx=0).stop 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 msgr2=0x7fe9000c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00090b0 tx=0x7fe8f0004750 comp rx=0 tx=0).stop 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 shutdown_connections 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe8e006ade0 0x7fe8e006d290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe900160e10 0x7fe9000b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe900071ef0 0x7fe9000c8220 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00090b0 tx=0x7fe8f0004750 comp rx=0 tx=0).stop 2023-05-11T07:36:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 --2- 172.21.15.144:0/1317143513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9000cc870 0x7fe9000b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 >> 172.21.15.144:0/1317143513 conn(0x7fe9000cb720 msgr2=0x7fe9000cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 shutdown_connections 2023-05-11T07:36:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f07201f8ae0 con 0x7f07200b0e30 2023-05-11T07:36:13.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.589+0000 7fe9059ff700 1 -- 172.21.15.144:0/1317143513 wait complete. 2023-05-11T07:36:13.595 INFO:teuthology.orchestra.run.smithi144.stdout:55834574861 2023-05-11T07:36:13.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.590+0000 7f071cff9700 1 -- 172.21.15.144:0/799315501 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0710057b20 con 0x7f07200b0e30 2023-05-11T07:36:13.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.593+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 msgr2=0x7f070c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.593+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 0x7f070c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07200b4bf0 tx=0x7f0714007d70 comp rx=0 tx=0).stop 2023-05-11T07:36:13.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.593+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 msgr2=0x7f07200c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.593+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f071000e900 tx=0x7f071000ec10 comp rx=0 tx=0).stop 2023-05-11T07:36:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 shutdown_connections 2023-05-11T07:36:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f070c06ace0 0x7f070c06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07200cacc0 0x7f07200ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f072006dec0 0x7f07200c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 --2- 172.21.15.144:0/799315501 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f07200b0e30 0x7f07200c49f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 >> 172.21.15.144:0/799315501 conn(0x7f07200cb720 msgr2=0x7f07200ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 shutdown_connections 2023-05-11T07:36:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.594+0000 7f07269ff700 1 -- 172.21.15.144:0/799315501 wait complete. 2023-05-11T07:36:13.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-05-11T07:36:13.602 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.604+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff2380c75a0 con 0x7ff2380cbe30 2023-05-11T07:36:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.604+0000 7ff22dffb700 1 -- 172.21.15.144:0/1265001065 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff230057cc0 con 0x7ff2380cbe30 2023-05-11T07:36:13.608 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:13.609 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.605+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd0280055a0 con 0x7fd0480b5fd0 2023-05-11T07:36:13.609 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.606+0000 7fd0457fa700 1 -- 172.21.15.144:0/13548263 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd03c057b30 con 0x7fd0480b5fd0 2023-05-11T07:36:13.610 INFO:teuthology.orchestra.run.smithi144.stdout:55834574860 2023-05-11T07:36:13.612 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.608+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 msgr2=0x7ff21c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.612 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.608+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 0x7ff21c06d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff2340090b0 tx=0x7ff23401c040 comp rx=0 tx=0).stop 2023-05-11T07:36:13.612 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.608+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 msgr2=0x7ff23815b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.608+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b7e0 tx=0x7ff23000baf0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 shutdown_connections 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff21c06adb0 0x7ff21c06d260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff2380cbe30 0x7ff23815b8f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2380b0e30 0x7ff23814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 --2- 172.21.15.144:0/1265001065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2380cacc0 0x7ff23815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.613 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 >> 172.21.15.144:0/1265001065 conn(0x7ff23806af60 msgr2=0x7ff2380ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.2 2023-05-11T07:36:13.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 msgr2=0x7fd02c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 0x7fd02c06d260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd034009c40 tx=0x7fd034008030 comp rx=0 tx=0).stop 2023-05-11T07:36:13.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 msgr2=0x7fd048144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00b470 tx=0x7fd03c00b830 comp rx=0 tx=0).stop 2023-05-11T07:36:13.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 shutdown_connections 2023-05-11T07:36:13.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7ff23f9ff700 1 -- 172.21.15.144:0/1265001065 wait complete. 2023-05-11T07:36:13.616 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 shutdown_connections 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd02c06adb0 0x7fd02c06d260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0480b5fd0 0x7fd048144760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04815c940 0x7fd0480ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 --2- 172.21.15.144:0/13548263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0480b6420 0x7fd04806aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 >> 172.21.15.144:0/13548263 conn(0x7fd0480d3180 msgr2=0x7fd04814eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 shutdown_connections 2023-05-11T07:36:13.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.609+0000 7fd04efff700 1 -- 172.21.15.144:0/13548263 wait complete. 2023-05-11T07:36:13.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.6 2023-05-11T07:36:13.622 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2023-05-11T07:36:13.633 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-05-11T07:36:13.634 DEBUG:teuthology.parallel:result is None 2023-05-11T07:36:13.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-11T07:36:13.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:36:13.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.855+0000 7f42977ff700 1 Processor -- start 2023-05-11T07:36:13.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.855+0000 7f42977ff700 1 -- start start 2023-05-11T07:36:13.860 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f42977ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f429006a2d0 0x7f429008aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f42977ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f42900cc930 0x7f429006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f42977ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42900cead0 con 0x7f429016d1a0 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f42977ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429016e140 con 0x7f429006a2d0 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f42977ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429008a8d0 con 0x7f42900cc930 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f429559b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f429006a2d0 0x7f429008aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f429559b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f429006a2d0 0x7f429008aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41948/0 (socket says 172.21.15.144:41948) 2023-05-11T07:36:13.861 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f429559b700 1 -- 172.21.15.144:0/768862984 learned_addr learned my addr 172.21.15.144:0/768862984 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f4295d9c700 1 --2- 172.21.15.144:0/768862984 >> v2:172.21.15.145:3300/0 conn(0x7f42900cc930 0x7f429006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.856+0000 7f4294d9a700 1 --1- 172.21.15.144:0/768862984 >> v1:172.21.15.144:6789/0 conn(0x7f429016d1a0 0x7f429006a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40826/0 (socket says 172.21.15.144:40826) 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f429559b700 1 -- 172.21.15.144:0/768862984 >> v2:172.21.15.145:3300/0 conn(0x7f42900cc930 msgr2=0x7f429006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f429559b700 1 --2- 172.21.15.144:0/768862984 >> v2:172.21.15.145:3300/0 conn(0x7f42900cc930 0x7f429006be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f429559b700 1 -- 172.21.15.144:0/768862984 >> v1:172.21.15.144:6789/0 conn(0x7f429016d1a0 legacy=0x7f429006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.862 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f429559b700 1 -- 172.21.15.144:0/768862984 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429006b9d0 con 0x7f429006a2d0 2023-05-11T07:36:13.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f429559b700 1 --2- 172.21.15.144:0/768862984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429006a2d0 0x7f429008aa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f429006f6f0 tx=0x7f428c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8561ad0a09ca7740 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.863 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f4287fff700 1 -- 172.21.15.144:0/768862984 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c010070 con 0x7f429006a2d0 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f4287fff700 1 -- 172.21.15.144:0/768862984 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00be90 con 0x7f429006a2d0 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.857+0000 7f4287fff700 1 -- 172.21.15.144:0/768862984 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c008b10 con 0x7f429006a2d0 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 -- 172.21.15.144:0/768862984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429006a2d0 msgr2=0x7f429008aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 --2- 172.21.15.144:0/768862984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429006a2d0 0x7f429008aa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f429006f6f0 tx=0x7f428c00d330 comp rx=0 tx=0).stop 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 -- 172.21.15.144:0/768862984 shutdown_connections 2023-05-11T07:36:13.864 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 --2- 172.21.15.144:0/768862984 >> v2:172.21.15.145:3300/0 conn(0x7f42900cc930 0x7f429006be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 --2- 172.21.15.144:0/768862984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429006a2d0 0x7f429008aa70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 -- 172.21.15.144:0/768862984 >> 172.21.15.144:0/768862984 conn(0x7f42900cb7e0 msgr2=0x7f42900cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:13.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 -- 172.21.15.144:0/768862984 shutdown_connections 2023-05-11T07:36:13.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.858+0000 7f42977ff700 1 -- 172.21.15.144:0/768862984 wait complete. 2023-05-11T07:36:13.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.860+0000 7f42977ff700 1 Processor -- start 2023-05-11T07:36:13.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.860+0000 7f42977ff700 1 -- start start 2023-05-11T07:36:13.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f429006a2d0 0x7f4290088ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42900cc930 0x7f42900c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900c5670 con 0x7f429016d1a0 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900b1c30 con 0x7f42900cc930 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f42977ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900b1f10 con 0x7f429006a2d0 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f429559b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f429006a2d0 0x7f4290088ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4294d9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42900cc930 0x7f42900c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41950/0 (socket says 172.21.15.144:41950) 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 -- 172.21.15.144:0/939515804 learned_addr learned my addr 172.21.15.144:0/939515804 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 -- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f429006a2d0 msgr2=0x7f4290088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f429006a2d0 0x7f4290088ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 -- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42900cc930 msgr2=0x7f42900c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42900cc930 0x7f42900c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.862+0000 7f4295d9c700 1 -- 172.21.15.144:0/939515804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0086d0 con 0x7f429016d1a0 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f4295d9c700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f428800efc0 tx=0x7f428800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288009ea0 con 0x7f429016d1a0 2023-05-11T07:36:13.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800f040 con 0x7f429016d1a0 2023-05-11T07:36:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429016d8a0 con 0x7f429016d1a0 2023-05-11T07:36:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800ced0 con 0x7f429016d1a0 2023-05-11T07:36:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.863+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429016d610 con 0x7f429016d1a0 2023-05-11T07:36:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.864+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429016db80 con 0x7f429016d1a0 2023-05-11T07:36:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.865+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4288014480 con 0x7f429016d1a0 2023-05-11T07:36:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.866+0000 7f4285ffb700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 0x7f427406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.866+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4288089ff0 con 0x7f429016d1a0 2023-05-11T07:36:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.866+0000 7f429559b700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 0x7f427406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.867+0000 7f429559b700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 0x7f427406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:13.870+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f42880bc2d0 con 0x7f429016d1a0 2023-05-11T07:36:14.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.061+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42900ce790 con 0x7f427406ace0 2023-05-11T07:36:14.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.072+0000 7f4285ffb700 1 -- 172.21.15.144:0/939515804 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367263 (secure 0 0 0) 0x7f42900ce790 con 0x7f427406ace0 2023-05-11T07:36:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:14.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 msgr2=0x7f427406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 0x7f427406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c012000 comp rx=0 tx=0).stop 2023-05-11T07:36:14.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 msgr2=0x7f42901692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f428800efc0 tx=0x7f428800c3a0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 shutdown_connections 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f427406ace0 0x7f427406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f429006a2d0 0x7f4290088ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f429016d1a0 0x7f42901692f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 --2- 172.21.15.144:0/939515804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42900cc930 0x7f42900c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 >> 172.21.15.144:0/939515804 conn(0x7f42900cb7e0 msgr2=0x7f42900cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:14.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 shutdown_connections 2023-05-11T07:36:14.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.076+0000 7f42977ff700 1 -- 172.21.15.144:0/939515804 wait complete. 2023-05-11T07:36:14.083 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:36:14.097 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-05-11T07:36:13.721198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2146888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003667"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089760+0000","last_change":"2023-05-11T07:35:40.003263+0000","last_active":"2023-05-11T07:35:45.089760+0000","last_peered":"2023-05-11T07:35:45.089760+0000","last_clean":"2023-05-11T07:35:45.089760+0000","last_became_active":"2023-05-11T07:35:40.002990+0000","last_became_peered":"2023-05-11T07:35:40.002990+0000","last_unstale":"2023-05-11T07:35:45.089760+0000","last_undegraded":"2023-05-11T07:35:45.089760+0000","last_fullsized":"2023-05-11T07:35:45.089760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:47:49.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015531+0000","last_change":"2023-05-11T07:35:40.026566+0000","last_active":"2023-05-11T07:35:45.015531+0000","last_peered":"2023-05-11T07:35:45.015531+0000","last_clean":"2023-05-11T07:35:45.015531+0000","last_became_active":"2023-05-11T07:35:40.026251+0000","last_became_peered":"2023-05-11T07:35:40.026251+0000","last_unstale":"2023-05-11T07:35:45.015531+0000","last_undegraded":"2023-05-11T07:35:45.015531+0000","last_fullsized":"2023-05-11T07:35:45.015531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:55:14.716226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562178+0000","last_change":"2023-05-11T07:35:40.017456+0000","last_active":"2023-05-11T07:35:47.562178+0000","last_peered":"2023-05-11T07:35:47.562178+0000","last_clean":"2023-05-11T07:35:47.562178+0000","last_became_active":"2023-05-11T07:35:40.017116+0000","last_became_peered":"2023-05-11T07:35:40.017116+0000","last_unstale":"2023-05-11T07:35:47.562178+0000","last_undegraded":"2023-05-11T07:35:47.562178+0000","last_fullsized":"2023-05-11T07:35:47.562178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:56.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891706+0000","last_change":"2023-05-11T07:35:40.015700+0000","last_active":"2023-05-11T07:35:46.891706+0000","last_peered":"2023-05-11T07:35:46.891706+0000","last_clean":"2023-05-11T07:35:46.891706+0000","last_became_active":"2023-05-11T07:35:40.015379+0000","last_became_peered":"2023-05-11T07:35:40.015379+0000","last_unstale":"2023-05-11T07:35:46.891706+0000","last_undegraded":"2023-05-11T07:35:46.891706+0000","last_fullsized":"2023-05-11T07:35:46.891706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:18:19.207636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517497+0000","last_change":"2023-05-11T07:35:40.017874+0000","last_active":"2023-05-11T07:35:44.517497+0000","last_peered":"2023-05-11T07:35:44.517497+0000","last_clean":"2023-05-11T07:35:44.517497+0000","last_became_active":"2023-05-11T07:35:40.017633+0000","last_became_peered":"2023-05-11T07:35:40.017633+0000","last_unstale":"2023-05-11T07:35:44.517497+0000","last_undegraded":"2023-05-11T07:35:44.517497+0000","last_fullsized":"2023-05-11T07:35:44.517497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561892+0000","last_change":"2023-05-11T07:35:40.019837+0000","last_active":"2023-05-11T07:35:47.561892+0000","last_peered":"2023-05-11T07:35:47.561892+0000","last_clean":"2023-05-11T07:35:47.561892+0000","last_became_active":"2023-05-11T07:35:40.019582+0000","last_became_peered":"2023-05-11T07:35:40.019582+0000","last_unstale":"2023-05-11T07:35:47.561892+0000","last_undegraded":"2023-05-11T07:35:47.561892+0000","last_fullsized":"2023-05-11T07:35:47.561892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:04:10.251391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518855+0000","last_change":"2023-05-11T07:35:40.019621+0000","last_active":"2023-05-11T07:35:44.518855+0000","last_peered":"2023-05-11T07:35:44.518855+0000","last_clean":"2023-05-11T07:35:44.518855+0000","last_became_active":"2023-05-11T07:35:40.019325+0000","last_became_peered":"2023-05-11T07:35:40.019325+0000","last_unstale":"2023-05-11T07:35:44.518855+0000","last_undegraded":"2023-05-11T07:35:44.518855+0000","last_fullsized":"2023-05-11T07:35:44.518855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:11.547662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014908+0000","last_change":"2023-05-11T07:35:40.026209+0000","last_active":"2023-05-11T07:35:45.014908+0000","last_peered":"2023-05-11T07:35:45.014908+0000","last_clean":"2023-05-11T07:35:45.014908+0000","last_became_active":"2023-05-11T07:35:40.025835+0000","last_became_peered":"2023-05-11T07:35:40.025835+0000","last_unstale":"2023-05-11T07:35:45.014908+0000","last_undegraded":"2023-05-11T07:35:45.014908+0000","last_fullsized":"2023-05-11T07:35:45.014908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:35.384590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516451+0000","last_change":"2023-05-11T07:35:40.027053+0000","last_active":"2023-05-11T07:35:44.516451+0000","last_peered":"2023-05-11T07:35:44.516451+0000","last_clean":"2023-05-11T07:35:44.516451+0000","last_became_active":"2023-05-11T07:35:40.026802+0000","last_became_peered":"2023-05-11T07:35:40.026802+0000","last_unstale":"2023-05-11T07:35:44.516451+0000","last_undegraded":"2023-05-11T07:35:44.516451+0000","last_fullsized":"2023-05-11T07:35:44.516451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015789+0000","last_change":"2023-05-11T07:35:40.028043+0000","last_active":"2023-05-11T07:35:45.015789+0000","last_peered":"2023-05-11T07:35:45.015789+0000","last_clean":"2023-05-11T07:35:45.015789+0000","last_became_active":"2023-05-11T07:35:40.027745+0000","last_became_peered":"2023-05-11T07:35:40.027745+0000","last_unstale":"2023-05-11T07:35:45.015789+0000","last_undegraded":"2023-05-11T07:35:45.015789+0000","last_fullsized":"2023-05-11T07:35:45.015789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:43.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562271+0000","last_change":"2023-05-11T07:35:40.021833+0000","last_active":"2023-05-11T07:35:47.562271+0000","last_peered":"2023-05-11T07:35:47.562271+0000","last_clean":"2023-05-11T07:35:47.562271+0000","last_became_active":"2023-05-11T07:35:40.021555+0000","last_became_peered":"2023-05-11T07:35:40.021555+0000","last_unstale":"2023-05-11T07:35:47.562271+0000","last_undegraded":"2023-05-11T07:35:47.562271+0000","last_fullsized":"2023-05-11T07:35:47.562271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:28.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089711+0000","last_change":"2023-05-11T07:35:40.008540+0000","last_active":"2023-05-11T07:35:45.089711+0000","last_peered":"2023-05-11T07:35:45.089711+0000","last_clean":"2023-05-11T07:35:45.089711+0000","last_became_active":"2023-05-11T07:35:40.008085+0000","last_became_peered":"2023-05-11T07:35:40.008085+0000","last_unstale":"2023-05-11T07:35:45.089711+0000","last_undegraded":"2023-05-11T07:35:45.089711+0000","last_fullsized":"2023-05-11T07:35:45.089711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:02:06.990407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089645+0000","last_change":"2023-05-11T07:35:40.003691+0000","last_active":"2023-05-11T07:35:45.089645+0000","last_peered":"2023-05-11T07:35:45.089645+0000","last_clean":"2023-05-11T07:35:45.089645+0000","last_became_active":"2023-05-11T07:35:40.003340+0000","last_became_peered":"2023-05-11T07:35:40.003340+0000","last_unstale":"2023-05-11T07:35:45.089645+0000","last_undegraded":"2023-05-11T07:35:45.089645+0000","last_fullsized":"2023-05-11T07:35:45.089645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:40.739929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014917+0000","last_change":"2023-05-11T07:35:40.023425+0000","last_active":"2023-05-11T07:35:45.014917+0000","last_peered":"2023-05-11T07:35:45.014917+0000","last_clean":"2023-05-11T07:35:45.014917+0000","last_became_active":"2023-05-11T07:35:40.023149+0000","last_became_peered":"2023-05-11T07:35:40.023149+0000","last_unstale":"2023-05-11T07:35:45.014917+0000","last_undegraded":"2023-05-11T07:35:45.014917+0000","last_fullsized":"2023-05-11T07:35:45.014917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:57.291650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517873+0000","last_change":"2023-05-11T07:35:40.019674+0000","last_active":"2023-05-11T07:35:44.517873+0000","last_peered":"2023-05-11T07:35:44.517873+0000","last_clean":"2023-05-11T07:35:44.517873+0000","last_became_active":"2023-05-11T07:35:40.019341+0000","last_became_peered":"2023-05-11T07:35:40.019341+0000","last_unstale":"2023-05-11T07:35:44.517873+0000","last_undegraded":"2023-05-11T07:35:44.517873+0000","last_fullsized":"2023-05-11T07:35:44.517873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561553+0000","last_change":"2023-05-11T07:35:40.017375+0000","last_active":"2023-05-11T07:35:47.561553+0000","last_peered":"2023-05-11T07:35:47.561553+0000","last_clean":"2023-05-11T07:35:47.561553+0000","last_became_active":"2023-05-11T07:35:40.017066+0000","last_became_peered":"2023-05-11T07:35:40.017066+0000","last_unstale":"2023-05-11T07:35:47.561553+0000","last_undegraded":"2023-05-11T07:35:47.561553+0000","last_fullsized":"2023-05-11T07:35:47.561553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:30:12.395814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516538+0000","last_change":"2023-05-11T07:35:40.028493+0000","last_active":"2023-05-11T07:35:44.516538+0000","last_peered":"2023-05-11T07:35:44.516538+0000","last_clean":"2023-05-11T07:35:44.516538+0000","last_became_active":"2023-05-11T07:35:40.028204+0000","last_became_peered":"2023-05-11T07:35:40.028204+0000","last_unstale":"2023-05-11T07:35:44.516538+0000","last_undegraded":"2023-05-11T07:35:44.516538+0000","last_fullsized":"2023-05-11T07:35:44.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:26.521370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562117+0000","last_change":"2023-05-11T07:35:40.014959+0000","last_active":"2023-05-11T07:35:47.562117+0000","last_peered":"2023-05-11T07:35:47.562117+0000","last_clean":"2023-05-11T07:35:47.562117+0000","last_became_active":"2023-05-11T07:35:40.014689+0000","last_became_peered":"2023-05-11T07:35:40.014689+0000","last_unstale":"2023-05-11T07:35:47.562117+0000","last_undegraded":"2023-05-11T07:35:47.562117+0000","last_fullsized":"2023-05-11T07:35:47.562117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:42.131185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089549+0000","last_change":"2023-05-11T07:35:40.001699+0000","last_active":"2023-05-11T07:35:45.089549+0000","last_peered":"2023-05-11T07:35:45.089549+0000","last_clean":"2023-05-11T07:35:45.089549+0000","last_became_active":"2023-05-11T07:35:40.001449+0000","last_became_peered":"2023-05-11T07:35:40.001449+0000","last_unstale":"2023-05-11T07:35:45.089549+0000","last_undegraded":"2023-05-11T07:35:45.089549+0000","last_fullsized":"2023-05-11T07:35:45.089549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:39:10.961995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561455+0000","last_change":"2023-05-11T07:35:40.023713+0000","last_active":"2023-05-11T07:35:47.561455+0000","last_peered":"2023-05-11T07:35:47.561455+0000","last_clean":"2023-05-11T07:35:47.561455+0000","last_became_active":"2023-05-11T07:35:40.023403+0000","last_became_peered":"2023-05-11T07:35:40.023403+0000","last_unstale":"2023-05-11T07:35:47.561455+0000","last_undegraded":"2023-05-11T07:35:47.561455+0000","last_fullsized":"2023-05-11T07:35:47.561455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:51:38.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518306+0000","last_change":"2023-05-11T07:35:40.019898+0000","last_active":"2023-05-11T07:35:44.518306+0000","last_peered":"2023-05-11T07:35:44.518306+0000","last_clean":"2023-05-11T07:35:44.518306+0000","last_became_active":"2023-05-11T07:35:40.019650+0000","last_became_peered":"2023-05-11T07:35:40.019650+0000","last_unstale":"2023-05-11T07:35:44.518306+0000","last_undegraded":"2023-05-11T07:35:44.518306+0000","last_fullsized":"2023-05-11T07:35:44.518306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516495+0000","last_change":"2023-05-11T07:35:40.018256+0000","last_active":"2023-05-11T07:35:44.516495+0000","last_peered":"2023-05-11T07:35:44.516495+0000","last_clean":"2023-05-11T07:35:44.516495+0000","last_became_active":"2023-05-11T07:35:40.017973+0000","last_became_peered":"2023-05-11T07:35:40.017973+0000","last_unstale":"2023-05-11T07:35:44.516495+0000","last_undegraded":"2023-05-11T07:35:44.516495+0000","last_fullsized":"2023-05-11T07:35:44.516495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:53.607196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.015426+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.015144+0000","last_became_peered":"2023-05-11T07:35:40.015144+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518102+0000","last_change":"2023-05-11T07:35:40.029940+0000","last_active":"2023-05-11T07:35:44.518102+0000","last_peered":"2023-05-11T07:35:44.518102+0000","last_clean":"2023-05-11T07:35:44.518102+0000","last_became_active":"2023-05-11T07:35:40.029761+0000","last_became_peered":"2023-05-11T07:35:40.029761+0000","last_unstale":"2023-05-11T07:35:44.518102+0000","last_undegraded":"2023-05-11T07:35:44.518102+0000","last_fullsized":"2023-05-11T07:35:44.518102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004787+0000","last_change":"2023-05-11T07:35:40.016915+0000","last_active":"2023-05-11T07:35:45.004787+0000","last_peered":"2023-05-11T07:35:45.004787+0000","last_clean":"2023-05-11T07:35:45.004787+0000","last_became_active":"2023-05-11T07:35:40.016633+0000","last_became_peered":"2023-05-11T07:35:40.016633+0000","last_unstale":"2023-05-11T07:35:45.004787+0000","last_undegraded":"2023-05-11T07:35:45.004787+0000","last_fullsized":"2023-05-11T07:35:45.004787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:02.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004835+0000","last_change":"2023-05-11T07:35:40.014665+0000","last_active":"2023-05-11T07:35:45.004835+0000","last_peered":"2023-05-11T07:35:45.004835+0000","last_clean":"2023-05-11T07:35:45.004835+0000","last_became_active":"2023-05-11T07:35:40.013282+0000","last_became_peered":"2023-05-11T07:35:40.013282+0000","last_unstale":"2023-05-11T07:35:45.004835+0000","last_undegraded":"2023-05-11T07:35:45.004835+0000","last_fullsized":"2023-05-11T07:35:45.004835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015640+0000","last_change":"2023-05-11T07:35:40.028278+0000","last_active":"2023-05-11T07:35:45.015640+0000","last_peered":"2023-05-11T07:35:45.015640+0000","last_clean":"2023-05-11T07:35:45.015640+0000","last_became_active":"2023-05-11T07:35:40.027965+0000","last_became_peered":"2023-05-11T07:35:40.027965+0000","last_unstale":"2023-05-11T07:35:45.015640+0000","last_undegraded":"2023-05-11T07:35:45.015640+0000","last_fullsized":"2023-05-11T07:35:45.015640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:25.486990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561879+0000","last_change":"2023-05-11T07:35:44.058122+0000","last_active":"2023-05-11T07:35:47.561879+0000","last_peered":"2023-05-11T07:35:47.561879+0000","last_clean":"2023-05-11T07:35:47.561879+0000","last_became_active":"2023-05-11T07:35:44.057702+0000","last_became_peered":"2023-05-11T07:35:44.057702+0000","last_unstale":"2023-05-11T07:35:47.561879+0000","last_undegraded":"2023-05-11T07:35:47.561879+0000","last_fullsized":"2023-05-11T07:35:47.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:36:05.616117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560688+0000","last_change":"2023-05-11T07:35:39.525251+0000","last_active":"2023-05-11T07:35:47.560688+0000","last_peered":"2023-05-11T07:35:47.560688+0000","last_clean":"2023-05-11T07:35:47.560688+0000","last_became_active":"2023-05-11T07:35:39.523877+0000","last_became_peered":"2023-05-11T07:35:39.523877+0000","last_unstale":"2023-05-11T07:35:47.560688+0000","last_undegraded":"2023-05-11T07:35:47.560688+0000","last_fullsized":"2023-05-11T07:35:47.560688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:53.446198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561824+0000","last_change":"2023-05-11T07:35:40.004593+0000","last_active":"2023-05-11T07:35:47.561824+0000","last_peered":"2023-05-11T07:35:47.561824+0000","last_clean":"2023-05-11T07:35:47.561824+0000","last_became_active":"2023-05-11T07:35:40.004302+0000","last_became_peered":"2023-05-11T07:35:40.004302+0000","last_unstale":"2023-05-11T07:35:47.561824+0000","last_undegraded":"2023-05-11T07:35:47.561824+0000","last_fullsized":"2023-05-11T07:35:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:02.707221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891981+0000","last_change":"2023-05-11T07:35:44.049215+0000","last_active":"2023-05-11T07:35:46.891981+0000","last_peered":"2023-05-11T07:35:46.891981+0000","last_clean":"2023-05-11T07:35:46.891981+0000","last_became_active":"2023-05-11T07:35:44.048856+0000","last_became_peered":"2023-05-11T07:35:44.048856+0000","last_unstale":"2023-05-11T07:35:46.891981+0000","last_undegraded":"2023-05-11T07:35:46.891981+0000","last_fullsized":"2023-05-11T07:35:46.891981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:59:50.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.003945+0000","last_change":"2023-05-11T07:35:39.522351+0000","last_active":"2023-05-11T07:35:45.003945+0000","last_peered":"2023-05-11T07:35:45.003945+0000","last_clean":"2023-05-11T07:35:45.003945+0000","last_became_active":"2023-05-11T07:35:39.522056+0000","last_became_peered":"2023-05-11T07:35:39.522056+0000","last_unstale":"2023-05-11T07:35:45.003945+0000","last_undegraded":"2023-05-11T07:35:45.003945+0000","last_fullsized":"2023-05-11T07:35:45.003945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:47:55.321727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516630+0000","last_change":"2023-05-11T07:35:40.027281+0000","last_active":"2023-05-11T07:35:44.516630+0000","last_peered":"2023-05-11T07:35:44.516630+0000","last_clean":"2023-05-11T07:35:44.516630+0000","last_became_active":"2023-05-11T07:35:40.026683+0000","last_became_peered":"2023-05-11T07:35:40.026683+0000","last_unstale":"2023-05-11T07:35:44.516630+0000","last_undegraded":"2023-05-11T07:35:44.516630+0000","last_fullsized":"2023-05-11T07:35:44.516630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516623+0000","last_change":"2023-05-11T07:35:44.045971+0000","last_active":"2023-05-11T07:35:44.516623+0000","last_peered":"2023-05-11T07:35:44.516623+0000","last_clean":"2023-05-11T07:35:44.516623+0000","last_became_active":"2023-05-11T07:35:44.045617+0000","last_became_peered":"2023-05-11T07:35:44.045617+0000","last_unstale":"2023-05-11T07:35:44.516623+0000","last_undegraded":"2023-05-11T07:35:44.516623+0000","last_fullsized":"2023-05-11T07:35:44.516623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:57.332534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560634+0000","last_change":"2023-05-11T07:35:39.521019+0000","last_active":"2023-05-11T07:35:47.560634+0000","last_peered":"2023-05-11T07:35:47.560634+0000","last_clean":"2023-05-11T07:35:47.560634+0000","last_became_active":"2023-05-11T07:35:39.520725+0000","last_became_peered":"2023-05-11T07:35:39.520725+0000","last_unstale":"2023-05-11T07:35:47.560634+0000","last_undegraded":"2023-05-11T07:35:47.560634+0000","last_fullsized":"2023-05-11T07:35:47.560634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.892105+0000","last_change":"2023-05-11T07:35:40.028356+0000","last_active":"2023-05-11T07:35:46.892105+0000","last_peered":"2023-05-11T07:35:46.892105+0000","last_clean":"2023-05-11T07:35:46.892105+0000","last_became_active":"2023-05-11T07:35:40.028139+0000","last_became_peered":"2023-05-11T07:35:40.028139+0000","last_unstale":"2023-05-11T07:35:46.892105+0000","last_undegraded":"2023-05-11T07:35:46.892105+0000","last_fullsized":"2023-05-11T07:35:46.892105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:09:08.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:44.048081+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:44.047704+0000","last_became_peered":"2023-05-11T07:35:44.047704+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:27.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516590+0000","last_change":"2023-05-11T07:35:39.524366+0000","last_active":"2023-05-11T07:35:44.516590+0000","last_peered":"2023-05-11T07:35:44.516590+0000","last_clean":"2023-05-11T07:35:44.516590+0000","last_became_active":"2023-05-11T07:35:39.523956+0000","last_became_peered":"2023-05-11T07:35:39.523956+0000","last_unstale":"2023-05-11T07:35:44.516590+0000","last_undegraded":"2023-05-11T07:35:44.516590+0000","last_fullsized":"2023-05-11T07:35:44.516590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:49.699791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561237+0000","last_change":"2023-05-11T07:35:40.004665+0000","last_active":"2023-05-11T07:35:47.561237+0000","last_peered":"2023-05-11T07:35:47.561237+0000","last_clean":"2023-05-11T07:35:47.561237+0000","last_became_active":"2023-05-11T07:35:40.004422+0000","last_became_peered":"2023-05-11T07:35:40.004422+0000","last_unstale":"2023-05-11T07:35:47.561237+0000","last_undegraded":"2023-05-11T07:35:47.561237+0000","last_fullsized":"2023-05-11T07:35:47.561237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517909+0000","last_change":"2023-05-11T07:35:44.059577+0000","last_active":"2023-05-11T07:35:44.517909+0000","last_peered":"2023-05-11T07:35:44.517909+0000","last_clean":"2023-05-11T07:35:44.517909+0000","last_became_active":"2023-05-11T07:35:44.058668+0000","last_became_peered":"2023-05-11T07:35:44.058668+0000","last_unstale":"2023-05-11T07:35:44.517909+0000","last_undegraded":"2023-05-11T07:35:44.517909+0000","last_fullsized":"2023-05-11T07:35:44.517909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:06.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015648+0000","last_change":"2023-05-11T07:35:39.516925+0000","last_active":"2023-05-11T07:35:45.015648+0000","last_peered":"2023-05-11T07:35:45.015648+0000","last_clean":"2023-05-11T07:35:45.015648+0000","last_became_active":"2023-05-11T07:35:39.516579+0000","last_became_peered":"2023-05-11T07:35:39.516579+0000","last_unstale":"2023-05-11T07:35:45.015648+0000","last_undegraded":"2023-05-11T07:35:45.015648+0000","last_fullsized":"2023-05-11T07:35:45.015648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:48:28.388729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560769+0000","last_change":"2023-05-11T07:35:40.020195+0000","last_active":"2023-05-11T07:35:47.560769+0000","last_peered":"2023-05-11T07:35:47.560769+0000","last_clean":"2023-05-11T07:35:47.560769+0000","last_became_active":"2023-05-11T07:35:40.020000+0000","last_became_peered":"2023-05-11T07:35:40.020000+0000","last_unstale":"2023-05-11T07:35:47.560769+0000","last_undegraded":"2023-05-11T07:35:47.560769+0000","last_fullsized":"2023-05-11T07:35:47.560769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561713+0000","last_change":"2023-05-11T07:35:44.046341+0000","last_active":"2023-05-11T07:35:47.561713+0000","last_peered":"2023-05-11T07:35:47.561713+0000","last_clean":"2023-05-11T07:35:47.561713+0000","last_became_active":"2023-05-11T07:35:44.045931+0000","last_became_peered":"2023-05-11T07:35:44.045931+0000","last_unstale":"2023-05-11T07:35:47.561713+0000","last_undegraded":"2023-05-11T07:35:47.561713+0000","last_fullsized":"2023-05-11T07:35:47.561713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:43:00.804549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518863+0000","last_change":"2023-05-11T07:35:39.522292+0000","last_active":"2023-05-11T07:35:44.518863+0000","last_peered":"2023-05-11T07:35:44.518863+0000","last_clean":"2023-05-11T07:35:44.518863+0000","last_became_active":"2023-05-11T07:35:39.522044+0000","last_became_peered":"2023-05-11T07:35:39.522044+0000","last_unstale":"2023-05-11T07:35:44.518863+0000","last_undegraded":"2023-05-11T07:35:44.518863+0000","last_fullsized":"2023-05-11T07:35:44.518863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004352+0000","last_change":"2023-05-11T07:35:40.006244+0000","last_active":"2023-05-11T07:35:45.004352+0000","last_peered":"2023-05-11T07:35:45.004352+0000","last_clean":"2023-05-11T07:35:45.004352+0000","last_became_active":"2023-05-11T07:35:40.006008+0000","last_became_peered":"2023-05-11T07:35:40.006008+0000","last_unstale":"2023-05-11T07:35:45.004352+0000","last_undegraded":"2023-05-11T07:35:45.004352+0000","last_fullsized":"2023-05-11T07:35:45.004352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004124+0000","last_change":"2023-05-11T07:35:44.050216+0000","last_active":"2023-05-11T07:35:45.004124+0000","last_peered":"2023-05-11T07:35:45.004124+0000","last_clean":"2023-05-11T07:35:45.004124+0000","last_became_active":"2023-05-11T07:35:44.049821+0000","last_became_peered":"2023-05-11T07:35:44.049821+0000","last_unstale":"2023-05-11T07:35:45.004124+0000","last_undegraded":"2023-05-11T07:35:45.004124+0000","last_fullsized":"2023-05-11T07:35:45.004124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:52:59.303972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:58.639060+0000","last_change":"2023-05-11T07:35:39.524270+0000","last_active":"2023-05-11T07:35:58.639060+0000","last_peered":"2023-05-11T07:35:58.639060+0000","last_clean":"2023-05-11T07:35:58.639060+0000","last_became_active":"2023-05-11T07:35:39.523839+0000","last_became_peered":"2023-05-11T07:35:39.523839+0000","last_unstale":"2023-05-11T07:35:58.639060+0000","last_undegraded":"2023-05-11T07:35:58.639060+0000","last_fullsized":"2023-05-11T07:35:58.639060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:22:25.344878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561662+0000","last_change":"2023-05-11T07:35:40.023719+0000","last_active":"2023-05-11T07:35:47.561662+0000","last_peered":"2023-05-11T07:35:47.561662+0000","last_clean":"2023-05-11T07:35:47.561662+0000","last_became_active":"2023-05-11T07:35:40.023383+0000","last_became_peered":"2023-05-11T07:35:40.023383+0000","last_unstale":"2023-05-11T07:35:47.561662+0000","last_undegraded":"2023-05-11T07:35:47.561662+0000","last_fullsized":"2023-05-11T07:35:47.561662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:42.106118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015869+0000","last_change":"2023-05-11T07:35:44.049508+0000","last_active":"2023-05-11T07:35:45.015869+0000","last_peered":"2023-05-11T07:35:45.015869+0000","last_clean":"2023-05-11T07:35:45.015869+0000","last_became_active":"2023-05-11T07:35:44.049065+0000","last_became_peered":"2023-05-11T07:35:44.049065+0000","last_unstale":"2023-05-11T07:35:45.015869+0000","last_undegraded":"2023-05-11T07:35:45.015869+0000","last_fullsized":"2023-05-11T07:35:45.015869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:40.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518317+0000","last_change":"2023-05-11T07:35:39.531094+0000","last_active":"2023-05-11T07:35:44.518317+0000","last_peered":"2023-05-11T07:35:44.518317+0000","last_clean":"2023-05-11T07:35:44.518317+0000","last_became_active":"2023-05-11T07:35:39.530798+0000","last_became_peered":"2023-05-11T07:35:39.530798+0000","last_unstale":"2023-05-11T07:35:44.518317+0000","last_undegraded":"2023-05-11T07:35:44.518317+0000","last_fullsized":"2023-05-11T07:35:44.518317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:35.170874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561870+0000","last_change":"2023-05-11T07:35:40.005168+0000","last_active":"2023-05-11T07:35:47.561870+0000","last_peered":"2023-05-11T07:35:47.561870+0000","last_clean":"2023-05-11T07:35:47.561870+0000","last_became_active":"2023-05-11T07:35:40.004912+0000","last_became_peered":"2023-05-11T07:35:40.004912+0000","last_unstale":"2023-05-11T07:35:47.561870+0000","last_undegraded":"2023-05-11T07:35:47.561870+0000","last_fullsized":"2023-05-11T07:35:47.561870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:42.658238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561731+0000","last_change":"2023-05-11T07:35:44.048532+0000","last_active":"2023-05-11T07:35:47.561731+0000","last_peered":"2023-05-11T07:35:47.561731+0000","last_clean":"2023-05-11T07:35:47.561731+0000","last_became_active":"2023-05-11T07:35:44.048154+0000","last_became_peered":"2023-05-11T07:35:44.048154+0000","last_unstale":"2023-05-11T07:35:47.561731+0000","last_undegraded":"2023-05-11T07:35:47.561731+0000","last_fullsized":"2023-05-11T07:35:47.561731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:15.060562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516352+0000","last_change":"2023-05-11T07:35:39.522998+0000","last_active":"2023-05-11T07:35:44.516352+0000","last_peered":"2023-05-11T07:35:44.516352+0000","last_clean":"2023-05-11T07:35:44.516352+0000","last_became_active":"2023-05-11T07:35:39.522721+0000","last_became_peered":"2023-05-11T07:35:39.522721+0000","last_unstale":"2023-05-11T07:35:44.516352+0000","last_undegraded":"2023-05-11T07:35:44.516352+0000","last_fullsized":"2023-05-11T07:35:44.516352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:33.291889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015465+0000","last_change":"2023-05-11T07:35:40.032638+0000","last_active":"2023-05-11T07:35:45.015465+0000","last_peered":"2023-05-11T07:35:45.015465+0000","last_clean":"2023-05-11T07:35:45.015465+0000","last_became_active":"2023-05-11T07:35:40.032296+0000","last_became_peered":"2023-05-11T07:35:40.032296+0000","last_unstale":"2023-05-11T07:35:45.015465+0000","last_undegraded":"2023-05-11T07:35:45.015465+0000","last_fullsized":"2023-05-11T07:35:45.015465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:42:43.821239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562026+0000","last_change":"2023-05-11T07:35:44.048077+0000","last_active":"2023-05-11T07:35:47.562026+0000","last_peered":"2023-05-11T07:35:47.562026+0000","last_clean":"2023-05-11T07:35:47.562026+0000","last_became_active":"2023-05-11T07:35:44.047653+0000","last_became_peered":"2023-05-11T07:35:44.047653+0000","last_unstale":"2023-05-11T07:35:47.562026+0000","last_undegraded":"2023-05-11T07:35:47.562026+0000","last_fullsized":"2023-05-11T07:35:47.562026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517958+0000","last_change":"2023-05-11T07:35:39.529551+0000","last_active":"2023-05-11T07:35:44.517958+0000","last_peered":"2023-05-11T07:35:44.517958+0000","last_clean":"2023-05-11T07:35:44.517958+0000","last_became_active":"2023-05-11T07:35:39.529219+0000","last_became_peered":"2023-05-11T07:35:39.529219+0000","last_unstale":"2023-05-11T07:35:44.517958+0000","last_undegraded":"2023-05-11T07:35:44.517958+0000","last_fullsized":"2023-05-11T07:35:44.517958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:32.191475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516724+0000","last_change":"2023-05-11T07:35:40.027456+0000","last_active":"2023-05-11T07:35:44.516724+0000","last_peered":"2023-05-11T07:35:44.516724+0000","last_clean":"2023-05-11T07:35:44.516724+0000","last_became_active":"2023-05-11T07:35:40.027006+0000","last_became_peered":"2023-05-11T07:35:40.027006+0000","last_unstale":"2023-05-11T07:35:44.516724+0000","last_undegraded":"2023-05-11T07:35:44.516724+0000","last_fullsized":"2023-05-11T07:35:44.516724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015429+0000","last_change":"2023-05-11T07:35:44.051656+0000","last_active":"2023-05-11T07:35:45.015429+0000","last_peered":"2023-05-11T07:35:45.015429+0000","last_clean":"2023-05-11T07:35:45.015429+0000","last_became_active":"2023-05-11T07:35:44.051177+0000","last_became_peered":"2023-05-11T07:35:44.051177+0000","last_unstale":"2023-05-11T07:35:45.015429+0000","last_undegraded":"2023-05-11T07:35:45.015429+0000","last_fullsized":"2023-05-11T07:35:45.015429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:31:20.083650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891445+0000","last_change":"2023-05-11T07:35:39.525663+0000","last_active":"2023-05-11T07:35:46.891445+0000","last_peered":"2023-05-11T07:35:46.891445+0000","last_clean":"2023-05-11T07:35:46.891445+0000","last_became_active":"2023-05-11T07:35:39.525120+0000","last_became_peered":"2023-05-11T07:35:39.525120+0000","last_unstale":"2023-05-11T07:35:46.891445+0000","last_undegraded":"2023-05-11T07:35:46.891445+0000","last_fullsized":"2023-05-11T07:35:46.891445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:53:41.174416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562065+0000","last_change":"2023-05-11T07:35:40.019244+0000","last_active":"2023-05-11T07:35:47.562065+0000","last_peered":"2023-05-11T07:35:47.562065+0000","last_clean":"2023-05-11T07:35:47.562065+0000","last_became_active":"2023-05-11T07:35:40.018998+0000","last_became_peered":"2023-05-11T07:35:40.018998+0000","last_unstale":"2023-05-11T07:35:47.562065+0000","last_undegraded":"2023-05-11T07:35:47.562065+0000","last_fullsized":"2023-05-11T07:35:47.562065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:35.403397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518703+0000","last_change":"2023-05-11T07:35:44.056854+0000","last_active":"2023-05-11T07:35:44.518703+0000","last_peered":"2023-05-11T07:35:44.518703+0000","last_clean":"2023-05-11T07:35:44.518703+0000","last_became_active":"2023-05-11T07:35:44.056483+0000","last_became_peered":"2023-05-11T07:35:44.056483+0000","last_unstale":"2023-05-11T07:35:44.518703+0000","last_undegraded":"2023-05-11T07:35:44.518703+0000","last_fullsized":"2023-05-11T07:35:44.518703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:38.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518566+0000","last_change":"2023-05-11T07:35:39.529492+0000","last_active":"2023-05-11T07:35:44.518566+0000","last_peered":"2023-05-11T07:35:44.518566+0000","last_clean":"2023-05-11T07:35:44.518566+0000","last_became_active":"2023-05-11T07:35:39.529182+0000","last_became_peered":"2023-05-11T07:35:39.529182+0000","last_unstale":"2023-05-11T07:35:44.518566+0000","last_undegraded":"2023-05-11T07:35:44.518566+0000","last_fullsized":"2023-05-11T07:35:44.518566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:41.677638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014849+0000","last_change":"2023-05-11T07:35:40.029916+0000","last_active":"2023-05-11T07:35:45.014849+0000","last_peered":"2023-05-11T07:35:45.014849+0000","last_clean":"2023-05-11T07:35:45.014849+0000","last_became_active":"2023-05-11T07:35:40.029633+0000","last_became_peered":"2023-05-11T07:35:40.029633+0000","last_unstale":"2023-05-11T07:35:45.014849+0000","last_undegraded":"2023-05-11T07:35:45.014849+0000","last_fullsized":"2023-05-11T07:35:45.014849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089763+0000","last_change":"2023-05-11T07:35:44.046464+0000","last_active":"2023-05-11T07:35:45.089763+0000","last_peered":"2023-05-11T07:35:45.089763+0000","last_clean":"2023-05-11T07:35:45.089763+0000","last_became_active":"2023-05-11T07:35:44.046046+0000","last_became_peered":"2023-05-11T07:35:44.046046+0000","last_unstale":"2023-05-11T07:35:45.089763+0000","last_undegraded":"2023-05-11T07:35:45.089763+0000","last_fullsized":"2023-05-11T07:35:45.089763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:31:21.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518773+0000","last_change":"2023-05-11T07:35:39.529523+0000","last_active":"2023-05-11T07:35:44.518773+0000","last_peered":"2023-05-11T07:35:44.518773+0000","last_clean":"2023-05-11T07:35:44.518773+0000","last_became_active":"2023-05-11T07:35:39.529198+0000","last_became_peered":"2023-05-11T07:35:39.529198+0000","last_unstale":"2023-05-11T07:35:44.518773+0000","last_undegraded":"2023-05-11T07:35:44.518773+0000","last_fullsized":"2023-05-11T07:35:44.518773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:56.284794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561457+0000","last_change":"2023-05-11T07:35:40.021866+0000","last_active":"2023-05-11T07:35:47.561457+0000","last_peered":"2023-05-11T07:35:47.561457+0000","last_clean":"2023-05-11T07:35:47.561457+0000","last_became_active":"2023-05-11T07:35:40.021576+0000","last_became_peered":"2023-05-11T07:35:40.021576+0000","last_unstale":"2023-05-11T07:35:47.561457+0000","last_undegraded":"2023-05-11T07:35:47.561457+0000","last_fullsized":"2023-05-11T07:35:47.561457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:19:05.603259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089718+0000","last_change":"2023-05-11T07:35:44.045836+0000","last_active":"2023-05-11T07:35:45.089718+0000","last_peered":"2023-05-11T07:35:45.089718+0000","last_clean":"2023-05-11T07:35:45.089718+0000","last_became_active":"2023-05-11T07:35:44.045453+0000","last_became_peered":"2023-05-11T07:35:44.045453+0000","last_unstale":"2023-05-11T07:35:45.089718+0000","last_undegraded":"2023-05-11T07:35:45.089718+0000","last_fullsized":"2023-05-11T07:35:45.089718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.845162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518973+0000","last_change":"2023-05-11T07:35:39.526694+0000","last_active":"2023-05-11T07:35:44.518973+0000","last_peered":"2023-05-11T07:35:44.518973+0000","last_clean":"2023-05-11T07:35:44.518973+0000","last_became_active":"2023-05-11T07:35:39.526370+0000","last_became_peered":"2023-05-11T07:35:39.526370+0000","last_unstale":"2023-05-11T07:35:44.518973+0000","last_undegraded":"2023-05-11T07:35:44.518973+0000","last_fullsized":"2023-05-11T07:35:44.518973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:13:59.267692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:40.014209+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:40.013884+0000","last_became_peered":"2023-05-11T07:35:40.013884+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:49:21.339051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089552+0000","last_change":"2023-05-11T07:35:44.050723+0000","last_active":"2023-05-11T07:35:45.089552+0000","last_peered":"2023-05-11T07:35:45.089552+0000","last_clean":"2023-05-11T07:35:45.089552+0000","last_became_active":"2023-05-11T07:35:44.050285+0000","last_became_peered":"2023-05-11T07:35:44.050285+0000","last_unstale":"2023-05-11T07:35:45.089552+0000","last_undegraded":"2023-05-11T07:35:45.089552+0000","last_fullsized":"2023-05-11T07:35:45.089552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:44:48.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015149+0000","last_change":"2023-05-11T07:35:39.506013+0000","last_active":"2023-05-11T07:35:45.015149+0000","last_peered":"2023-05-11T07:35:45.015149+0000","last_clean":"2023-05-11T07:35:45.015149+0000","last_became_active":"2023-05-11T07:35:39.505714+0000","last_became_peered":"2023-05-11T07:35:39.505714+0000","last_unstale":"2023-05-11T07:35:45.015149+0000","last_undegraded":"2023-05-11T07:35:45.015149+0000","last_fullsized":"2023-05-11T07:35:45.015149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:01.700365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517568+0000","last_change":"2023-05-11T07:35:40.018422+0000","last_active":"2023-05-11T07:35:44.517568+0000","last_peered":"2023-05-11T07:35:44.517568+0000","last_clean":"2023-05-11T07:35:44.517568+0000","last_became_active":"2023-05-11T07:35:40.018159+0000","last_became_peered":"2023-05-11T07:35:40.018159+0000","last_unstale":"2023-05-11T07:35:44.517568+0000","last_undegraded":"2023-05-11T07:35:44.517568+0000","last_fullsized":"2023-05-11T07:35:44.517568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089716+0000","last_change":"2023-05-11T07:35:44.047834+0000","last_active":"2023-05-11T07:35:45.089716+0000","last_peered":"2023-05-11T07:35:45.089716+0000","last_clean":"2023-05-11T07:35:45.089716+0000","last_became_active":"2023-05-11T07:35:44.047465+0000","last_became_peered":"2023-05-11T07:35:44.047465+0000","last_unstale":"2023-05-11T07:35:45.089716+0000","last_undegraded":"2023-05-11T07:35:45.089716+0000","last_fullsized":"2023-05-11T07:35:45.089716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:59:10.577106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560876+0000","last_change":"2023-05-11T07:35:39.523143+0000","last_active":"2023-05-11T07:35:47.560876+0000","last_peered":"2023-05-11T07:35:47.560876+0000","last_clean":"2023-05-11T07:35:47.560876+0000","last_became_active":"2023-05-11T07:35:39.522833+0000","last_became_peered":"2023-05-11T07:35:39.522833+0000","last_unstale":"2023-05-11T07:35:47.560876+0000","last_undegraded":"2023-05-11T07:35:47.560876+0000","last_fullsized":"2023-05-11T07:35:47.560876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:43.170391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561462+0000","last_change":"2023-05-11T07:35:40.019416+0000","last_active":"2023-05-11T07:35:47.561462+0000","last_peered":"2023-05-11T07:35:47.561462+0000","last_clean":"2023-05-11T07:35:47.561462+0000","last_became_active":"2023-05-11T07:35:40.017783+0000","last_became_peered":"2023-05-11T07:35:40.017783+0000","last_unstale":"2023-05-11T07:35:47.561462+0000","last_undegraded":"2023-05-11T07:35:47.561462+0000","last_fullsized":"2023-05-11T07:35:47.561462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:40.343002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004455+0000","last_change":"2023-05-11T07:35:44.043607+0000","last_active":"2023-05-11T07:35:45.004455+0000","last_peered":"2023-05-11T07:35:45.004455+0000","last_clean":"2023-05-11T07:35:45.004455+0000","last_became_active":"2023-05-11T07:35:44.043204+0000","last_became_peered":"2023-05-11T07:35:44.043204+0000","last_unstale":"2023-05-11T07:35:45.004455+0000","last_undegraded":"2023-05-11T07:35:45.004455+0000","last_fullsized":"2023-05-11T07:35:45.004455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:57.120095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891506+0000","last_change":"2023-05-11T07:35:39.520690+0000","last_active":"2023-05-11T07:35:46.891506+0000","last_peered":"2023-05-11T07:35:46.891506+0000","last_clean":"2023-05-11T07:35:46.891506+0000","last_became_active":"2023-05-11T07:35:39.520360+0000","last_became_peered":"2023-05-11T07:35:39.520360+0000","last_unstale":"2023-05-11T07:35:46.891506+0000","last_undegraded":"2023-05-11T07:35:46.891506+0000","last_fullsized":"2023-05-11T07:35:46.891506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:07:45.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561931+0000","last_change":"2023-05-11T07:35:40.019241+0000","last_active":"2023-05-11T07:35:47.561931+0000","last_peered":"2023-05-11T07:35:47.561931+0000","last_clean":"2023-05-11T07:35:47.561931+0000","last_became_active":"2023-05-11T07:35:40.018965+0000","last_became_peered":"2023-05-11T07:35:40.018965+0000","last_unstale":"2023-05-11T07:35:47.561931+0000","last_undegraded":"2023-05-11T07:35:47.561931+0000","last_fullsized":"2023-05-11T07:35:47.561931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:05.166289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015716+0000","last_change":"2023-05-11T07:35:44.056735+0000","last_active":"2023-05-11T07:35:45.015716+0000","last_peered":"2023-05-11T07:35:45.015716+0000","last_clean":"2023-05-11T07:35:45.015716+0000","last_became_active":"2023-05-11T07:35:44.056344+0000","last_became_peered":"2023-05-11T07:35:44.056344+0000","last_unstale":"2023-05-11T07:35:45.015716+0000","last_undegraded":"2023-05-11T07:35:45.015716+0000","last_fullsized":"2023-05-11T07:35:45.015716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:05.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560559+0000","last_change":"2023-05-11T07:35:39.521039+0000","last_active":"2023-05-11T07:35:47.560559+0000","last_peered":"2023-05-11T07:35:47.560559+0000","last_clean":"2023-05-11T07:35:47.560559+0000","last_became_active":"2023-05-11T07:35:39.519579+0000","last_became_peered":"2023-05-11T07:35:39.519579+0000","last_unstale":"2023-05-11T07:35:47.560559+0000","last_undegraded":"2023-05-11T07:35:47.560559+0000","last_fullsized":"2023-05-11T07:35:47.560559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:17.898498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562159+0000","last_change":"2023-05-11T07:35:40.024176+0000","last_active":"2023-05-11T07:35:47.562159+0000","last_peered":"2023-05-11T07:35:47.562159+0000","last_clean":"2023-05-11T07:35:47.562159+0000","last_became_active":"2023-05-11T07:35:40.023913+0000","last_became_peered":"2023-05-11T07:35:40.023913+0000","last_unstale":"2023-05-11T07:35:47.562159+0000","last_undegraded":"2023-05-11T07:35:47.562159+0000","last_fullsized":"2023-05-11T07:35:47.562159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:45:40.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562016+0000","last_change":"2023-05-11T07:35:44.053961+0000","last_active":"2023-05-11T07:35:47.562016+0000","last_peered":"2023-05-11T07:35:47.562016+0000","last_clean":"2023-05-11T07:35:47.562016+0000","last_became_active":"2023-05-11T07:35:44.053562+0000","last_became_peered":"2023-05-11T07:35:44.053562+0000","last_unstale":"2023-05-11T07:35:47.562016+0000","last_undegraded":"2023-05-11T07:35:47.562016+0000","last_fullsized":"2023-05-11T07:35:47.562016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:43:09.942525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560794+0000","last_change":"2023-05-11T07:35:39.519635+0000","last_active":"2023-05-11T07:35:47.560794+0000","last_peered":"2023-05-11T07:35:47.560794+0000","last_clean":"2023-05-11T07:35:47.560794+0000","last_became_active":"2023-05-11T07:35:39.519358+0000","last_became_peered":"2023-05-11T07:35:39.519358+0000","last_unstale":"2023-05-11T07:35:47.560794+0000","last_undegraded":"2023-05-11T07:35:47.560794+0000","last_fullsized":"2023-05-11T07:35:47.560794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004912+0000","last_change":"2023-05-11T07:35:40.005569+0000","last_active":"2023-05-11T07:35:45.004912+0000","last_peered":"2023-05-11T07:35:45.004912+0000","last_clean":"2023-05-11T07:35:45.004912+0000","last_became_active":"2023-05-11T07:35:40.005265+0000","last_became_peered":"2023-05-11T07:35:40.005265+0000","last_unstale":"2023-05-11T07:35:45.004912+0000","last_undegraded":"2023-05-11T07:35:45.004912+0000","last_fullsized":"2023-05-11T07:35:45.004912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:05.664545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516637+0000","last_change":"2023-05-11T07:35:44.044625+0000","last_active":"2023-05-11T07:35:44.516637+0000","last_peered":"2023-05-11T07:35:44.516637+0000","last_clean":"2023-05-11T07:35:44.516637+0000","last_became_active":"2023-05-11T07:35:44.044209+0000","last_became_peered":"2023-05-11T07:35:44.044209+0000","last_unstale":"2023-05-11T07:35:44.516637+0000","last_undegraded":"2023-05-11T07:35:44.516637+0000","last_fullsized":"2023-05-11T07:35:44.516637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:05.083240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004520+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:35:45.004520+0000","last_peered":"2023-05-11T07:35:45.004520+0000","last_clean":"2023-05-11T07:35:45.004520+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:35:45.004520+0000","last_undegraded":"2023-05-11T07:35:45.004520+0000","last_fullsized":"2023-05-11T07:35:45.004520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:19.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015475+0000","last_change":"2023-05-11T07:35:39.507928+0000","last_active":"2023-05-11T07:35:45.015475+0000","last_peered":"2023-05-11T07:35:45.015475+0000","last_clean":"2023-05-11T07:35:45.015475+0000","last_became_active":"2023-05-11T07:35:39.507652+0000","last_became_peered":"2023-05-11T07:35:39.507652+0000","last_unstale":"2023-05-11T07:35:45.015475+0000","last_undegraded":"2023-05-11T07:35:45.015475+0000","last_fullsized":"2023-05-11T07:35:45.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:10.367809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004210+0000","last_change":"2023-05-11T07:35:40.023291+0000","last_active":"2023-05-11T07:35:45.004210+0000","last_peered":"2023-05-11T07:35:45.004210+0000","last_clean":"2023-05-11T07:35:45.004210+0000","last_became_active":"2023-05-11T07:35:40.023039+0000","last_became_peered":"2023-05-11T07:35:40.023039+0000","last_unstale":"2023-05-11T07:35:45.004210+0000","last_undegraded":"2023-05-11T07:35:45.004210+0000","last_fullsized":"2023-05-11T07:35:45.004210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:34.298746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516791+0000","last_change":"2023-05-11T07:35:44.056582+0000","last_active":"2023-05-11T07:35:44.516791+0000","last_peered":"2023-05-11T07:35:44.516791+0000","last_clean":"2023-05-11T07:35:44.516791+0000","last_became_active":"2023-05-11T07:35:44.055990+0000","last_became_peered":"2023-05-11T07:35:44.055990+0000","last_unstale":"2023-05-11T07:35:44.516791+0000","last_undegraded":"2023-05-11T07:35:44.516791+0000","last_fullsized":"2023-05-11T07:35:44.516791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:09.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014983+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:35:45.014983+0000","last_peered":"2023-05-11T07:35:45.014983+0000","last_clean":"2023-05-11T07:35:45.014983+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:35:45.014983+0000","last_undegraded":"2023-05-11T07:35:45.014983+0000","last_fullsized":"2023-05-11T07:35:45.014983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:04.852885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560659+0000","last_change":"2023-05-11T07:35:39.525461+0000","last_active":"2023-05-11T07:35:47.560659+0000","last_peered":"2023-05-11T07:35:47.560659+0000","last_clean":"2023-05-11T07:35:47.560659+0000","last_became_active":"2023-05-11T07:35:39.525087+0000","last_became_peered":"2023-05-11T07:35:39.525087+0000","last_unstale":"2023-05-11T07:35:47.560659+0000","last_undegraded":"2023-05-11T07:35:47.560659+0000","last_fullsized":"2023-05-11T07:35:47.560659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:32:39.463622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004389+0000","last_change":"2023-05-11T07:35:40.015281+0000","last_active":"2023-05-11T07:35:45.004389+0000","last_peered":"2023-05-11T07:35:45.004389+0000","last_clean":"2023-05-11T07:35:45.004389+0000","last_became_active":"2023-05-11T07:35:40.015024+0000","last_became_peered":"2023-05-11T07:35:40.015024+0000","last_unstale":"2023-05-11T07:35:45.004389+0000","last_undegraded":"2023-05-11T07:35:45.004389+0000","last_fullsized":"2023-05-11T07:35:45.004389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:25.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089964+0000","last_change":"2023-05-11T07:35:44.051357+0000","last_active":"2023-05-11T07:35:45.089964+0000","last_peered":"2023-05-11T07:35:45.089964+0000","last_clean":"2023-05-11T07:35:45.089964+0000","last_became_active":"2023-05-11T07:35:44.051006+0000","last_became_peered":"2023-05-11T07:35:44.051006+0000","last_unstale":"2023-05-11T07:35:45.089964+0000","last_undegraded":"2023-05-11T07:35:45.089964+0000","last_fullsized":"2023-05-11T07:35:45.089964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:52:35.255028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089456+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:35:45.089456+0000","last_peered":"2023-05-11T07:35:45.089456+0000","last_clean":"2023-05-11T07:35:45.089456+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:35:45.089456+0000","last_undegraded":"2023-05-11T07:35:45.089456+0000","last_fullsized":"2023-05-11T07:35:45.089456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:55:52.663792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004173+0000","last_change":"2023-05-11T07:35:39.519332+0000","last_active":"2023-05-11T07:35:45.004173+0000","last_peered":"2023-05-11T07:35:45.004173+0000","last_clean":"2023-05-11T07:35:45.004173+0000","last_became_active":"2023-05-11T07:35:39.518915+0000","last_became_peered":"2023-05-11T07:35:39.518915+0000","last_unstale":"2023-05-11T07:35:45.004173+0000","last_undegraded":"2023-05-11T07:35:45.004173+0000","last_fullsized":"2023-05-11T07:35:45.004173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004831+0000","last_change":"2023-05-11T07:35:40.029329+0000","last_active":"2023-05-11T07:35:45.004831+0000","last_peered":"2023-05-11T07:35:45.004831+0000","last_clean":"2023-05-11T07:35:45.004831+0000","last_became_active":"2023-05-11T07:35:40.029022+0000","last_became_peered":"2023-05-11T07:35:40.029022+0000","last_unstale":"2023-05-11T07:35:45.004831+0000","last_undegraded":"2023-05-11T07:35:45.004831+0000","last_fullsized":"2023-05-11T07:35:45.004831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518310+0000","last_change":"2023-05-11T07:35:44.049973+0000","last_active":"2023-05-11T07:35:44.518310+0000","last_peered":"2023-05-11T07:35:44.518310+0000","last_clean":"2023-05-11T07:35:44.518310+0000","last_became_active":"2023-05-11T07:35:44.049495+0000","last_became_peered":"2023-05-11T07:35:44.049495+0000","last_unstale":"2023-05-11T07:35:44.518310+0000","last_undegraded":"2023-05-11T07:35:44.518310+0000","last_fullsized":"2023-05-11T07:35:44.518310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:18.555450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015274+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:35:45.015274+0000","last_peered":"2023-05-11T07:35:45.015274+0000","last_clean":"2023-05-11T07:35:45.015274+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:35:45.015274+0000","last_undegraded":"2023-05-11T07:35:45.015274+0000","last_fullsized":"2023-05-11T07:35:45.015274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:03:52.797193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517992+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:35:44.517992+0000","last_peered":"2023-05-11T07:35:44.517992+0000","last_clean":"2023-05-11T07:35:44.517992+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:35:44.517992+0000","last_undegraded":"2023-05-11T07:35:44.517992+0000","last_fullsized":"2023-05-11T07:35:44.517992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:36:52.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561588+0000","last_change":"2023-05-11T07:35:39.510017+0000","last_active":"2023-05-11T07:35:47.561588+0000","last_peered":"2023-05-11T07:35:47.561588+0000","last_clean":"2023-05-11T07:35:47.561588+0000","last_became_active":"2023-05-11T07:35:39.509671+0000","last_became_peered":"2023-05-11T07:35:39.509671+0000","last_unstale":"2023-05-11T07:35:47.561588+0000","last_undegraded":"2023-05-11T07:35:47.561588+0000","last_fullsized":"2023-05-11T07:35:47.561588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:34.377733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891878+0000","last_change":"2023-05-11T07:35:40.008915+0000","last_active":"2023-05-11T07:35:46.891878+0000","last_peered":"2023-05-11T07:35:46.891878+0000","last_clean":"2023-05-11T07:35:46.891878+0000","last_became_active":"2023-05-11T07:35:40.008581+0000","last_became_peered":"2023-05-11T07:35:40.008581+0000","last_unstale":"2023-05-11T07:35:46.891878+0000","last_undegraded":"2023-05-11T07:35:46.891878+0000","last_fullsized":"2023-05-11T07:35:46.891878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:40:05.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015471+0000","last_change":"2023-05-11T07:35:44.057326+0000","last_active":"2023-05-11T07:35:45.015471+0000","last_peered":"2023-05-11T07:35:45.015471+0000","last_clean":"2023-05-11T07:35:45.015471+0000","last_became_active":"2023-05-11T07:35:44.056853+0000","last_became_peered":"2023-05-11T07:35:44.056853+0000","last_unstale":"2023-05-11T07:35:45.015471+0000","last_undegraded":"2023-05-11T07:35:45.015471+0000","last_fullsized":"2023-05-11T07:35:45.015471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:23.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518296+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:35:44.518296+0000","last_peered":"2023-05-11T07:35:44.518296+0000","last_clean":"2023-05-11T07:35:44.518296+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:35:44.518296+0000","last_undegraded":"2023-05-11T07:35:44.518296+0000","last_fullsized":"2023-05-11T07:35:44.518296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:17.235034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516272+0000","last_change":"2023-05-11T07:35:39.524833+0000","last_active":"2023-05-11T07:35:44.516272+0000","last_peered":"2023-05-11T07:35:44.516272+0000","last_clean":"2023-05-11T07:35:44.516272+0000","last_became_active":"2023-05-11T07:35:39.524447+0000","last_became_peered":"2023-05-11T07:35:39.524447+0000","last_unstale":"2023-05-11T07:35:44.516272+0000","last_undegraded":"2023-05-11T07:35:44.516272+0000","last_fullsized":"2023-05-11T07:35:44.516272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516309+0000","last_change":"2023-05-11T07:35:40.023349+0000","last_active":"2023-05-11T07:35:44.516309+0000","last_peered":"2023-05-11T07:35:44.516309+0000","last_clean":"2023-05-11T07:35:44.516309+0000","last_became_active":"2023-05-11T07:35:40.023100+0000","last_became_peered":"2023-05-11T07:35:40.023100+0000","last_unstale":"2023-05-11T07:35:44.516309+0000","last_undegraded":"2023-05-11T07:35:44.516309+0000","last_fullsized":"2023-05-11T07:35:44.516309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.824139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891965+0000","last_change":"2023-05-11T07:35:44.043637+0000","last_active":"2023-05-11T07:35:46.891965+0000","last_peered":"2023-05-11T07:35:46.891965+0000","last_clean":"2023-05-11T07:35:46.891965+0000","last_became_active":"2023-05-11T07:35:44.043165+0000","last_became_peered":"2023-05-11T07:35:44.043165+0000","last_unstale":"2023-05-11T07:35:46.891965+0000","last_undegraded":"2023-05-11T07:35:46.891965+0000","last_fullsized":"2023-05-11T07:35:46.891965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:49.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518831+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:35:44.518831+0000","last_peered":"2023-05-11T07:35:44.518831+0000","last_clean":"2023-05-11T07:35:44.518831+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:35:44.518831+0000","last_undegraded":"2023-05-11T07:35:44.518831+0000","last_fullsized":"2023-05-11T07:35:44.518831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:50:56.012444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004600+0000","last_change":"2023-05-11T07:35:39.518954+0000","last_active":"2023-05-11T07:35:45.004600+0000","last_peered":"2023-05-11T07:35:45.004600+0000","last_clean":"2023-05-11T07:35:45.004600+0000","last_became_active":"2023-05-11T07:35:39.518679+0000","last_became_peered":"2023-05-11T07:35:39.518679+0000","last_unstale":"2023-05-11T07:35:45.004600+0000","last_undegraded":"2023-05-11T07:35:45.004600+0000","last_fullsized":"2023-05-11T07:35:45.004600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516743+0000","last_change":"2023-05-11T07:35:40.027840+0000","last_active":"2023-05-11T07:35:44.516743+0000","last_peered":"2023-05-11T07:35:44.516743+0000","last_clean":"2023-05-11T07:35:44.516743+0000","last_became_active":"2023-05-11T07:35:40.027601+0000","last_became_peered":"2023-05-11T07:35:40.027601+0000","last_unstale":"2023-05-11T07:35:44.516743+0000","last_undegraded":"2023-05-11T07:35:44.516743+0000","last_fullsized":"2023-05-11T07:35:44.516743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561680+0000","last_change":"2023-05-11T07:35:44.057877+0000","last_active":"2023-05-11T07:35:47.561680+0000","last_peered":"2023-05-11T07:35:47.561680+0000","last_clean":"2023-05-11T07:35:47.561680+0000","last_became_active":"2023-05-11T07:35:44.057419+0000","last_became_peered":"2023-05-11T07:35:44.057419+0000","last_unstale":"2023-05-11T07:35:47.561680+0000","last_undegraded":"2023-05-11T07:35:47.561680+0000","last_fullsized":"2023-05-11T07:35:47.561680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:08:36.688411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561013+0000","last_change":"2023-05-11T07:35:39.520251+0000","last_active":"2023-05-11T07:35:47.561013+0000","last_peered":"2023-05-11T07:35:47.561013+0000","last_clean":"2023-05-11T07:35:47.561013+0000","last_became_active":"2023-05-11T07:35:39.519934+0000","last_became_peered":"2023-05-11T07:35:39.519934+0000","last_unstale":"2023-05-11T07:35:47.561013+0000","last_undegraded":"2023-05-11T07:35:47.561013+0000","last_fullsized":"2023-05-11T07:35:47.561013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:04.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004725+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:35:45.004725+0000","last_peered":"2023-05-11T07:35:45.004725+0000","last_clean":"2023-05-11T07:35:45.004725+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:35:45.004725+0000","last_undegraded":"2023-05-11T07:35:45.004725+0000","last_fullsized":"2023-05-11T07:35:45.004725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:14.281579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561109+0000","last_change":"2023-05-11T07:35:40.019926+0000","last_active":"2023-05-11T07:35:47.561109+0000","last_peered":"2023-05-11T07:35:47.561109+0000","last_clean":"2023-05-11T07:35:47.561109+0000","last_became_active":"2023-05-11T07:35:40.019675+0000","last_became_peered":"2023-05-11T07:35:40.019675+0000","last_unstale":"2023-05-11T07:35:47.561109+0000","last_undegraded":"2023-05-11T07:35:47.561109+0000","last_fullsized":"2023-05-11T07:35:47.561109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560939+0000","last_change":"2023-05-11T07:35:44.043124+0000","last_active":"2023-05-11T07:35:47.560939+0000","last_peered":"2023-05-11T07:35:47.560939+0000","last_clean":"2023-05-11T07:35:47.560939+0000","last_became_active":"2023-05-11T07:35:44.042657+0000","last_became_peered":"2023-05-11T07:35:44.042657+0000","last_unstale":"2023-05-11T07:35:47.560939+0000","last_undegraded":"2023-05-11T07:35:47.560939+0000","last_fullsized":"2023-05-11T07:35:47.560939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:36.711230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891959+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:35:46.891959+0000","last_peered":"2023-05-11T07:35:46.891959+0000","last_clean":"2023-05-11T07:35:46.891959+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:35:46.891959+0000","last_undegraded":"2023-05-11T07:35:46.891959+0000","last_fullsized":"2023-05-11T07:35:46.891959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:55:13.429347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516483+0000","last_change":"2023-05-11T07:35:39.522039+0000","last_active":"2023-05-11T07:35:44.516483+0000","last_peered":"2023-05-11T07:35:44.516483+0000","last_clean":"2023-05-11T07:35:44.516483+0000","last_became_active":"2023-05-11T07:35:39.521457+0000","last_became_peered":"2023-05-11T07:35:39.521457+0000","last_unstale":"2023-05-11T07:35:44.516483+0000","last_undegraded":"2023-05-11T07:35:44.516483+0000","last_fullsized":"2023-05-11T07:35:44.516483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:24.062361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561314+0000","last_change":"2023-05-11T07:35:40.019321+0000","last_active":"2023-05-11T07:35:47.561314+0000","last_peered":"2023-05-11T07:35:47.561314+0000","last_clean":"2023-05-11T07:35:47.561314+0000","last_became_active":"2023-05-11T07:35:40.019071+0000","last_became_peered":"2023-05-11T07:35:40.019071+0000","last_unstale":"2023-05-11T07:35:47.561314+0000","last_undegraded":"2023-05-11T07:35:47.561314+0000","last_fullsized":"2023-05-11T07:35:47.561314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:09.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004624+0000","last_change":"2023-05-11T07:35:44.056475+0000","last_active":"2023-05-11T07:35:45.004624+0000","last_peered":"2023-05-11T07:35:45.004624+0000","last_clean":"2023-05-11T07:35:45.004624+0000","last_became_active":"2023-05-11T07:35:44.056110+0000","last_became_peered":"2023-05-11T07:35:44.056110+0000","last_unstale":"2023-05-11T07:35:45.004624+0000","last_undegraded":"2023-05-11T07:35:45.004624+0000","last_fullsized":"2023-05-11T07:35:45.004624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:54.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516667+0000","last_change":"2023-05-11T07:35:39.525088+0000","last_active":"2023-05-11T07:35:44.516667+0000","last_peered":"2023-05-11T07:35:44.516667+0000","last_clean":"2023-05-11T07:35:44.516667+0000","last_became_active":"2023-05-11T07:35:39.524603+0000","last_became_peered":"2023-05-11T07:35:39.524603+0000","last_unstale":"2023-05-11T07:35:44.516667+0000","last_undegraded":"2023-05-11T07:35:44.516667+0000","last_fullsized":"2023-05-11T07:35:44.516667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089889+0000","last_change":"2023-05-11T07:35:40.008368+0000","last_active":"2023-05-11T07:35:45.089889+0000","last_peered":"2023-05-11T07:35:45.089889+0000","last_clean":"2023-05-11T07:35:45.089889+0000","last_became_active":"2023-05-11T07:35:40.006963+0000","last_became_peered":"2023-05-11T07:35:40.006963+0000","last_unstale":"2023-05-11T07:35:45.089889+0000","last_undegraded":"2023-05-11T07:35:45.089889+0000","last_fullsized":"2023-05-11T07:35:45.089889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:16:58.803321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518483+0000","last_change":"2023-05-11T07:35:44.056975+0000","last_active":"2023-05-11T07:35:44.518483+0000","last_peered":"2023-05-11T07:35:44.518483+0000","last_clean":"2023-05-11T07:35:44.518483+0000","last_became_active":"2023-05-11T07:35:44.056495+0000","last_became_peered":"2023-05-11T07:35:44.056495+0000","last_unstale":"2023-05-11T07:35:44.518483+0000","last_undegraded":"2023-05-11T07:35:44.518483+0000","last_fullsized":"2023-05-11T07:35:44.518483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:53.367006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015252+0000","last_change":"2023-05-11T07:35:39.521916+0000","last_active":"2023-05-11T07:35:45.015252+0000","last_peered":"2023-05-11T07:35:45.015252+0000","last_clean":"2023-05-11T07:35:45.015252+0000","last_became_active":"2023-05-11T07:35:39.521597+0000","last_became_peered":"2023-05-11T07:35:39.521597+0000","last_unstale":"2023-05-11T07:35:45.015252+0000","last_undegraded":"2023-05-11T07:35:45.015252+0000","last_fullsized":"2023-05-11T07:35:45.015252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:34.396540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561427+0000","last_change":"2023-05-11T07:35:40.017540+0000","last_active":"2023-05-11T07:35:47.561427+0000","last_peered":"2023-05-11T07:35:47.561427+0000","last_clean":"2023-05-11T07:35:47.561427+0000","last_became_active":"2023-05-11T07:35:40.016451+0000","last_became_peered":"2023-05-11T07:35:40.016451+0000","last_unstale":"2023-05-11T07:35:47.561427+0000","last_undegraded":"2023-05-11T07:35:47.561427+0000","last_fullsized":"2023-05-11T07:35:47.561427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:44:21.145951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015327+0000","last_change":"2023-05-11T07:35:44.052508+0000","last_active":"2023-05-11T07:35:45.015327+0000","last_peered":"2023-05-11T07:35:45.015327+0000","last_clean":"2023-05-11T07:35:45.015327+0000","last_became_active":"2023-05-11T07:35:44.052017+0000","last_became_peered":"2023-05-11T07:35:44.052017+0000","last_unstale":"2023-05-11T07:35:45.015327+0000","last_undegraded":"2023-05-11T07:35:45.015327+0000","last_fullsized":"2023-05-11T07:35:45.015327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015262+0000","last_change":"2023-05-11T07:35:39.521328+0000","last_active":"2023-05-11T07:35:45.015262+0000","last_peered":"2023-05-11T07:35:45.015262+0000","last_clean":"2023-05-11T07:35:45.015262+0000","last_became_active":"2023-05-11T07:35:39.521000+0000","last_became_peered":"2023-05-11T07:35:39.521000+0000","last_unstale":"2023-05-11T07:35:45.015262+0000","last_undegraded":"2023-05-11T07:35:45.015262+0000","last_fullsized":"2023-05-11T07:35:45.015262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.018737+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.017851+0000","last_became_peered":"2023-05-11T07:35:40.017851+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:34:37.153358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561068+0000","last_change":"2023-05-11T07:35:44.054974+0000","last_active":"2023-05-11T07:35:47.561068+0000","last_peered":"2023-05-11T07:35:47.561068+0000","last_clean":"2023-05-11T07:35:47.561068+0000","last_became_active":"2023-05-11T07:35:44.051992+0000","last_became_peered":"2023-05-11T07:35:44.051992+0000","last_unstale":"2023-05-11T07:35:47.561068+0000","last_undegraded":"2023-05-11T07:35:47.561068+0000","last_fullsized":"2023-05-11T07:35:47.561068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:01:14.299594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561390+0000","last_change":"2023-05-11T07:35:39.517443+0000","last_active":"2023-05-11T07:35:47.561390+0000","last_peered":"2023-05-11T07:35:47.561390+0000","last_clean":"2023-05-11T07:35:47.561390+0000","last_became_active":"2023-05-11T07:35:39.517129+0000","last_became_peered":"2023-05-11T07:35:39.517129+0000","last_unstale":"2023-05-11T07:35:47.561390+0000","last_undegraded":"2023-05-11T07:35:47.561390+0000","last_fullsized":"2023-05-11T07:35:47.561390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:48.847251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561320+0000","last_change":"2023-05-11T07:35:40.006173+0000","last_active":"2023-05-11T07:35:47.561320+0000","last_peered":"2023-05-11T07:35:47.561320+0000","last_clean":"2023-05-11T07:35:47.561320+0000","last_became_active":"2023-05-11T07:35:40.005890+0000","last_became_peered":"2023-05-11T07:35:40.005890+0000","last_unstale":"2023-05-11T07:35:47.561320+0000","last_undegraded":"2023-05-11T07:35:47.561320+0000","last_fullsized":"2023-05-11T07:35:47.561320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:36.177731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004231+0000","last_change":"2023-05-11T07:35:44.049707+0000","last_active":"2023-05-11T07:35:45.004231+0000","last_peered":"2023-05-11T07:35:45.004231+0000","last_clean":"2023-05-11T07:35:45.004231+0000","last_became_active":"2023-05-11T07:35:44.048969+0000","last_became_peered":"2023-05-11T07:35:44.048969+0000","last_unstale":"2023-05-11T07:35:45.004231+0000","last_undegraded":"2023-05-11T07:35:45.004231+0000","last_fullsized":"2023-05-11T07:35:45.004231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:27.337039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516740+0000","last_change":"2023-05-11T07:35:39.524299+0000","last_active":"2023-05-11T07:35:44.516740+0000","last_peered":"2023-05-11T07:35:44.516740+0000","last_clean":"2023-05-11T07:35:44.516740+0000","last_became_active":"2023-05-11T07:35:39.523715+0000","last_became_peered":"2023-05-11T07:35:39.523715+0000","last_unstale":"2023-05-11T07:35:44.516740+0000","last_undegraded":"2023-05-11T07:35:44.516740+0000","last_fullsized":"2023-05-11T07:35:44.516740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:50.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561653+0000","last_change":"2023-05-11T07:35:40.024550+0000","last_active":"2023-05-11T07:35:47.561653+0000","last_peered":"2023-05-11T07:35:47.561653+0000","last_clean":"2023-05-11T07:35:47.561653+0000","last_became_active":"2023-05-11T07:35:40.024275+0000","last_became_peered":"2023-05-11T07:35:40.024275+0000","last_unstale":"2023-05-11T07:35:47.561653+0000","last_undegraded":"2023-05-11T07:35:47.561653+0000","last_fullsized":"2023-05-11T07:35:47.561653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:34:28.815609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891614+0000","last_change":"2023-05-11T07:35:40.006241+0000","last_active":"2023-05-11T07:35:46.891614+0000","last_peered":"2023-05-11T07:35:46.891614+0000","last_clean":"2023-05-11T07:35:46.891614+0000","last_became_active":"2023-05-11T07:35:40.004809+0000","last_became_peered":"2023-05-11T07:35:40.004809+0000","last_unstale":"2023-05-11T07:35:46.891614+0000","last_undegraded":"2023-05-11T07:35:46.891614+0000","last_fullsized":"2023-05-11T07:35:46.891614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:12:57.760117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561474+0000","last_change":"2023-05-11T07:35:40.005112+0000","last_active":"2023-05-11T07:35:47.561474+0000","last_peered":"2023-05-11T07:35:47.561474+0000","last_clean":"2023-05-11T07:35:47.561474+0000","last_became_active":"2023-05-11T07:35:40.004879+0000","last_became_peered":"2023-05-11T07:35:40.004879+0000","last_unstale":"2023-05-11T07:35:47.561474+0000","last_undegraded":"2023-05-11T07:35:47.561474+0000","last_fullsized":"2023-05-11T07:35:47.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561826+0000","last_change":"2023-05-11T07:35:40.025239+0000","last_active":"2023-05-11T07:35:47.561826+0000","last_peered":"2023-05-11T07:35:47.561826+0000","last_clean":"2023-05-11T07:35:47.561826+0000","last_became_active":"2023-05-11T07:35:40.024971+0000","last_became_peered":"2023-05-11T07:35:40.024971+0000","last_unstale":"2023-05-11T07:35:47.561826+0000","last_undegraded":"2023-05-11T07:35:47.561826+0000","last_fullsized":"2023-05-11T07:35:47.561826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:24.724155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561353+0000","last_change":"2023-05-11T07:35:40.021603+0000","last_active":"2023-05-11T07:35:47.561353+0000","last_peered":"2023-05-11T07:35:47.561353+0000","last_clean":"2023-05-11T07:35:47.561353+0000","last_became_active":"2023-05-11T07:35:40.021312+0000","last_became_peered":"2023-05-11T07:35:40.021312+0000","last_unstale":"2023-05-11T07:35:47.561353+0000","last_undegraded":"2023-05-11T07:35:47.561353+0000","last_fullsized":"2023-05-11T07:35:47.561353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004544+0000","last_change":"2023-05-11T07:35:40.017015+0000","last_active":"2023-05-11T07:35:45.004544+0000","last_peered":"2023-05-11T07:35:45.004544+0000","last_clean":"2023-05-11T07:35:45.004544+0000","last_became_active":"2023-05-11T07:35:40.016304+0000","last_became_peered":"2023-05-11T07:35:40.016304+0000","last_unstale":"2023-05-11T07:35:45.004544+0000","last_undegraded":"2023-05-11T07:35:45.004544+0000","last_fullsized":"2023-05-11T07:35:45.004544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:53.819634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.736000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.706}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.933}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.917999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.602}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.311999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.960999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":713999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6959999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7809999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.971}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.919}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.051}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.364000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:36:14.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:36:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.317+0000 7f2f263ff700 1 Processor -- start 2023-05-11T07:36:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.317+0000 7f2f263ff700 1 -- start start 2023-05-11T07:36:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.318+0000 7f2f263ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.318+0000 7f2f263ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f200d02c0 0x7f2f200d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.318+0000 7f2f263ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2015cef0 con 0x7f2f200b87e0 2023-05-11T07:36:14.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.318+0000 7f2f263ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200b5a80 con 0x7f2f200d02c0 2023-05-11T07:36:14.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.318+0000 7f2f263ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200cdf70 con 0x7f2f200b52a0 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f2499c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f2f200d02c0 0x7f2f200d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52492/0 (socket says 172.21.15.144:52492) 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 -- 172.21.15.144:0/946710365 learned_addr learned my addr 172.21.15.144:0/946710365 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1ffff700 1 --1- 172.21.15.144:0/946710365 >> v1:172.21.15.145:6789/0 conn(0x7f2f200b87e0 0x7f2f200b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:59832/0 (socket says 172.21.15.144:59832) 2023-05-11T07:36:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 -- 172.21.15.144:0/946710365 >> v2:172.21.15.145:3300/0 conn(0x7f2f200d02c0 msgr2=0x7f2f200d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 --2- 172.21.15.144:0/946710365 >> v2:172.21.15.145:3300/0 conn(0x7f2f200d02c0 0x7f2f200d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 -- 172.21.15.144:0/946710365 >> v1:172.21.15.145:6789/0 conn(0x7f2f200b87e0 legacy=0x7f2f200b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1effd700 1 -- 172.21.15.144:0/946710365 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920248476 0 0) 0x7f2f10001110 con 0x7f2f200b87e0 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 -- 172.21.15.144:0/946710365 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200cd760 con 0x7f2f200b52a0 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.319+0000 7f2f1f7fe700 1 --2- 172.21.15.144:0/946710365 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f140098f0 tx=0x7f2f14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75433f4f4f01ca6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f1effd700 1 -- 172.21.15.144:0/946710365 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011830 con 0x7f2f200b52a0 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f1effd700 1 -- 172.21.15.144:0/946710365 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14011990 con 0x7f2f200b52a0 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f1effd700 1 -- 172.21.15.144:0/946710365 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14011d20 con 0x7f2f200b52a0 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 -- 172.21.15.144:0/946710365 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 msgr2=0x7f2f200d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 --2- 172.21.15.144:0/946710365 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f140098f0 tx=0x7f2f14009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 -- 172.21.15.144:0/946710365 shutdown_connections 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 --2- 172.21.15.144:0/946710365 >> v2:172.21.15.145:3300/0 conn(0x7f2f200d02c0 0x7f2f200d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 --2- 172.21.15.144:0/946710365 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b52a0 0x7f2f200d2090 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 -- 172.21.15.144:0/946710365 >> 172.21.15.144:0/946710365 conn(0x7f2f2006acf0 msgr2=0x7f2f2006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 -- 172.21.15.144:0/946710365 shutdown_connections 2023-05-11T07:36:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.320+0000 7f2f263ff700 1 -- 172.21.15.144:0/946710365 wait complete. 2023-05-11T07:36:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.322+0000 7f2f263ff700 1 Processor -- start 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.322+0000 7f2f263ff700 1 -- start start 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b87e0 0x7f2f201f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f200d02c0 0x7f2f200c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201f26b0 con 0x7f2f200b52a0 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201f61e0 con 0x7f2f200d02c0 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f263ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201f6460 con 0x7f2f200b87e0 2023-05-11T07:36:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f1ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f1ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41956/0 (socket says 172.21.15.144:41956) 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.323+0000 7f2f1ffff700 1 -- 172.21.15.144:0/3898003411 learned_addr learned my addr 172.21.15.144:0/3898003411 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1f7fe700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b87e0 0x7f2f201f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f2499c700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f200d02c0 0x7f2f200c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 -- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b87e0 msgr2=0x7f2f201f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b87e0 0x7f2f201f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 -- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f200d02c0 msgr2=0x7f2f200c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f200d02c0 0x7f2f200c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 -- 172.21.15.144:0/3898003411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14009550 con 0x7f2f200b52a0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1ffff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c730 tx=0x7f2f1000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10004c80 con 0x7f2f200b52a0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10004e00 con 0x7f2f200b52a0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10007310 con 0x7f2f200b52a0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.324+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f200cd9b0 con 0x7f2f200b52a0 2023-05-11T07:36:14.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.325+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f200d2d30 con 0x7f2f200b52a0 2023-05-11T07:36:14.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.325+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f200cdc90 con 0x7f2f200b52a0 2023-05-11T07:36:14.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.326+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f10007470 con 0x7f2f200b52a0 2023-05-11T07:36:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.327+0000 7f2f1cff9700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 0x7f2f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.327+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f100891e0 con 0x7f2f200b52a0 2023-05-11T07:36:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.327+0000 7f2f1f7fe700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 0x7f2f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.328+0000 7f2f1f7fe700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 0x7f2f0c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f200b5690 tx=0x7f2f14008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.331+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2f10054030 con 0x7f2f200b52a0 2023-05-11T07:36:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.525+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f2015cef0 con 0x7f2f0c06ace0 2023-05-11T07:36:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.535+0000 7f2f1cff9700 1 -- 172.21.15.144:0/3898003411 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367263 (secure 0 0 0) 0x7f2f2015cef0 con 0x7f2f0c06ace0 2023-05-11T07:36:14.543 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.539+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 msgr2=0x7f2f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.539+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 0x7f2f0c06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f200b5690 tx=0x7f2f14008030 comp rx=0 tx=0).stop 2023-05-11T07:36:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.539+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 msgr2=0x7f2f200ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.539+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c730 tx=0x7f2f1000ca40 comp rx=0 tx=0).stop 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 shutdown_connections 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f2f0c06ace0 0x7f2f0c06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f200d02c0 0x7f2f200c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f200b52a0 0x7f2f200ccd30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 --2- 172.21.15.144:0/3898003411 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f2f200b87e0 0x7f2f201f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 >> 172.21.15.144:0/3898003411 conn(0x7f2f2006acf0 msgr2=0x7f2f200b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:14.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 shutdown_connections 2023-05-11T07:36:14.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.540+0000 7f2f263ff700 1 -- 172.21.15.144:0/3898003411 wait complete. 2023-05-11T07:36:14.547 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:36:14.561 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-05-11T07:36:13.721198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67496,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907224,"statfs":{"total":773094113280,"available":773024997376,"internally_reserved":0,"allocated":3579904,"data_stored":2146888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003667"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089760+0000","last_change":"2023-05-11T07:35:40.003263+0000","last_active":"2023-05-11T07:35:45.089760+0000","last_peered":"2023-05-11T07:35:45.089760+0000","last_clean":"2023-05-11T07:35:45.089760+0000","last_became_active":"2023-05-11T07:35:40.002990+0000","last_became_peered":"2023-05-11T07:35:40.002990+0000","last_unstale":"2023-05-11T07:35:45.089760+0000","last_undegraded":"2023-05-11T07:35:45.089760+0000","last_fullsized":"2023-05-11T07:35:45.089760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:47:49.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015531+0000","last_change":"2023-05-11T07:35:40.026566+0000","last_active":"2023-05-11T07:35:45.015531+0000","last_peered":"2023-05-11T07:35:45.015531+0000","last_clean":"2023-05-11T07:35:45.015531+0000","last_became_active":"2023-05-11T07:35:40.026251+0000","last_became_peered":"2023-05-11T07:35:40.026251+0000","last_unstale":"2023-05-11T07:35:45.015531+0000","last_undegraded":"2023-05-11T07:35:45.015531+0000","last_fullsized":"2023-05-11T07:35:45.015531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:55:14.716226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562178+0000","last_change":"2023-05-11T07:35:40.017456+0000","last_active":"2023-05-11T07:35:47.562178+0000","last_peered":"2023-05-11T07:35:47.562178+0000","last_clean":"2023-05-11T07:35:47.562178+0000","last_became_active":"2023-05-11T07:35:40.017116+0000","last_became_peered":"2023-05-11T07:35:40.017116+0000","last_unstale":"2023-05-11T07:35:47.562178+0000","last_undegraded":"2023-05-11T07:35:47.562178+0000","last_fullsized":"2023-05-11T07:35:47.562178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:56.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891706+0000","last_change":"2023-05-11T07:35:40.015700+0000","last_active":"2023-05-11T07:35:46.891706+0000","last_peered":"2023-05-11T07:35:46.891706+0000","last_clean":"2023-05-11T07:35:46.891706+0000","last_became_active":"2023-05-11T07:35:40.015379+0000","last_became_peered":"2023-05-11T07:35:40.015379+0000","last_unstale":"2023-05-11T07:35:46.891706+0000","last_undegraded":"2023-05-11T07:35:46.891706+0000","last_fullsized":"2023-05-11T07:35:46.891706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:18:19.207636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517497+0000","last_change":"2023-05-11T07:35:40.017874+0000","last_active":"2023-05-11T07:35:44.517497+0000","last_peered":"2023-05-11T07:35:44.517497+0000","last_clean":"2023-05-11T07:35:44.517497+0000","last_became_active":"2023-05-11T07:35:40.017633+0000","last_became_peered":"2023-05-11T07:35:40.017633+0000","last_unstale":"2023-05-11T07:35:44.517497+0000","last_undegraded":"2023-05-11T07:35:44.517497+0000","last_fullsized":"2023-05-11T07:35:44.517497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561892+0000","last_change":"2023-05-11T07:35:40.019837+0000","last_active":"2023-05-11T07:35:47.561892+0000","last_peered":"2023-05-11T07:35:47.561892+0000","last_clean":"2023-05-11T07:35:47.561892+0000","last_became_active":"2023-05-11T07:35:40.019582+0000","last_became_peered":"2023-05-11T07:35:40.019582+0000","last_unstale":"2023-05-11T07:35:47.561892+0000","last_undegraded":"2023-05-11T07:35:47.561892+0000","last_fullsized":"2023-05-11T07:35:47.561892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:04:10.251391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518855+0000","last_change":"2023-05-11T07:35:40.019621+0000","last_active":"2023-05-11T07:35:44.518855+0000","last_peered":"2023-05-11T07:35:44.518855+0000","last_clean":"2023-05-11T07:35:44.518855+0000","last_became_active":"2023-05-11T07:35:40.019325+0000","last_became_peered":"2023-05-11T07:35:40.019325+0000","last_unstale":"2023-05-11T07:35:44.518855+0000","last_undegraded":"2023-05-11T07:35:44.518855+0000","last_fullsized":"2023-05-11T07:35:44.518855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:11.547662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014908+0000","last_change":"2023-05-11T07:35:40.026209+0000","last_active":"2023-05-11T07:35:45.014908+0000","last_peered":"2023-05-11T07:35:45.014908+0000","last_clean":"2023-05-11T07:35:45.014908+0000","last_became_active":"2023-05-11T07:35:40.025835+0000","last_became_peered":"2023-05-11T07:35:40.025835+0000","last_unstale":"2023-05-11T07:35:45.014908+0000","last_undegraded":"2023-05-11T07:35:45.014908+0000","last_fullsized":"2023-05-11T07:35:45.014908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:35.384590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516451+0000","last_change":"2023-05-11T07:35:40.027053+0000","last_active":"2023-05-11T07:35:44.516451+0000","last_peered":"2023-05-11T07:35:44.516451+0000","last_clean":"2023-05-11T07:35:44.516451+0000","last_became_active":"2023-05-11T07:35:40.026802+0000","last_became_peered":"2023-05-11T07:35:40.026802+0000","last_unstale":"2023-05-11T07:35:44.516451+0000","last_undegraded":"2023-05-11T07:35:44.516451+0000","last_fullsized":"2023-05-11T07:35:44.516451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015789+0000","last_change":"2023-05-11T07:35:40.028043+0000","last_active":"2023-05-11T07:35:45.015789+0000","last_peered":"2023-05-11T07:35:45.015789+0000","last_clean":"2023-05-11T07:35:45.015789+0000","last_became_active":"2023-05-11T07:35:40.027745+0000","last_became_peered":"2023-05-11T07:35:40.027745+0000","last_unstale":"2023-05-11T07:35:45.015789+0000","last_undegraded":"2023-05-11T07:35:45.015789+0000","last_fullsized":"2023-05-11T07:35:45.015789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:43.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562271+0000","last_change":"2023-05-11T07:35:40.021833+0000","last_active":"2023-05-11T07:35:47.562271+0000","last_peered":"2023-05-11T07:35:47.562271+0000","last_clean":"2023-05-11T07:35:47.562271+0000","last_became_active":"2023-05-11T07:35:40.021555+0000","last_became_peered":"2023-05-11T07:35:40.021555+0000","last_unstale":"2023-05-11T07:35:47.562271+0000","last_undegraded":"2023-05-11T07:35:47.562271+0000","last_fullsized":"2023-05-11T07:35:47.562271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:28.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089711+0000","last_change":"2023-05-11T07:35:40.008540+0000","last_active":"2023-05-11T07:35:45.089711+0000","last_peered":"2023-05-11T07:35:45.089711+0000","last_clean":"2023-05-11T07:35:45.089711+0000","last_became_active":"2023-05-11T07:35:40.008085+0000","last_became_peered":"2023-05-11T07:35:40.008085+0000","last_unstale":"2023-05-11T07:35:45.089711+0000","last_undegraded":"2023-05-11T07:35:45.089711+0000","last_fullsized":"2023-05-11T07:35:45.089711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:02:06.990407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089645+0000","last_change":"2023-05-11T07:35:40.003691+0000","last_active":"2023-05-11T07:35:45.089645+0000","last_peered":"2023-05-11T07:35:45.089645+0000","last_clean":"2023-05-11T07:35:45.089645+0000","last_became_active":"2023-05-11T07:35:40.003340+0000","last_became_peered":"2023-05-11T07:35:40.003340+0000","last_unstale":"2023-05-11T07:35:45.089645+0000","last_undegraded":"2023-05-11T07:35:45.089645+0000","last_fullsized":"2023-05-11T07:35:45.089645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:40.739929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014917+0000","last_change":"2023-05-11T07:35:40.023425+0000","last_active":"2023-05-11T07:35:45.014917+0000","last_peered":"2023-05-11T07:35:45.014917+0000","last_clean":"2023-05-11T07:35:45.014917+0000","last_became_active":"2023-05-11T07:35:40.023149+0000","last_became_peered":"2023-05-11T07:35:40.023149+0000","last_unstale":"2023-05-11T07:35:45.014917+0000","last_undegraded":"2023-05-11T07:35:45.014917+0000","last_fullsized":"2023-05-11T07:35:45.014917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:57.291650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517873+0000","last_change":"2023-05-11T07:35:40.019674+0000","last_active":"2023-05-11T07:35:44.517873+0000","last_peered":"2023-05-11T07:35:44.517873+0000","last_clean":"2023-05-11T07:35:44.517873+0000","last_became_active":"2023-05-11T07:35:40.019341+0000","last_became_peered":"2023-05-11T07:35:40.019341+0000","last_unstale":"2023-05-11T07:35:44.517873+0000","last_undegraded":"2023-05-11T07:35:44.517873+0000","last_fullsized":"2023-05-11T07:35:44.517873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561553+0000","last_change":"2023-05-11T07:35:40.017375+0000","last_active":"2023-05-11T07:35:47.561553+0000","last_peered":"2023-05-11T07:35:47.561553+0000","last_clean":"2023-05-11T07:35:47.561553+0000","last_became_active":"2023-05-11T07:35:40.017066+0000","last_became_peered":"2023-05-11T07:35:40.017066+0000","last_unstale":"2023-05-11T07:35:47.561553+0000","last_undegraded":"2023-05-11T07:35:47.561553+0000","last_fullsized":"2023-05-11T07:35:47.561553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:30:12.395814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516538+0000","last_change":"2023-05-11T07:35:40.028493+0000","last_active":"2023-05-11T07:35:44.516538+0000","last_peered":"2023-05-11T07:35:44.516538+0000","last_clean":"2023-05-11T07:35:44.516538+0000","last_became_active":"2023-05-11T07:35:40.028204+0000","last_became_peered":"2023-05-11T07:35:40.028204+0000","last_unstale":"2023-05-11T07:35:44.516538+0000","last_undegraded":"2023-05-11T07:35:44.516538+0000","last_fullsized":"2023-05-11T07:35:44.516538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:26.521370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562117+0000","last_change":"2023-05-11T07:35:40.014959+0000","last_active":"2023-05-11T07:35:47.562117+0000","last_peered":"2023-05-11T07:35:47.562117+0000","last_clean":"2023-05-11T07:35:47.562117+0000","last_became_active":"2023-05-11T07:35:40.014689+0000","last_became_peered":"2023-05-11T07:35:40.014689+0000","last_unstale":"2023-05-11T07:35:47.562117+0000","last_undegraded":"2023-05-11T07:35:47.562117+0000","last_fullsized":"2023-05-11T07:35:47.562117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:42.131185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089549+0000","last_change":"2023-05-11T07:35:40.001699+0000","last_active":"2023-05-11T07:35:45.089549+0000","last_peered":"2023-05-11T07:35:45.089549+0000","last_clean":"2023-05-11T07:35:45.089549+0000","last_became_active":"2023-05-11T07:35:40.001449+0000","last_became_peered":"2023-05-11T07:35:40.001449+0000","last_unstale":"2023-05-11T07:35:45.089549+0000","last_undegraded":"2023-05-11T07:35:45.089549+0000","last_fullsized":"2023-05-11T07:35:45.089549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:39:10.961995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561455+0000","last_change":"2023-05-11T07:35:40.023713+0000","last_active":"2023-05-11T07:35:47.561455+0000","last_peered":"2023-05-11T07:35:47.561455+0000","last_clean":"2023-05-11T07:35:47.561455+0000","last_became_active":"2023-05-11T07:35:40.023403+0000","last_became_peered":"2023-05-11T07:35:40.023403+0000","last_unstale":"2023-05-11T07:35:47.561455+0000","last_undegraded":"2023-05-11T07:35:47.561455+0000","last_fullsized":"2023-05-11T07:35:47.561455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:51:38.942750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518306+0000","last_change":"2023-05-11T07:35:40.019898+0000","last_active":"2023-05-11T07:35:44.518306+0000","last_peered":"2023-05-11T07:35:44.518306+0000","last_clean":"2023-05-11T07:35:44.518306+0000","last_became_active":"2023-05-11T07:35:40.019650+0000","last_became_peered":"2023-05-11T07:35:40.019650+0000","last_unstale":"2023-05-11T07:35:44.518306+0000","last_undegraded":"2023-05-11T07:35:44.518306+0000","last_fullsized":"2023-05-11T07:35:44.518306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516495+0000","last_change":"2023-05-11T07:35:40.018256+0000","last_active":"2023-05-11T07:35:44.516495+0000","last_peered":"2023-05-11T07:35:44.516495+0000","last_clean":"2023-05-11T07:35:44.516495+0000","last_became_active":"2023-05-11T07:35:40.017973+0000","last_became_peered":"2023-05-11T07:35:40.017973+0000","last_unstale":"2023-05-11T07:35:44.516495+0000","last_undegraded":"2023-05-11T07:35:44.516495+0000","last_fullsized":"2023-05-11T07:35:44.516495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:53.607196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.015426+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.015144+0000","last_became_peered":"2023-05-11T07:35:40.015144+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:15.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518102+0000","last_change":"2023-05-11T07:35:40.029940+0000","last_active":"2023-05-11T07:35:44.518102+0000","last_peered":"2023-05-11T07:35:44.518102+0000","last_clean":"2023-05-11T07:35:44.518102+0000","last_became_active":"2023-05-11T07:35:40.029761+0000","last_became_peered":"2023-05-11T07:35:40.029761+0000","last_unstale":"2023-05-11T07:35:44.518102+0000","last_undegraded":"2023-05-11T07:35:44.518102+0000","last_fullsized":"2023-05-11T07:35:44.518102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004787+0000","last_change":"2023-05-11T07:35:40.016915+0000","last_active":"2023-05-11T07:35:45.004787+0000","last_peered":"2023-05-11T07:35:45.004787+0000","last_clean":"2023-05-11T07:35:45.004787+0000","last_became_active":"2023-05-11T07:35:40.016633+0000","last_became_peered":"2023-05-11T07:35:40.016633+0000","last_unstale":"2023-05-11T07:35:45.004787+0000","last_undegraded":"2023-05-11T07:35:45.004787+0000","last_fullsized":"2023-05-11T07:35:45.004787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:02.978104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004835+0000","last_change":"2023-05-11T07:35:40.014665+0000","last_active":"2023-05-11T07:35:45.004835+0000","last_peered":"2023-05-11T07:35:45.004835+0000","last_clean":"2023-05-11T07:35:45.004835+0000","last_became_active":"2023-05-11T07:35:40.013282+0000","last_became_peered":"2023-05-11T07:35:40.013282+0000","last_unstale":"2023-05-11T07:35:45.004835+0000","last_undegraded":"2023-05-11T07:35:45.004835+0000","last_fullsized":"2023-05-11T07:35:45.004835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015640+0000","last_change":"2023-05-11T07:35:40.028278+0000","last_active":"2023-05-11T07:35:45.015640+0000","last_peered":"2023-05-11T07:35:45.015640+0000","last_clean":"2023-05-11T07:35:45.015640+0000","last_became_active":"2023-05-11T07:35:40.027965+0000","last_became_peered":"2023-05-11T07:35:40.027965+0000","last_unstale":"2023-05-11T07:35:45.015640+0000","last_undegraded":"2023-05-11T07:35:45.015640+0000","last_fullsized":"2023-05-11T07:35:45.015640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:25.486990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561879+0000","last_change":"2023-05-11T07:35:44.058122+0000","last_active":"2023-05-11T07:35:47.561879+0000","last_peered":"2023-05-11T07:35:47.561879+0000","last_clean":"2023-05-11T07:35:47.561879+0000","last_became_active":"2023-05-11T07:35:44.057702+0000","last_became_peered":"2023-05-11T07:35:44.057702+0000","last_unstale":"2023-05-11T07:35:47.561879+0000","last_undegraded":"2023-05-11T07:35:47.561879+0000","last_fullsized":"2023-05-11T07:35:47.561879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:36:05.616117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560688+0000","last_change":"2023-05-11T07:35:39.525251+0000","last_active":"2023-05-11T07:35:47.560688+0000","last_peered":"2023-05-11T07:35:47.560688+0000","last_clean":"2023-05-11T07:35:47.560688+0000","last_became_active":"2023-05-11T07:35:39.523877+0000","last_became_peered":"2023-05-11T07:35:39.523877+0000","last_unstale":"2023-05-11T07:35:47.560688+0000","last_undegraded":"2023-05-11T07:35:47.560688+0000","last_fullsized":"2023-05-11T07:35:47.560688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:53.446198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561824+0000","last_change":"2023-05-11T07:35:40.004593+0000","last_active":"2023-05-11T07:35:47.561824+0000","last_peered":"2023-05-11T07:35:47.561824+0000","last_clean":"2023-05-11T07:35:47.561824+0000","last_became_active":"2023-05-11T07:35:40.004302+0000","last_became_peered":"2023-05-11T07:35:40.004302+0000","last_unstale":"2023-05-11T07:35:47.561824+0000","last_undegraded":"2023-05-11T07:35:47.561824+0000","last_fullsized":"2023-05-11T07:35:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:02.707221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891981+0000","last_change":"2023-05-11T07:35:44.049215+0000","last_active":"2023-05-11T07:35:46.891981+0000","last_peered":"2023-05-11T07:35:46.891981+0000","last_clean":"2023-05-11T07:35:46.891981+0000","last_became_active":"2023-05-11T07:35:44.048856+0000","last_became_peered":"2023-05-11T07:35:44.048856+0000","last_unstale":"2023-05-11T07:35:46.891981+0000","last_undegraded":"2023-05-11T07:35:46.891981+0000","last_fullsized":"2023-05-11T07:35:46.891981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:59:50.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.003945+0000","last_change":"2023-05-11T07:35:39.522351+0000","last_active":"2023-05-11T07:35:45.003945+0000","last_peered":"2023-05-11T07:35:45.003945+0000","last_clean":"2023-05-11T07:35:45.003945+0000","last_became_active":"2023-05-11T07:35:39.522056+0000","last_became_peered":"2023-05-11T07:35:39.522056+0000","last_unstale":"2023-05-11T07:35:45.003945+0000","last_undegraded":"2023-05-11T07:35:45.003945+0000","last_fullsized":"2023-05-11T07:35:45.003945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:47:55.321727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516630+0000","last_change":"2023-05-11T07:35:40.027281+0000","last_active":"2023-05-11T07:35:44.516630+0000","last_peered":"2023-05-11T07:35:44.516630+0000","last_clean":"2023-05-11T07:35:44.516630+0000","last_became_active":"2023-05-11T07:35:40.026683+0000","last_became_peered":"2023-05-11T07:35:40.026683+0000","last_unstale":"2023-05-11T07:35:44.516630+0000","last_undegraded":"2023-05-11T07:35:44.516630+0000","last_fullsized":"2023-05-11T07:35:44.516630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516623+0000","last_change":"2023-05-11T07:35:44.045971+0000","last_active":"2023-05-11T07:35:44.516623+0000","last_peered":"2023-05-11T07:35:44.516623+0000","last_clean":"2023-05-11T07:35:44.516623+0000","last_became_active":"2023-05-11T07:35:44.045617+0000","last_became_peered":"2023-05-11T07:35:44.045617+0000","last_unstale":"2023-05-11T07:35:44.516623+0000","last_undegraded":"2023-05-11T07:35:44.516623+0000","last_fullsized":"2023-05-11T07:35:44.516623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:57.332534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560634+0000","last_change":"2023-05-11T07:35:39.521019+0000","last_active":"2023-05-11T07:35:47.560634+0000","last_peered":"2023-05-11T07:35:47.560634+0000","last_clean":"2023-05-11T07:35:47.560634+0000","last_became_active":"2023-05-11T07:35:39.520725+0000","last_became_peered":"2023-05-11T07:35:39.520725+0000","last_unstale":"2023-05-11T07:35:47.560634+0000","last_undegraded":"2023-05-11T07:35:47.560634+0000","last_fullsized":"2023-05-11T07:35:47.560634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.892105+0000","last_change":"2023-05-11T07:35:40.028356+0000","last_active":"2023-05-11T07:35:46.892105+0000","last_peered":"2023-05-11T07:35:46.892105+0000","last_clean":"2023-05-11T07:35:46.892105+0000","last_became_active":"2023-05-11T07:35:40.028139+0000","last_became_peered":"2023-05-11T07:35:40.028139+0000","last_unstale":"2023-05-11T07:35:46.892105+0000","last_undegraded":"2023-05-11T07:35:46.892105+0000","last_fullsized":"2023-05-11T07:35:46.892105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:09:08.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:44.048081+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:44.047704+0000","last_became_peered":"2023-05-11T07:35:44.047704+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:27.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516590+0000","last_change":"2023-05-11T07:35:39.524366+0000","last_active":"2023-05-11T07:35:44.516590+0000","last_peered":"2023-05-11T07:35:44.516590+0000","last_clean":"2023-05-11T07:35:44.516590+0000","last_became_active":"2023-05-11T07:35:39.523956+0000","last_became_peered":"2023-05-11T07:35:39.523956+0000","last_unstale":"2023-05-11T07:35:44.516590+0000","last_undegraded":"2023-05-11T07:35:44.516590+0000","last_fullsized":"2023-05-11T07:35:44.516590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:49.699791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561237+0000","last_change":"2023-05-11T07:35:40.004665+0000","last_active":"2023-05-11T07:35:47.561237+0000","last_peered":"2023-05-11T07:35:47.561237+0000","last_clean":"2023-05-11T07:35:47.561237+0000","last_became_active":"2023-05-11T07:35:40.004422+0000","last_became_peered":"2023-05-11T07:35:40.004422+0000","last_unstale":"2023-05-11T07:35:47.561237+0000","last_undegraded":"2023-05-11T07:35:47.561237+0000","last_fullsized":"2023-05-11T07:35:47.561237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517909+0000","last_change":"2023-05-11T07:35:44.059577+0000","last_active":"2023-05-11T07:35:44.517909+0000","last_peered":"2023-05-11T07:35:44.517909+0000","last_clean":"2023-05-11T07:35:44.517909+0000","last_became_active":"2023-05-11T07:35:44.058668+0000","last_became_peered":"2023-05-11T07:35:44.058668+0000","last_unstale":"2023-05-11T07:35:44.517909+0000","last_undegraded":"2023-05-11T07:35:44.517909+0000","last_fullsized":"2023-05-11T07:35:44.517909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:06.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015648+0000","last_change":"2023-05-11T07:35:39.516925+0000","last_active":"2023-05-11T07:35:45.015648+0000","last_peered":"2023-05-11T07:35:45.015648+0000","last_clean":"2023-05-11T07:35:45.015648+0000","last_became_active":"2023-05-11T07:35:39.516579+0000","last_became_peered":"2023-05-11T07:35:39.516579+0000","last_unstale":"2023-05-11T07:35:45.015648+0000","last_undegraded":"2023-05-11T07:35:45.015648+0000","last_fullsized":"2023-05-11T07:35:45.015648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:48:28.388729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560769+0000","last_change":"2023-05-11T07:35:40.020195+0000","last_active":"2023-05-11T07:35:47.560769+0000","last_peered":"2023-05-11T07:35:47.560769+0000","last_clean":"2023-05-11T07:35:47.560769+0000","last_became_active":"2023-05-11T07:35:40.020000+0000","last_became_peered":"2023-05-11T07:35:40.020000+0000","last_unstale":"2023-05-11T07:35:47.560769+0000","last_undegraded":"2023-05-11T07:35:47.560769+0000","last_fullsized":"2023-05-11T07:35:47.560769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:20.976357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561713+0000","last_change":"2023-05-11T07:35:44.046341+0000","last_active":"2023-05-11T07:35:47.561713+0000","last_peered":"2023-05-11T07:35:47.561713+0000","last_clean":"2023-05-11T07:35:47.561713+0000","last_became_active":"2023-05-11T07:35:44.045931+0000","last_became_peered":"2023-05-11T07:35:44.045931+0000","last_unstale":"2023-05-11T07:35:47.561713+0000","last_undegraded":"2023-05-11T07:35:47.561713+0000","last_fullsized":"2023-05-11T07:35:47.561713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:43:00.804549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518863+0000","last_change":"2023-05-11T07:35:39.522292+0000","last_active":"2023-05-11T07:35:44.518863+0000","last_peered":"2023-05-11T07:35:44.518863+0000","last_clean":"2023-05-11T07:35:44.518863+0000","last_became_active":"2023-05-11T07:35:39.522044+0000","last_became_peered":"2023-05-11T07:35:39.522044+0000","last_unstale":"2023-05-11T07:35:44.518863+0000","last_undegraded":"2023-05-11T07:35:44.518863+0000","last_fullsized":"2023-05-11T07:35:44.518863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004352+0000","last_change":"2023-05-11T07:35:40.006244+0000","last_active":"2023-05-11T07:35:45.004352+0000","last_peered":"2023-05-11T07:35:45.004352+0000","last_clean":"2023-05-11T07:35:45.004352+0000","last_became_active":"2023-05-11T07:35:40.006008+0000","last_became_peered":"2023-05-11T07:35:40.006008+0000","last_unstale":"2023-05-11T07:35:45.004352+0000","last_undegraded":"2023-05-11T07:35:45.004352+0000","last_fullsized":"2023-05-11T07:35:45.004352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:15:34.274113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004124+0000","last_change":"2023-05-11T07:35:44.050216+0000","last_active":"2023-05-11T07:35:45.004124+0000","last_peered":"2023-05-11T07:35:45.004124+0000","last_clean":"2023-05-11T07:35:45.004124+0000","last_became_active":"2023-05-11T07:35:44.049821+0000","last_became_peered":"2023-05-11T07:35:44.049821+0000","last_unstale":"2023-05-11T07:35:45.004124+0000","last_undegraded":"2023-05-11T07:35:45.004124+0000","last_fullsized":"2023-05-11T07:35:45.004124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:52:59.303972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:58.639060+0000","last_change":"2023-05-11T07:35:39.524270+0000","last_active":"2023-05-11T07:35:58.639060+0000","last_peered":"2023-05-11T07:35:58.639060+0000","last_clean":"2023-05-11T07:35:58.639060+0000","last_became_active":"2023-05-11T07:35:39.523839+0000","last_became_peered":"2023-05-11T07:35:39.523839+0000","last_unstale":"2023-05-11T07:35:58.639060+0000","last_undegraded":"2023-05-11T07:35:58.639060+0000","last_fullsized":"2023-05-11T07:35:58.639060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:22:25.344878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561662+0000","last_change":"2023-05-11T07:35:40.023719+0000","last_active":"2023-05-11T07:35:47.561662+0000","last_peered":"2023-05-11T07:35:47.561662+0000","last_clean":"2023-05-11T07:35:47.561662+0000","last_became_active":"2023-05-11T07:35:40.023383+0000","last_became_peered":"2023-05-11T07:35:40.023383+0000","last_unstale":"2023-05-11T07:35:47.561662+0000","last_undegraded":"2023-05-11T07:35:47.561662+0000","last_fullsized":"2023-05-11T07:35:47.561662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:42.106118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015869+0000","last_change":"2023-05-11T07:35:44.049508+0000","last_active":"2023-05-11T07:35:45.015869+0000","last_peered":"2023-05-11T07:35:45.015869+0000","last_clean":"2023-05-11T07:35:45.015869+0000","last_became_active":"2023-05-11T07:35:44.049065+0000","last_became_peered":"2023-05-11T07:35:44.049065+0000","last_unstale":"2023-05-11T07:35:45.015869+0000","last_undegraded":"2023-05-11T07:35:45.015869+0000","last_fullsized":"2023-05-11T07:35:45.015869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:40.211706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518317+0000","last_change":"2023-05-11T07:35:39.531094+0000","last_active":"2023-05-11T07:35:44.518317+0000","last_peered":"2023-05-11T07:35:44.518317+0000","last_clean":"2023-05-11T07:35:44.518317+0000","last_became_active":"2023-05-11T07:35:39.530798+0000","last_became_peered":"2023-05-11T07:35:39.530798+0000","last_unstale":"2023-05-11T07:35:44.518317+0000","last_undegraded":"2023-05-11T07:35:44.518317+0000","last_fullsized":"2023-05-11T07:35:44.518317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:35.170874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561870+0000","last_change":"2023-05-11T07:35:40.005168+0000","last_active":"2023-05-11T07:35:47.561870+0000","last_peered":"2023-05-11T07:35:47.561870+0000","last_clean":"2023-05-11T07:35:47.561870+0000","last_became_active":"2023-05-11T07:35:40.004912+0000","last_became_peered":"2023-05-11T07:35:40.004912+0000","last_unstale":"2023-05-11T07:35:47.561870+0000","last_undegraded":"2023-05-11T07:35:47.561870+0000","last_fullsized":"2023-05-11T07:35:47.561870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:42.658238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561731+0000","last_change":"2023-05-11T07:35:44.048532+0000","last_active":"2023-05-11T07:35:47.561731+0000","last_peered":"2023-05-11T07:35:47.561731+0000","last_clean":"2023-05-11T07:35:47.561731+0000","last_became_active":"2023-05-11T07:35:44.048154+0000","last_became_peered":"2023-05-11T07:35:44.048154+0000","last_unstale":"2023-05-11T07:35:47.561731+0000","last_undegraded":"2023-05-11T07:35:47.561731+0000","last_fullsized":"2023-05-11T07:35:47.561731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:15.060562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516352+0000","last_change":"2023-05-11T07:35:39.522998+0000","last_active":"2023-05-11T07:35:44.516352+0000","last_peered":"2023-05-11T07:35:44.516352+0000","last_clean":"2023-05-11T07:35:44.516352+0000","last_became_active":"2023-05-11T07:35:39.522721+0000","last_became_peered":"2023-05-11T07:35:39.522721+0000","last_unstale":"2023-05-11T07:35:44.516352+0000","last_undegraded":"2023-05-11T07:35:44.516352+0000","last_fullsized":"2023-05-11T07:35:44.516352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:33.291889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015465+0000","last_change":"2023-05-11T07:35:40.032638+0000","last_active":"2023-05-11T07:35:45.015465+0000","last_peered":"2023-05-11T07:35:45.015465+0000","last_clean":"2023-05-11T07:35:45.015465+0000","last_became_active":"2023-05-11T07:35:40.032296+0000","last_became_peered":"2023-05-11T07:35:40.032296+0000","last_unstale":"2023-05-11T07:35:45.015465+0000","last_undegraded":"2023-05-11T07:35:45.015465+0000","last_fullsized":"2023-05-11T07:35:45.015465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:42:43.821239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562026+0000","last_change":"2023-05-11T07:35:44.048077+0000","last_active":"2023-05-11T07:35:47.562026+0000","last_peered":"2023-05-11T07:35:47.562026+0000","last_clean":"2023-05-11T07:35:47.562026+0000","last_became_active":"2023-05-11T07:35:44.047653+0000","last_became_peered":"2023-05-11T07:35:44.047653+0000","last_unstale":"2023-05-11T07:35:47.562026+0000","last_undegraded":"2023-05-11T07:35:47.562026+0000","last_fullsized":"2023-05-11T07:35:47.562026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517958+0000","last_change":"2023-05-11T07:35:39.529551+0000","last_active":"2023-05-11T07:35:44.517958+0000","last_peered":"2023-05-11T07:35:44.517958+0000","last_clean":"2023-05-11T07:35:44.517958+0000","last_became_active":"2023-05-11T07:35:39.529219+0000","last_became_peered":"2023-05-11T07:35:39.529219+0000","last_unstale":"2023-05-11T07:35:44.517958+0000","last_undegraded":"2023-05-11T07:35:44.517958+0000","last_fullsized":"2023-05-11T07:35:44.517958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:32.191475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516724+0000","last_change":"2023-05-11T07:35:40.027456+0000","last_active":"2023-05-11T07:35:44.516724+0000","last_peered":"2023-05-11T07:35:44.516724+0000","last_clean":"2023-05-11T07:35:44.516724+0000","last_became_active":"2023-05-11T07:35:40.027006+0000","last_became_peered":"2023-05-11T07:35:40.027006+0000","last_unstale":"2023-05-11T07:35:44.516724+0000","last_undegraded":"2023-05-11T07:35:44.516724+0000","last_fullsized":"2023-05-11T07:35:44.516724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:44.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015429+0000","last_change":"2023-05-11T07:35:44.051656+0000","last_active":"2023-05-11T07:35:45.015429+0000","last_peered":"2023-05-11T07:35:45.015429+0000","last_clean":"2023-05-11T07:35:45.015429+0000","last_became_active":"2023-05-11T07:35:44.051177+0000","last_became_peered":"2023-05-11T07:35:44.051177+0000","last_unstale":"2023-05-11T07:35:45.015429+0000","last_undegraded":"2023-05-11T07:35:45.015429+0000","last_fullsized":"2023-05-11T07:35:45.015429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:31:20.083650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891445+0000","last_change":"2023-05-11T07:35:39.525663+0000","last_active":"2023-05-11T07:35:46.891445+0000","last_peered":"2023-05-11T07:35:46.891445+0000","last_clean":"2023-05-11T07:35:46.891445+0000","last_became_active":"2023-05-11T07:35:39.525120+0000","last_became_peered":"2023-05-11T07:35:39.525120+0000","last_unstale":"2023-05-11T07:35:46.891445+0000","last_undegraded":"2023-05-11T07:35:46.891445+0000","last_fullsized":"2023-05-11T07:35:46.891445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:53:41.174416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562065+0000","last_change":"2023-05-11T07:35:40.019244+0000","last_active":"2023-05-11T07:35:47.562065+0000","last_peered":"2023-05-11T07:35:47.562065+0000","last_clean":"2023-05-11T07:35:47.562065+0000","last_became_active":"2023-05-11T07:35:40.018998+0000","last_became_peered":"2023-05-11T07:35:40.018998+0000","last_unstale":"2023-05-11T07:35:47.562065+0000","last_undegraded":"2023-05-11T07:35:47.562065+0000","last_fullsized":"2023-05-11T07:35:47.562065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:35.403397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518703+0000","last_change":"2023-05-11T07:35:44.056854+0000","last_active":"2023-05-11T07:35:44.518703+0000","last_peered":"2023-05-11T07:35:44.518703+0000","last_clean":"2023-05-11T07:35:44.518703+0000","last_became_active":"2023-05-11T07:35:44.056483+0000","last_became_peered":"2023-05-11T07:35:44.056483+0000","last_unstale":"2023-05-11T07:35:44.518703+0000","last_undegraded":"2023-05-11T07:35:44.518703+0000","last_fullsized":"2023-05-11T07:35:44.518703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:38.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518566+0000","last_change":"2023-05-11T07:35:39.529492+0000","last_active":"2023-05-11T07:35:44.518566+0000","last_peered":"2023-05-11T07:35:44.518566+0000","last_clean":"2023-05-11T07:35:44.518566+0000","last_became_active":"2023-05-11T07:35:39.529182+0000","last_became_peered":"2023-05-11T07:35:39.529182+0000","last_unstale":"2023-05-11T07:35:44.518566+0000","last_undegraded":"2023-05-11T07:35:44.518566+0000","last_fullsized":"2023-05-11T07:35:44.518566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:41.677638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014849+0000","last_change":"2023-05-11T07:35:40.029916+0000","last_active":"2023-05-11T07:35:45.014849+0000","last_peered":"2023-05-11T07:35:45.014849+0000","last_clean":"2023-05-11T07:35:45.014849+0000","last_became_active":"2023-05-11T07:35:40.029633+0000","last_became_peered":"2023-05-11T07:35:40.029633+0000","last_unstale":"2023-05-11T07:35:45.014849+0000","last_undegraded":"2023-05-11T07:35:45.014849+0000","last_fullsized":"2023-05-11T07:35:45.014849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089763+0000","last_change":"2023-05-11T07:35:44.046464+0000","last_active":"2023-05-11T07:35:45.089763+0000","last_peered":"2023-05-11T07:35:45.089763+0000","last_clean":"2023-05-11T07:35:45.089763+0000","last_became_active":"2023-05-11T07:35:44.046046+0000","last_became_peered":"2023-05-11T07:35:44.046046+0000","last_unstale":"2023-05-11T07:35:45.089763+0000","last_undegraded":"2023-05-11T07:35:45.089763+0000","last_fullsized":"2023-05-11T07:35:45.089763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:31:21.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518773+0000","last_change":"2023-05-11T07:35:39.529523+0000","last_active":"2023-05-11T07:35:44.518773+0000","last_peered":"2023-05-11T07:35:44.518773+0000","last_clean":"2023-05-11T07:35:44.518773+0000","last_became_active":"2023-05-11T07:35:39.529198+0000","last_became_peered":"2023-05-11T07:35:39.529198+0000","last_unstale":"2023-05-11T07:35:44.518773+0000","last_undegraded":"2023-05-11T07:35:44.518773+0000","last_fullsized":"2023-05-11T07:35:44.518773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:56.284794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561457+0000","last_change":"2023-05-11T07:35:40.021866+0000","last_active":"2023-05-11T07:35:47.561457+0000","last_peered":"2023-05-11T07:35:47.561457+0000","last_clean":"2023-05-11T07:35:47.561457+0000","last_became_active":"2023-05-11T07:35:40.021576+0000","last_became_peered":"2023-05-11T07:35:40.021576+0000","last_unstale":"2023-05-11T07:35:47.561457+0000","last_undegraded":"2023-05-11T07:35:47.561457+0000","last_fullsized":"2023-05-11T07:35:47.561457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:19:05.603259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089718+0000","last_change":"2023-05-11T07:35:44.045836+0000","last_active":"2023-05-11T07:35:45.089718+0000","last_peered":"2023-05-11T07:35:45.089718+0000","last_clean":"2023-05-11T07:35:45.089718+0000","last_became_active":"2023-05-11T07:35:44.045453+0000","last_became_peered":"2023-05-11T07:35:44.045453+0000","last_unstale":"2023-05-11T07:35:45.089718+0000","last_undegraded":"2023-05-11T07:35:45.089718+0000","last_fullsized":"2023-05-11T07:35:45.089718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.845162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518973+0000","last_change":"2023-05-11T07:35:39.526694+0000","last_active":"2023-05-11T07:35:44.518973+0000","last_peered":"2023-05-11T07:35:44.518973+0000","last_clean":"2023-05-11T07:35:44.518973+0000","last_became_active":"2023-05-11T07:35:39.526370+0000","last_became_peered":"2023-05-11T07:35:39.526370+0000","last_unstale":"2023-05-11T07:35:44.518973+0000","last_undegraded":"2023-05-11T07:35:44.518973+0000","last_fullsized":"2023-05-11T07:35:44.518973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:13:59.267692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891488+0000","last_change":"2023-05-11T07:35:40.014209+0000","last_active":"2023-05-11T07:35:46.891488+0000","last_peered":"2023-05-11T07:35:46.891488+0000","last_clean":"2023-05-11T07:35:46.891488+0000","last_became_active":"2023-05-11T07:35:40.013884+0000","last_became_peered":"2023-05-11T07:35:40.013884+0000","last_unstale":"2023-05-11T07:35:46.891488+0000","last_undegraded":"2023-05-11T07:35:46.891488+0000","last_fullsized":"2023-05-11T07:35:46.891488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:49:21.339051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089552+0000","last_change":"2023-05-11T07:35:44.050723+0000","last_active":"2023-05-11T07:35:45.089552+0000","last_peered":"2023-05-11T07:35:45.089552+0000","last_clean":"2023-05-11T07:35:45.089552+0000","last_became_active":"2023-05-11T07:35:44.050285+0000","last_became_peered":"2023-05-11T07:35:44.050285+0000","last_unstale":"2023-05-11T07:35:45.089552+0000","last_undegraded":"2023-05-11T07:35:45.089552+0000","last_fullsized":"2023-05-11T07:35:45.089552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:44:48.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015149+0000","last_change":"2023-05-11T07:35:39.506013+0000","last_active":"2023-05-11T07:35:45.015149+0000","last_peered":"2023-05-11T07:35:45.015149+0000","last_clean":"2023-05-11T07:35:45.015149+0000","last_became_active":"2023-05-11T07:35:39.505714+0000","last_became_peered":"2023-05-11T07:35:39.505714+0000","last_unstale":"2023-05-11T07:35:45.015149+0000","last_undegraded":"2023-05-11T07:35:45.015149+0000","last_fullsized":"2023-05-11T07:35:45.015149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:01.700365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517568+0000","last_change":"2023-05-11T07:35:40.018422+0000","last_active":"2023-05-11T07:35:44.517568+0000","last_peered":"2023-05-11T07:35:44.517568+0000","last_clean":"2023-05-11T07:35:44.517568+0000","last_became_active":"2023-05-11T07:35:40.018159+0000","last_became_peered":"2023-05-11T07:35:40.018159+0000","last_unstale":"2023-05-11T07:35:44.517568+0000","last_undegraded":"2023-05-11T07:35:44.517568+0000","last_fullsized":"2023-05-11T07:35:44.517568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.929812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089716+0000","last_change":"2023-05-11T07:35:44.047834+0000","last_active":"2023-05-11T07:35:45.089716+0000","last_peered":"2023-05-11T07:35:45.089716+0000","last_clean":"2023-05-11T07:35:45.089716+0000","last_became_active":"2023-05-11T07:35:44.047465+0000","last_became_peered":"2023-05-11T07:35:44.047465+0000","last_unstale":"2023-05-11T07:35:45.089716+0000","last_undegraded":"2023-05-11T07:35:45.089716+0000","last_fullsized":"2023-05-11T07:35:45.089716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:59:10.577106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560876+0000","last_change":"2023-05-11T07:35:39.523143+0000","last_active":"2023-05-11T07:35:47.560876+0000","last_peered":"2023-05-11T07:35:47.560876+0000","last_clean":"2023-05-11T07:35:47.560876+0000","last_became_active":"2023-05-11T07:35:39.522833+0000","last_became_peered":"2023-05-11T07:35:39.522833+0000","last_unstale":"2023-05-11T07:35:47.560876+0000","last_undegraded":"2023-05-11T07:35:47.560876+0000","last_fullsized":"2023-05-11T07:35:47.560876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:43.170391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561462+0000","last_change":"2023-05-11T07:35:40.019416+0000","last_active":"2023-05-11T07:35:47.561462+0000","last_peered":"2023-05-11T07:35:47.561462+0000","last_clean":"2023-05-11T07:35:47.561462+0000","last_became_active":"2023-05-11T07:35:40.017783+0000","last_became_peered":"2023-05-11T07:35:40.017783+0000","last_unstale":"2023-05-11T07:35:47.561462+0000","last_undegraded":"2023-05-11T07:35:47.561462+0000","last_fullsized":"2023-05-11T07:35:47.561462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:40.343002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004455+0000","last_change":"2023-05-11T07:35:44.043607+0000","last_active":"2023-05-11T07:35:45.004455+0000","last_peered":"2023-05-11T07:35:45.004455+0000","last_clean":"2023-05-11T07:35:45.004455+0000","last_became_active":"2023-05-11T07:35:44.043204+0000","last_became_peered":"2023-05-11T07:35:44.043204+0000","last_unstale":"2023-05-11T07:35:45.004455+0000","last_undegraded":"2023-05-11T07:35:45.004455+0000","last_fullsized":"2023-05-11T07:35:45.004455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:29:57.120095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891506+0000","last_change":"2023-05-11T07:35:39.520690+0000","last_active":"2023-05-11T07:35:46.891506+0000","last_peered":"2023-05-11T07:35:46.891506+0000","last_clean":"2023-05-11T07:35:46.891506+0000","last_became_active":"2023-05-11T07:35:39.520360+0000","last_became_peered":"2023-05-11T07:35:39.520360+0000","last_unstale":"2023-05-11T07:35:46.891506+0000","last_undegraded":"2023-05-11T07:35:46.891506+0000","last_fullsized":"2023-05-11T07:35:46.891506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:07:45.775424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561931+0000","last_change":"2023-05-11T07:35:40.019241+0000","last_active":"2023-05-11T07:35:47.561931+0000","last_peered":"2023-05-11T07:35:47.561931+0000","last_clean":"2023-05-11T07:35:47.561931+0000","last_became_active":"2023-05-11T07:35:40.018965+0000","last_became_peered":"2023-05-11T07:35:40.018965+0000","last_unstale":"2023-05-11T07:35:47.561931+0000","last_undegraded":"2023-05-11T07:35:47.561931+0000","last_fullsized":"2023-05-11T07:35:47.561931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:05.166289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015716+0000","last_change":"2023-05-11T07:35:44.056735+0000","last_active":"2023-05-11T07:35:45.015716+0000","last_peered":"2023-05-11T07:35:45.015716+0000","last_clean":"2023-05-11T07:35:45.015716+0000","last_became_active":"2023-05-11T07:35:44.056344+0000","last_became_peered":"2023-05-11T07:35:44.056344+0000","last_unstale":"2023-05-11T07:35:45.015716+0000","last_undegraded":"2023-05-11T07:35:45.015716+0000","last_fullsized":"2023-05-11T07:35:45.015716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:05.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560559+0000","last_change":"2023-05-11T07:35:39.521039+0000","last_active":"2023-05-11T07:35:47.560559+0000","last_peered":"2023-05-11T07:35:47.560559+0000","last_clean":"2023-05-11T07:35:47.560559+0000","last_became_active":"2023-05-11T07:35:39.519579+0000","last_became_peered":"2023-05-11T07:35:39.519579+0000","last_unstale":"2023-05-11T07:35:47.560559+0000","last_undegraded":"2023-05-11T07:35:47.560559+0000","last_fullsized":"2023-05-11T07:35:47.560559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:17.898498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562159+0000","last_change":"2023-05-11T07:35:40.024176+0000","last_active":"2023-05-11T07:35:47.562159+0000","last_peered":"2023-05-11T07:35:47.562159+0000","last_clean":"2023-05-11T07:35:47.562159+0000","last_became_active":"2023-05-11T07:35:40.023913+0000","last_became_peered":"2023-05-11T07:35:40.023913+0000","last_unstale":"2023-05-11T07:35:47.562159+0000","last_undegraded":"2023-05-11T07:35:47.562159+0000","last_fullsized":"2023-05-11T07:35:47.562159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:45:40.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.562016+0000","last_change":"2023-05-11T07:35:44.053961+0000","last_active":"2023-05-11T07:35:47.562016+0000","last_peered":"2023-05-11T07:35:47.562016+0000","last_clean":"2023-05-11T07:35:47.562016+0000","last_became_active":"2023-05-11T07:35:44.053562+0000","last_became_peered":"2023-05-11T07:35:44.053562+0000","last_unstale":"2023-05-11T07:35:47.562016+0000","last_undegraded":"2023-05-11T07:35:47.562016+0000","last_fullsized":"2023-05-11T07:35:47.562016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:43:09.942525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560794+0000","last_change":"2023-05-11T07:35:39.519635+0000","last_active":"2023-05-11T07:35:47.560794+0000","last_peered":"2023-05-11T07:35:47.560794+0000","last_clean":"2023-05-11T07:35:47.560794+0000","last_became_active":"2023-05-11T07:35:39.519358+0000","last_became_peered":"2023-05-11T07:35:39.519358+0000","last_unstale":"2023-05-11T07:35:47.560794+0000","last_undegraded":"2023-05-11T07:35:47.560794+0000","last_fullsized":"2023-05-11T07:35:47.560794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004912+0000","last_change":"2023-05-11T07:35:40.005569+0000","last_active":"2023-05-11T07:35:45.004912+0000","last_peered":"2023-05-11T07:35:45.004912+0000","last_clean":"2023-05-11T07:35:45.004912+0000","last_became_active":"2023-05-11T07:35:40.005265+0000","last_became_peered":"2023-05-11T07:35:40.005265+0000","last_unstale":"2023-05-11T07:35:45.004912+0000","last_undegraded":"2023-05-11T07:35:45.004912+0000","last_fullsized":"2023-05-11T07:35:45.004912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:05.664545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516637+0000","last_change":"2023-05-11T07:35:44.044625+0000","last_active":"2023-05-11T07:35:44.516637+0000","last_peered":"2023-05-11T07:35:44.516637+0000","last_clean":"2023-05-11T07:35:44.516637+0000","last_became_active":"2023-05-11T07:35:44.044209+0000","last_became_peered":"2023-05-11T07:35:44.044209+0000","last_unstale":"2023-05-11T07:35:44.516637+0000","last_undegraded":"2023-05-11T07:35:44.516637+0000","last_fullsized":"2023-05-11T07:35:44.516637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:05.083240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004520+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:35:45.004520+0000","last_peered":"2023-05-11T07:35:45.004520+0000","last_clean":"2023-05-11T07:35:45.004520+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:35:45.004520+0000","last_undegraded":"2023-05-11T07:35:45.004520+0000","last_fullsized":"2023-05-11T07:35:45.004520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:32:19.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015475+0000","last_change":"2023-05-11T07:35:39.507928+0000","last_active":"2023-05-11T07:35:45.015475+0000","last_peered":"2023-05-11T07:35:45.015475+0000","last_clean":"2023-05-11T07:35:45.015475+0000","last_became_active":"2023-05-11T07:35:39.507652+0000","last_became_peered":"2023-05-11T07:35:39.507652+0000","last_unstale":"2023-05-11T07:35:45.015475+0000","last_undegraded":"2023-05-11T07:35:45.015475+0000","last_fullsized":"2023-05-11T07:35:45.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:10.367809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004210+0000","last_change":"2023-05-11T07:35:40.023291+0000","last_active":"2023-05-11T07:35:45.004210+0000","last_peered":"2023-05-11T07:35:45.004210+0000","last_clean":"2023-05-11T07:35:45.004210+0000","last_became_active":"2023-05-11T07:35:40.023039+0000","last_became_peered":"2023-05-11T07:35:40.023039+0000","last_unstale":"2023-05-11T07:35:45.004210+0000","last_undegraded":"2023-05-11T07:35:45.004210+0000","last_fullsized":"2023-05-11T07:35:45.004210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:34.298746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516791+0000","last_change":"2023-05-11T07:35:44.056582+0000","last_active":"2023-05-11T07:35:44.516791+0000","last_peered":"2023-05-11T07:35:44.516791+0000","last_clean":"2023-05-11T07:35:44.516791+0000","last_became_active":"2023-05-11T07:35:44.055990+0000","last_became_peered":"2023-05-11T07:35:44.055990+0000","last_unstale":"2023-05-11T07:35:44.516791+0000","last_undegraded":"2023-05-11T07:35:44.516791+0000","last_fullsized":"2023-05-11T07:35:44.516791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:09.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.014983+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:35:45.014983+0000","last_peered":"2023-05-11T07:35:45.014983+0000","last_clean":"2023-05-11T07:35:45.014983+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:35:45.014983+0000","last_undegraded":"2023-05-11T07:35:45.014983+0000","last_fullsized":"2023-05-11T07:35:45.014983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:04.852885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560659+0000","last_change":"2023-05-11T07:35:39.525461+0000","last_active":"2023-05-11T07:35:47.560659+0000","last_peered":"2023-05-11T07:35:47.560659+0000","last_clean":"2023-05-11T07:35:47.560659+0000","last_became_active":"2023-05-11T07:35:39.525087+0000","last_became_peered":"2023-05-11T07:35:39.525087+0000","last_unstale":"2023-05-11T07:35:47.560659+0000","last_undegraded":"2023-05-11T07:35:47.560659+0000","last_fullsized":"2023-05-11T07:35:47.560659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:32:39.463622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004389+0000","last_change":"2023-05-11T07:35:40.015281+0000","last_active":"2023-05-11T07:35:45.004389+0000","last_peered":"2023-05-11T07:35:45.004389+0000","last_clean":"2023-05-11T07:35:45.004389+0000","last_became_active":"2023-05-11T07:35:40.015024+0000","last_became_peered":"2023-05-11T07:35:40.015024+0000","last_unstale":"2023-05-11T07:35:45.004389+0000","last_undegraded":"2023-05-11T07:35:45.004389+0000","last_fullsized":"2023-05-11T07:35:45.004389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:25.069217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089964+0000","last_change":"2023-05-11T07:35:44.051357+0000","last_active":"2023-05-11T07:35:45.089964+0000","last_peered":"2023-05-11T07:35:45.089964+0000","last_clean":"2023-05-11T07:35:45.089964+0000","last_became_active":"2023-05-11T07:35:44.051006+0000","last_became_peered":"2023-05-11T07:35:44.051006+0000","last_unstale":"2023-05-11T07:35:45.089964+0000","last_undegraded":"2023-05-11T07:35:45.089964+0000","last_fullsized":"2023-05-11T07:35:45.089964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:52:35.255028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089456+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:35:45.089456+0000","last_peered":"2023-05-11T07:35:45.089456+0000","last_clean":"2023-05-11T07:35:45.089456+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:35:45.089456+0000","last_undegraded":"2023-05-11T07:35:45.089456+0000","last_fullsized":"2023-05-11T07:35:45.089456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:55:52.663792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004173+0000","last_change":"2023-05-11T07:35:39.519332+0000","last_active":"2023-05-11T07:35:45.004173+0000","last_peered":"2023-05-11T07:35:45.004173+0000","last_clean":"2023-05-11T07:35:45.004173+0000","last_became_active":"2023-05-11T07:35:39.518915+0000","last_became_peered":"2023-05-11T07:35:39.518915+0000","last_unstale":"2023-05-11T07:35:45.004173+0000","last_undegraded":"2023-05-11T07:35:45.004173+0000","last_fullsized":"2023-05-11T07:35:45.004173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004831+0000","last_change":"2023-05-11T07:35:40.029329+0000","last_active":"2023-05-11T07:35:45.004831+0000","last_peered":"2023-05-11T07:35:45.004831+0000","last_clean":"2023-05-11T07:35:45.004831+0000","last_became_active":"2023-05-11T07:35:40.029022+0000","last_became_peered":"2023-05-11T07:35:40.029022+0000","last_unstale":"2023-05-11T07:35:45.004831+0000","last_undegraded":"2023-05-11T07:35:45.004831+0000","last_fullsized":"2023-05-11T07:35:45.004831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518310+0000","last_change":"2023-05-11T07:35:44.049973+0000","last_active":"2023-05-11T07:35:44.518310+0000","last_peered":"2023-05-11T07:35:44.518310+0000","last_clean":"2023-05-11T07:35:44.518310+0000","last_became_active":"2023-05-11T07:35:44.049495+0000","last_became_peered":"2023-05-11T07:35:44.049495+0000","last_unstale":"2023-05-11T07:35:44.518310+0000","last_undegraded":"2023-05-11T07:35:44.518310+0000","last_fullsized":"2023-05-11T07:35:44.518310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:01:18.555450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015274+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:35:45.015274+0000","last_peered":"2023-05-11T07:35:45.015274+0000","last_clean":"2023-05-11T07:35:45.015274+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:35:45.015274+0000","last_undegraded":"2023-05-11T07:35:45.015274+0000","last_fullsized":"2023-05-11T07:35:45.015274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:03:52.797193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.517992+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:35:44.517992+0000","last_peered":"2023-05-11T07:35:44.517992+0000","last_clean":"2023-05-11T07:35:44.517992+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:35:44.517992+0000","last_undegraded":"2023-05-11T07:35:44.517992+0000","last_fullsized":"2023-05-11T07:35:44.517992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:36:52.165838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561588+0000","last_change":"2023-05-11T07:35:39.510017+0000","last_active":"2023-05-11T07:35:47.561588+0000","last_peered":"2023-05-11T07:35:47.561588+0000","last_clean":"2023-05-11T07:35:47.561588+0000","last_became_active":"2023-05-11T07:35:39.509671+0000","last_became_peered":"2023-05-11T07:35:39.509671+0000","last_unstale":"2023-05-11T07:35:47.561588+0000","last_undegraded":"2023-05-11T07:35:47.561588+0000","last_fullsized":"2023-05-11T07:35:47.561588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:34.377733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891878+0000","last_change":"2023-05-11T07:35:40.008915+0000","last_active":"2023-05-11T07:35:46.891878+0000","last_peered":"2023-05-11T07:35:46.891878+0000","last_clean":"2023-05-11T07:35:46.891878+0000","last_became_active":"2023-05-11T07:35:40.008581+0000","last_became_peered":"2023-05-11T07:35:40.008581+0000","last_unstale":"2023-05-11T07:35:46.891878+0000","last_undegraded":"2023-05-11T07:35:46.891878+0000","last_fullsized":"2023-05-11T07:35:46.891878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:40:05.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015471+0000","last_change":"2023-05-11T07:35:44.057326+0000","last_active":"2023-05-11T07:35:45.015471+0000","last_peered":"2023-05-11T07:35:45.015471+0000","last_clean":"2023-05-11T07:35:45.015471+0000","last_became_active":"2023-05-11T07:35:44.056853+0000","last_became_peered":"2023-05-11T07:35:44.056853+0000","last_unstale":"2023-05-11T07:35:45.015471+0000","last_undegraded":"2023-05-11T07:35:45.015471+0000","last_fullsized":"2023-05-11T07:35:45.015471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:23.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518296+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:35:44.518296+0000","last_peered":"2023-05-11T07:35:44.518296+0000","last_clean":"2023-05-11T07:35:44.518296+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:35:44.518296+0000","last_undegraded":"2023-05-11T07:35:44.518296+0000","last_fullsized":"2023-05-11T07:35:44.518296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:17.235034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516272+0000","last_change":"2023-05-11T07:35:39.524833+0000","last_active":"2023-05-11T07:35:44.516272+0000","last_peered":"2023-05-11T07:35:44.516272+0000","last_clean":"2023-05-11T07:35:44.516272+0000","last_became_active":"2023-05-11T07:35:39.524447+0000","last_became_peered":"2023-05-11T07:35:39.524447+0000","last_unstale":"2023-05-11T07:35:44.516272+0000","last_undegraded":"2023-05-11T07:35:44.516272+0000","last_fullsized":"2023-05-11T07:35:44.516272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:03:23.021582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516309+0000","last_change":"2023-05-11T07:35:40.023349+0000","last_active":"2023-05-11T07:35:44.516309+0000","last_peered":"2023-05-11T07:35:44.516309+0000","last_clean":"2023-05-11T07:35:44.516309+0000","last_became_active":"2023-05-11T07:35:40.023100+0000","last_became_peered":"2023-05-11T07:35:40.023100+0000","last_unstale":"2023-05-11T07:35:44.516309+0000","last_undegraded":"2023-05-11T07:35:44.516309+0000","last_fullsized":"2023-05-11T07:35:44.516309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:23.824139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891965+0000","last_change":"2023-05-11T07:35:44.043637+0000","last_active":"2023-05-11T07:35:46.891965+0000","last_peered":"2023-05-11T07:35:46.891965+0000","last_clean":"2023-05-11T07:35:46.891965+0000","last_became_active":"2023-05-11T07:35:44.043165+0000","last_became_peered":"2023-05-11T07:35:44.043165+0000","last_unstale":"2023-05-11T07:35:46.891965+0000","last_undegraded":"2023-05-11T07:35:46.891965+0000","last_fullsized":"2023-05-11T07:35:46.891965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:49.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518831+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:35:44.518831+0000","last_peered":"2023-05-11T07:35:44.518831+0000","last_clean":"2023-05-11T07:35:44.518831+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:35:44.518831+0000","last_undegraded":"2023-05-11T07:35:44.518831+0000","last_fullsized":"2023-05-11T07:35:44.518831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:50:56.012444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004600+0000","last_change":"2023-05-11T07:35:39.518954+0000","last_active":"2023-05-11T07:35:45.004600+0000","last_peered":"2023-05-11T07:35:45.004600+0000","last_clean":"2023-05-11T07:35:45.004600+0000","last_became_active":"2023-05-11T07:35:39.518679+0000","last_became_peered":"2023-05-11T07:35:39.518679+0000","last_unstale":"2023-05-11T07:35:45.004600+0000","last_undegraded":"2023-05-11T07:35:45.004600+0000","last_fullsized":"2023-05-11T07:35:45.004600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:00.563484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516743+0000","last_change":"2023-05-11T07:35:40.027840+0000","last_active":"2023-05-11T07:35:44.516743+0000","last_peered":"2023-05-11T07:35:44.516743+0000","last_clean":"2023-05-11T07:35:44.516743+0000","last_became_active":"2023-05-11T07:35:40.027601+0000","last_became_peered":"2023-05-11T07:35:40.027601+0000","last_unstale":"2023-05-11T07:35:44.516743+0000","last_undegraded":"2023-05-11T07:35:44.516743+0000","last_fullsized":"2023-05-11T07:35:44.516743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:33.198331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561680+0000","last_change":"2023-05-11T07:35:44.057877+0000","last_active":"2023-05-11T07:35:47.561680+0000","last_peered":"2023-05-11T07:35:47.561680+0000","last_clean":"2023-05-11T07:35:47.561680+0000","last_became_active":"2023-05-11T07:35:44.057419+0000","last_became_peered":"2023-05-11T07:35:44.057419+0000","last_unstale":"2023-05-11T07:35:47.561680+0000","last_undegraded":"2023-05-11T07:35:47.561680+0000","last_fullsized":"2023-05-11T07:35:47.561680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:08:36.688411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561013+0000","last_change":"2023-05-11T07:35:39.520251+0000","last_active":"2023-05-11T07:35:47.561013+0000","last_peered":"2023-05-11T07:35:47.561013+0000","last_clean":"2023-05-11T07:35:47.561013+0000","last_became_active":"2023-05-11T07:35:39.519934+0000","last_became_peered":"2023-05-11T07:35:39.519934+0000","last_unstale":"2023-05-11T07:35:47.561013+0000","last_undegraded":"2023-05-11T07:35:47.561013+0000","last_fullsized":"2023-05-11T07:35:47.561013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:37:04.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004725+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:35:45.004725+0000","last_peered":"2023-05-11T07:35:45.004725+0000","last_clean":"2023-05-11T07:35:45.004725+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:35:45.004725+0000","last_undegraded":"2023-05-11T07:35:45.004725+0000","last_fullsized":"2023-05-11T07:35:45.004725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:14.281579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561109+0000","last_change":"2023-05-11T07:35:40.019926+0000","last_active":"2023-05-11T07:35:47.561109+0000","last_peered":"2023-05-11T07:35:47.561109+0000","last_clean":"2023-05-11T07:35:47.561109+0000","last_became_active":"2023-05-11T07:35:40.019675+0000","last_became_peered":"2023-05-11T07:35:40.019675+0000","last_unstale":"2023-05-11T07:35:47.561109+0000","last_undegraded":"2023-05-11T07:35:47.561109+0000","last_fullsized":"2023-05-11T07:35:47.561109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:51.464677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.560939+0000","last_change":"2023-05-11T07:35:44.043124+0000","last_active":"2023-05-11T07:35:47.560939+0000","last_peered":"2023-05-11T07:35:47.560939+0000","last_clean":"2023-05-11T07:35:47.560939+0000","last_became_active":"2023-05-11T07:35:44.042657+0000","last_became_peered":"2023-05-11T07:35:44.042657+0000","last_unstale":"2023-05-11T07:35:47.560939+0000","last_undegraded":"2023-05-11T07:35:47.560939+0000","last_fullsized":"2023-05-11T07:35:47.560939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:47:36.711230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891959+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:35:46.891959+0000","last_peered":"2023-05-11T07:35:46.891959+0000","last_clean":"2023-05-11T07:35:46.891959+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:35:46.891959+0000","last_undegraded":"2023-05-11T07:35:46.891959+0000","last_fullsized":"2023-05-11T07:35:46.891959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:55:13.429347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516483+0000","last_change":"2023-05-11T07:35:39.522039+0000","last_active":"2023-05-11T07:35:44.516483+0000","last_peered":"2023-05-11T07:35:44.516483+0000","last_clean":"2023-05-11T07:35:44.516483+0000","last_became_active":"2023-05-11T07:35:39.521457+0000","last_became_peered":"2023-05-11T07:35:39.521457+0000","last_unstale":"2023-05-11T07:35:44.516483+0000","last_undegraded":"2023-05-11T07:35:44.516483+0000","last_fullsized":"2023-05-11T07:35:44.516483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:41:24.062361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561314+0000","last_change":"2023-05-11T07:35:40.019321+0000","last_active":"2023-05-11T07:35:47.561314+0000","last_peered":"2023-05-11T07:35:47.561314+0000","last_clean":"2023-05-11T07:35:47.561314+0000","last_became_active":"2023-05-11T07:35:40.019071+0000","last_became_peered":"2023-05-11T07:35:40.019071+0000","last_unstale":"2023-05-11T07:35:47.561314+0000","last_undegraded":"2023-05-11T07:35:47.561314+0000","last_fullsized":"2023-05-11T07:35:47.561314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:51:09.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004624+0000","last_change":"2023-05-11T07:35:44.056475+0000","last_active":"2023-05-11T07:35:45.004624+0000","last_peered":"2023-05-11T07:35:45.004624+0000","last_clean":"2023-05-11T07:35:45.004624+0000","last_became_active":"2023-05-11T07:35:44.056110+0000","last_became_peered":"2023-05-11T07:35:44.056110+0000","last_unstale":"2023-05-11T07:35:45.004624+0000","last_undegraded":"2023-05-11T07:35:45.004624+0000","last_fullsized":"2023-05-11T07:35:45.004624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:54.219547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516667+0000","last_change":"2023-05-11T07:35:39.525088+0000","last_active":"2023-05-11T07:35:44.516667+0000","last_peered":"2023-05-11T07:35:44.516667+0000","last_clean":"2023-05-11T07:35:44.516667+0000","last_became_active":"2023-05-11T07:35:39.524603+0000","last_became_peered":"2023-05-11T07:35:39.524603+0000","last_unstale":"2023-05-11T07:35:44.516667+0000","last_undegraded":"2023-05-11T07:35:44.516667+0000","last_fullsized":"2023-05-11T07:35:44.516667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:19:01.971247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.089889+0000","last_change":"2023-05-11T07:35:40.008368+0000","last_active":"2023-05-11T07:35:45.089889+0000","last_peered":"2023-05-11T07:35:45.089889+0000","last_clean":"2023-05-11T07:35:45.089889+0000","last_became_active":"2023-05-11T07:35:40.006963+0000","last_became_peered":"2023-05-11T07:35:40.006963+0000","last_unstale":"2023-05-11T07:35:45.089889+0000","last_undegraded":"2023-05-11T07:35:45.089889+0000","last_fullsized":"2023-05-11T07:35:45.089889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:16:58.803321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.518483+0000","last_change":"2023-05-11T07:35:44.056975+0000","last_active":"2023-05-11T07:35:44.518483+0000","last_peered":"2023-05-11T07:35:44.518483+0000","last_clean":"2023-05-11T07:35:44.518483+0000","last_became_active":"2023-05-11T07:35:44.056495+0000","last_became_peered":"2023-05-11T07:35:44.056495+0000","last_unstale":"2023-05-11T07:35:44.518483+0000","last_undegraded":"2023-05-11T07:35:44.518483+0000","last_fullsized":"2023-05-11T07:35:44.518483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:53.367006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015252+0000","last_change":"2023-05-11T07:35:39.521916+0000","last_active":"2023-05-11T07:35:45.015252+0000","last_peered":"2023-05-11T07:35:45.015252+0000","last_clean":"2023-05-11T07:35:45.015252+0000","last_became_active":"2023-05-11T07:35:39.521597+0000","last_became_peered":"2023-05-11T07:35:39.521597+0000","last_unstale":"2023-05-11T07:35:45.015252+0000","last_undegraded":"2023-05-11T07:35:45.015252+0000","last_fullsized":"2023-05-11T07:35:45.015252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:47:34.396540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561427+0000","last_change":"2023-05-11T07:35:40.017540+0000","last_active":"2023-05-11T07:35:47.561427+0000","last_peered":"2023-05-11T07:35:47.561427+0000","last_clean":"2023-05-11T07:35:47.561427+0000","last_became_active":"2023-05-11T07:35:40.016451+0000","last_became_peered":"2023-05-11T07:35:40.016451+0000","last_unstale":"2023-05-11T07:35:47.561427+0000","last_undegraded":"2023-05-11T07:35:47.561427+0000","last_fullsized":"2023-05-11T07:35:47.561427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:44:21.145951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015327+0000","last_change":"2023-05-11T07:35:44.052508+0000","last_active":"2023-05-11T07:35:45.015327+0000","last_peered":"2023-05-11T07:35:45.015327+0000","last_clean":"2023-05-11T07:35:45.015327+0000","last_became_active":"2023-05-11T07:35:44.052017+0000","last_became_peered":"2023-05-11T07:35:44.052017+0000","last_unstale":"2023-05-11T07:35:45.015327+0000","last_undegraded":"2023-05-11T07:35:45.015327+0000","last_fullsized":"2023-05-11T07:35:45.015327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:14:03.787448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.015262+0000","last_change":"2023-05-11T07:35:39.521328+0000","last_active":"2023-05-11T07:35:45.015262+0000","last_peered":"2023-05-11T07:35:45.015262+0000","last_clean":"2023-05-11T07:35:45.015262+0000","last_became_active":"2023-05-11T07:35:39.521000+0000","last_became_peered":"2023-05-11T07:35:39.521000+0000","last_unstale":"2023-05-11T07:35:45.015262+0000","last_undegraded":"2023-05-11T07:35:45.015262+0000","last_fullsized":"2023-05-11T07:35:45.015262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:41.651382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561189+0000","last_change":"2023-05-11T07:35:40.018737+0000","last_active":"2023-05-11T07:35:47.561189+0000","last_peered":"2023-05-11T07:35:47.561189+0000","last_clean":"2023-05-11T07:35:47.561189+0000","last_became_active":"2023-05-11T07:35:40.017851+0000","last_became_peered":"2023-05-11T07:35:40.017851+0000","last_unstale":"2023-05-11T07:35:47.561189+0000","last_undegraded":"2023-05-11T07:35:47.561189+0000","last_fullsized":"2023-05-11T07:35:47.561189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:34:37.153358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561068+0000","last_change":"2023-05-11T07:35:44.054974+0000","last_active":"2023-05-11T07:35:47.561068+0000","last_peered":"2023-05-11T07:35:47.561068+0000","last_clean":"2023-05-11T07:35:47.561068+0000","last_became_active":"2023-05-11T07:35:44.051992+0000","last_became_peered":"2023-05-11T07:35:44.051992+0000","last_unstale":"2023-05-11T07:35:47.561068+0000","last_undegraded":"2023-05-11T07:35:47.561068+0000","last_fullsized":"2023-05-11T07:35:47.561068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:01:14.299594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561390+0000","last_change":"2023-05-11T07:35:39.517443+0000","last_active":"2023-05-11T07:35:47.561390+0000","last_peered":"2023-05-11T07:35:47.561390+0000","last_clean":"2023-05-11T07:35:47.561390+0000","last_became_active":"2023-05-11T07:35:39.517129+0000","last_became_peered":"2023-05-11T07:35:39.517129+0000","last_unstale":"2023-05-11T07:35:47.561390+0000","last_undegraded":"2023-05-11T07:35:47.561390+0000","last_fullsized":"2023-05-11T07:35:47.561390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:48.847251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561320+0000","last_change":"2023-05-11T07:35:40.006173+0000","last_active":"2023-05-11T07:35:47.561320+0000","last_peered":"2023-05-11T07:35:47.561320+0000","last_clean":"2023-05-11T07:35:47.561320+0000","last_became_active":"2023-05-11T07:35:40.005890+0000","last_became_peered":"2023-05-11T07:35:40.005890+0000","last_unstale":"2023-05-11T07:35:47.561320+0000","last_undegraded":"2023-05-11T07:35:47.561320+0000","last_fullsized":"2023-05-11T07:35:47.561320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:37:36.177731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004231+0000","last_change":"2023-05-11T07:35:44.049707+0000","last_active":"2023-05-11T07:35:45.004231+0000","last_peered":"2023-05-11T07:35:45.004231+0000","last_clean":"2023-05-11T07:35:45.004231+0000","last_became_active":"2023-05-11T07:35:44.048969+0000","last_became_peered":"2023-05-11T07:35:44.048969+0000","last_unstale":"2023-05-11T07:35:45.004231+0000","last_undegraded":"2023-05-11T07:35:45.004231+0000","last_fullsized":"2023-05-11T07:35:45.004231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:43.007750+0000","last_clean_scrub_stamp":"2023-05-11T07:35:43.007750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:14:27.337039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:44.516740+0000","last_change":"2023-05-11T07:35:39.524299+0000","last_active":"2023-05-11T07:35:44.516740+0000","last_peered":"2023-05-11T07:35:44.516740+0000","last_clean":"2023-05-11T07:35:44.516740+0000","last_became_active":"2023-05-11T07:35:39.523715+0000","last_became_peered":"2023-05-11T07:35:39.523715+0000","last_unstale":"2023-05-11T07:35:44.516740+0000","last_undegraded":"2023-05-11T07:35:44.516740+0000","last_fullsized":"2023-05-11T07:35:44.516740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:38.487994+0000","last_clean_scrub_stamp":"2023-05-11T07:35:38.487994+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:48:50.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561653+0000","last_change":"2023-05-11T07:35:40.024550+0000","last_active":"2023-05-11T07:35:47.561653+0000","last_peered":"2023-05-11T07:35:47.561653+0000","last_clean":"2023-05-11T07:35:47.561653+0000","last_became_active":"2023-05-11T07:35:40.024275+0000","last_became_peered":"2023-05-11T07:35:40.024275+0000","last_unstale":"2023-05-11T07:35:47.561653+0000","last_undegraded":"2023-05-11T07:35:47.561653+0000","last_fullsized":"2023-05-11T07:35:47.561653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:34:28.815609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:46.891614+0000","last_change":"2023-05-11T07:35:40.006241+0000","last_active":"2023-05-11T07:35:46.891614+0000","last_peered":"2023-05-11T07:35:46.891614+0000","last_clean":"2023-05-11T07:35:46.891614+0000","last_became_active":"2023-05-11T07:35:40.004809+0000","last_became_peered":"2023-05-11T07:35:40.004809+0000","last_unstale":"2023-05-11T07:35:46.891614+0000","last_undegraded":"2023-05-11T07:35:46.891614+0000","last_fullsized":"2023-05-11T07:35:46.891614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:12:57.760117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561474+0000","last_change":"2023-05-11T07:35:40.005112+0000","last_active":"2023-05-11T07:35:47.561474+0000","last_peered":"2023-05-11T07:35:47.561474+0000","last_clean":"2023-05-11T07:35:47.561474+0000","last_became_active":"2023-05-11T07:35:40.004879+0000","last_became_peered":"2023-05-11T07:35:40.004879+0000","last_unstale":"2023-05-11T07:35:47.561474+0000","last_undegraded":"2023-05-11T07:35:47.561474+0000","last_fullsized":"2023-05-11T07:35:47.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:42.684495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561826+0000","last_change":"2023-05-11T07:35:40.025239+0000","last_active":"2023-05-11T07:35:47.561826+0000","last_peered":"2023-05-11T07:35:47.561826+0000","last_clean":"2023-05-11T07:35:47.561826+0000","last_became_active":"2023-05-11T07:35:40.024971+0000","last_became_peered":"2023-05-11T07:35:40.024971+0000","last_unstale":"2023-05-11T07:35:47.561826+0000","last_undegraded":"2023-05-11T07:35:47.561826+0000","last_fullsized":"2023-05-11T07:35:47.561826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:24.724155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:47.561353+0000","last_change":"2023-05-11T07:35:40.021603+0000","last_active":"2023-05-11T07:35:47.561353+0000","last_peered":"2023-05-11T07:35:47.561353+0000","last_clean":"2023-05-11T07:35:47.561353+0000","last_became_active":"2023-05-11T07:35:40.021312+0000","last_became_peered":"2023-05-11T07:35:40.021312+0000","last_unstale":"2023-05-11T07:35:47.561353+0000","last_undegraded":"2023-05-11T07:35:47.561353+0000","last_fullsized":"2023-05-11T07:35:47.561353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:43:54.755316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T07:35:45.004544+0000","last_change":"2023-05-11T07:35:40.017015+0000","last_active":"2023-05-11T07:35:45.004544+0000","last_peered":"2023-05-11T07:35:45.004544+0000","last_clean":"2023-05-11T07:35:45.004544+0000","last_became_active":"2023-05-11T07:35:40.016304+0000","last_became_peered":"2023-05-11T07:35:40.016304+0000","last_unstale":"2023-05-11T07:35:45.004544+0000","last_undegraded":"2023-05-11T07:35:45.004544+0000","last_fullsized":"2023-05-11T07:35:45.004544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:39.494851+0000","last_clean_scrub_stamp":"2023-05-11T07:35:39.494851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:51:53.819634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.736000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.706}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.933}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.917999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.602}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.311999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.960999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":713999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6959999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7809999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.971}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.919}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.051}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.364000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:36:14.569 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-11T07:36:14.570 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-11T07:36:14.570 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-11T07:36:14.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-11T07:36:14.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.783+0000 7fda861ff700 1 Processor -- start 2023-05-11T07:36:14.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.783+0000 7fda861ff700 1 -- start start 2023-05-11T07:36:14.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda861ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda800b52a0 0x7fda800d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda861ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8015cef0 con 0x7fda800b87e0 2023-05-11T07:36:14.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda861ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda800cd760 con 0x7fda800d02c0 2023-05-11T07:36:14.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda861ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800b5a80 con 0x7fda800b52a0 2023-05-11T07:36:14.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda800b52a0 0x7fda800d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda800b52a0 0x7fda800d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41958/0 (socket says 172.21.15.144:41958) 2023-05-11T07:36:14.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 -- 172.21.15.144:0/2306981411 learned_addr learned my addr 172.21.15.144:0/2306981411 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:14.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 -- 172.21.15.144:0/2306981411 >> v1:172.21.15.145:6789/0 conn(0x7fda800d02c0 legacy=0x7fda800d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 -- 172.21.15.144:0/2306981411 >> v1:172.21.15.144:6789/0 conn(0x7fda800b87e0 legacy=0x7fda800b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.785+0000 7fda77fff700 1 -- 172.21.15.144:0/2306981411 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800d2d30 con 0x7fda800b52a0 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda77fff700 1 --2- 172.21.15.144:0/2306981411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800b52a0 0x7fda800d2090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda680098f0 tx=0x7fda68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33d43cd696b2b12 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda7effd700 1 -- 172.21.15.144:0/2306981411 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6800b8a0 con 0x7fda800b52a0 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda7effd700 1 -- 172.21.15.144:0/2306981411 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6800ba00 con 0x7fda800b52a0 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda7effd700 1 -- 172.21.15.144:0/2306981411 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6800bd90 con 0x7fda800b52a0 2023-05-11T07:36:14.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda861ff700 1 -- 172.21.15.144:0/2306981411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800b52a0 msgr2=0x7fda800d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.786+0000 7fda861ff700 1 --2- 172.21.15.144:0/2306981411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800b52a0 0x7fda800d2090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda680098f0 tx=0x7fda68009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.787+0000 7fda861ff700 1 -- 172.21.15.144:0/2306981411 shutdown_connections 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.787+0000 7fda861ff700 1 --2- 172.21.15.144:0/2306981411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800b52a0 0x7fda800d2090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.787+0000 7fda861ff700 1 -- 172.21.15.144:0/2306981411 >> 172.21.15.144:0/2306981411 conn(0x7fda8006acf0 msgr2=0x7fda8006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.787+0000 7fda861ff700 1 -- 172.21.15.144:0/2306981411 shutdown_connections 2023-05-11T07:36:14.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.787+0000 7fda861ff700 1 -- 172.21.15.144:0/2306981411 wait complete. 2023-05-11T07:36:14.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.789+0000 7fda861ff700 1 Processor -- start 2023-05-11T07:36:14.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.789+0000 7fda861ff700 1 -- start start 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800b52a0 0x7fda80154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 0x7fda800c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801f3ac0 con 0x7fda800d02c0 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800c7be0 con 0x7fda800b87e0 2023-05-11T07:36:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.790+0000 7fda861ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda801f37e0 con 0x7fda800b52a0 2023-05-11T07:36:14.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda77fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 0x7fda800c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41966/0 (socket says 172.21.15.144:41966) 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 -- 172.21.15.144:0/144676237 learned_addr learned my addr 172.21.15.144:0/144676237 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7f7fe700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800b52a0 0x7fda80154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 -- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800b52a0 msgr2=0x7fda80154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800b52a0 0x7fda80154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 -- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 msgr2=0x7fda800c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 0x7fda800c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 -- 172.21.15.144:0/144676237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68009550 con 0x7fda800d02c0 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda77fff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 0x7fda800c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.791+0000 7fda7ffff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda7800cb50 tx=0x7fda7800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.792+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78003c00 con 0x7fda800d02c0 2023-05-11T07:36:14.797 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.792+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78003d60 con 0x7fda800d02c0 2023-05-11T07:36:14.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.792+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800cdc90 con 0x7fda800d02c0 2023-05-11T07:36:14.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.792+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800aa20 con 0x7fda800d02c0 2023-05-11T07:36:14.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.792+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda800cd9b0 con 0x7fda800d02c0 2023-05-11T07:36:14.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.793+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda800b8bb0 con 0x7fda800d02c0 2023-05-11T07:36:14.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.794+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda7800ab80 con 0x7fda800d02c0 2023-05-11T07:36:14.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.794+0000 7fda7cff9700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 0x7fda6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:14.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.795+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda78089790 con 0x7fda800d02c0 2023-05-11T07:36:14.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.795+0000 7fda7f7fe700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 0x7fda6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:14.799 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.795+0000 7fda7f7fe700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 0x7fda6006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda70007fd0 tx=0x7fda70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:14.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:14.799+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fda780544b0 con 0x7fda800d02c0 2023-05-11T07:36:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.037+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda8008b830 con 0x7fda800d02c0 2023-05-11T07:36:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.037+0000 7fda7cff9700 1 -- 172.21.15.144:0/144676237 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fda78057ad0 con 0x7fda800d02c0 2023-05-11T07:36:15.041 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:15.041 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-11T07:36:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 msgr2=0x7fda6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 0x7fda6006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda70007fd0 tx=0x7fda70009040 comp rx=0 tx=0).stop 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 msgr2=0x7fda801e63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda7800cb50 tx=0x7fda7800ce60 comp rx=0 tx=0).stop 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 shutdown_connections 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fda6006ace0 0x7fda6006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fda800b52a0 0x7fda80154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda800d02c0 0x7fda801e63d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 --2- 172.21.15.144:0/144676237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda800b87e0 0x7fda800c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 >> 172.21.15.144:0/144676237 conn(0x7fda8006acf0 msgr2=0x7fda800b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:15.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 shutdown_connections 2023-05-11T07:36:15.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.040+0000 7fda861ff700 1 -- 172.21.15.144:0/144676237 wait complete. 2023-05-11T07:36:15.061 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-11T07:36:15.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.243+0000 7f0e071ff700 1 Processor -- start 2023-05-11T07:36:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.244+0000 7f0e071ff700 1 -- start start 2023-05-11T07:36:15.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000b87e0 0x7f0e000b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0e000d02c0 0x7f0e000b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000d2090 0x7f0e000d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e000b5a80 con 0x7f0e000d2090 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e000cdf70 con 0x7f0e000d02c0 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e071ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000cfe70 con 0x7f0e000b87e0 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e0579c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000d2090 0x7f0e000d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e0579c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000d2090 0x7f0e000d24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41972/0 (socket says 172.21.15.144:41972) 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e0579c700 1 -- 172.21.15.144:0/2329395545 learned_addr learned my addr 172.21.15.144:0/2329395545 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0dfffff700 1 --2- 172.21.15.144:0/2329395545 >> v2:172.21.15.145:3300/0 conn(0x7f0e000d02c0 0x7f0e000b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e04f9b700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000b87e0 0x7f0e000b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.245+0000 7f0e0579c700 1 -- 172.21.15.144:0/2329395545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000b87e0 msgr2=0x7f0e000b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e0579c700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000b87e0 0x7f0e000b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e0579c700 1 -- 172.21.15.144:0/2329395545 >> v2:172.21.15.145:3300/0 conn(0x7f0e000d02c0 msgr2=0x7f0e000b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e0579c700 1 --2- 172.21.15.144:0/2329395545 >> v2:172.21.15.145:3300/0 conn(0x7f0e000d02c0 0x7f0e000b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e0579c700 1 -- 172.21.15.144:0/2329395545 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0015cef0 con 0x7f0e000d2090 2023-05-11T07:36:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e0579c700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e000d24d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e000cffb0 tx=0x7f0df800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae1f3c725125b0e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0dff7fe700 1 -- 172.21.15.144:0/2329395545 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800e070 con 0x7f0e000d2090 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0dff7fe700 1 -- 172.21.15.144:0/2329395545 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8003a20 con 0x7f0e000d2090 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0dff7fe700 1 -- 172.21.15.144:0/2329395545 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8003dd0 con 0x7f0e000d2090 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e071ff700 1 -- 172.21.15.144:0/2329395545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 msgr2=0x7f0e000d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.246+0000 7f0e071ff700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e000d24d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e000cffb0 tx=0x7f0df800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 -- 172.21.15.144:0/2329395545 shutdown_connections 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e000d24d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 --2- 172.21.15.144:0/2329395545 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000b87e0 0x7f0e000b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 --2- 172.21.15.144:0/2329395545 >> v2:172.21.15.145:3300/0 conn(0x7f0e000d02c0 0x7f0e000b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 -- 172.21.15.144:0/2329395545 >> 172.21.15.144:0/2329395545 conn(0x7f0e0006acf0 msgr2=0x7f0e0006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 -- 172.21.15.144:0/2329395545 shutdown_connections 2023-05-11T07:36:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.247+0000 7f0e071ff700 1 -- 172.21.15.144:0/2329395545 wait complete. 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.249+0000 7f0e071ff700 1 Processor -- start 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.249+0000 7f0e071ff700 1 -- start start 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 0x7f0e00151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e0015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c8520 con 0x7f0e000d2090 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00151a60 con 0x7f0e000b87e0 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.250+0000 7f0e071ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c7f60 con 0x7f0e000d02c0 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0e0579c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e0015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0e04f9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 0x7f0e00151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:52534/0 (socket says 172.21.15.144:52534) 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 -- 172.21.15.144:0/1596325100 learned_addr learned my addr 172.21.15.144:0/1596325100 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0e04f9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 0x7f0e00151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:51988/0 (socket says 172.21.15.144:51988) 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 -- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 msgr2=0x7f0e00151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 0x7f0e00151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 -- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 msgr2=0x7f0e0015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e0015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 -- 172.21.15.144:0/1596325100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8009b30 con 0x7f0e000d02c0 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0e0579c700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e0015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.251+0000 7f0dfffff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e9b0 tx=0x7f0dec00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.252+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec009710 con 0x7f0e000d02c0 2023-05-11T07:36:15.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.252+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00ee50 con 0x7f0e000d02c0 2023-05-11T07:36:15.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.252+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000d2d30 con 0x7f0e000d02c0 2023-05-11T07:36:15.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.252+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00ca50 con 0x7f0e000d02c0 2023-05-11T07:36:15.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.252+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e000cd760 con 0x7f0e000d02c0 2023-05-11T07:36:15.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.253+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e000cd9b0 con 0x7f0e000d02c0 2023-05-11T07:36:15.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.254+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dec00cbb0 con 0x7f0e000d02c0 2023-05-11T07:36:15.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.255+0000 7f0dfd7fa700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 0x7f0de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.255+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0dec089800 con 0x7f0e000d02c0 2023-05-11T07:36:15.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.255+0000 7f0e04f9b700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 0x7f0de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.256+0000 7f0e04f9b700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 0x7f0de406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009b60 tx=0x7f0df4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.259+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0dec057fb0 con 0x7f0e000d02c0 2023-05-11T07:36:15.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.455+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e0008b830 con 0x7f0e000d02c0 2023-05-11T07:36:15.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.457+0000 7f0dfd7fa700 1 -- 172.21.15.144:0/1596325100 <== mon.2 v2:172.21.15.145:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f0dec00ce60 con 0x7f0e000d02c0 2023-05-11T07:36:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:15.463 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 msgr2=0x7f0de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 0x7f0de406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009b60 tx=0x7f0df4009210 comp rx=0 tx=0).stop 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 msgr2=0x7f0e000c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e9b0 tx=0x7f0dec00ecc0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 shutdown_connections 2023-05-11T07:36:15.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0de406ace0 0x7f0de406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000d2090 0x7f0e0015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000b87e0 0x7f0e00151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 --2- 172.21.15.144:0/1596325100 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0e000d02c0 0x7f0e000c7610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 >> 172.21.15.144:0/1596325100 conn(0x7f0e0006acf0 msgr2=0x7f0e000b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 shutdown_connections 2023-05-11T07:36:15.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.460+0000 7f0e071ff700 1 -- 172.21.15.144:0/1596325100 wait complete. 2023-05-11T07:36:15.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:15.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.665+0000 7fedbd5ff700 1 Processor -- start 2023-05-11T07:36:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.665+0000 7fedbd5ff700 1 -- start start 2023-05-11T07:36:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedbd5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7fedb815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedbd5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb815de80 con 0x7fedb80cfe00 2023-05-11T07:36:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedbd5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80cf640 con 0x7fedb80d14c0 2023-05-11T07:36:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedbd5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb815cd00 con 0x7fedb815c930 2023-05-11T07:36:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedb67fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fedb80cfe00 0x7fedb80d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40840/0 (socket says 172.21.15.144:40840) 2023-05-11T07:36:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.666+0000 7fedb67fc700 1 -- 172.21.15.144:0/2484505870 learned_addr learned my addr 172.21.15.144:0/2484505870 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:15.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7fedb815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094999547 0 0) 0x7fedb815de80 con 0x7fedb80cfe00 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda00035b0 con 0x7fedb80cfe00 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2464653176 0 0) 0x7feda00035b0 con 0x7fedb80cfe00 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 msgr2=0x7fedb815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7fedb815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 >> v1:172.21.15.145:6789/0 conn(0x7fedb80d14c0 legacy=0x7fedb81604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80cd940 con 0x7fedb80cfe00 2023-05-11T07:36:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fedac001670 con 0x7fedb80cfe00 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 >> v1:172.21.15.144:6789/0 conn(0x7fedb80cfe00 legacy=0x7fedb80d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feda0003a30 0x7feda0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7feda0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda0004d90 0x7feda0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb815cd00 con 0x7feda0003a30 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda000bac0 con 0x7feda0004d90 2023-05-11T07:36:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda000bc00 con 0x7fedb815c930 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feda0003a30 0x7feda0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.667+0000 7fedb67fc700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7feda0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb77fe700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda0004d90 0x7feda0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 -- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 msgr2=0x7feda0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb815c930 0x7feda0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 -- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda0004d90 msgr2=0x7feda0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda0004d90 0x7feda0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 -- 172.21.15.144:0/2484505870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00035b0 con 0x7feda0003a30 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feda0003a30 0x7feda0003e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feda8009b60 tx=0x7feda0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff20f14d9b048262 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800e6c0 con 0x7feda0003a30 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800e820 con 0x7feda0003a30 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.668+0000 7fedb5ffb700 1 -- 172.21.15.144:0/2484505870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800eb90 con 0x7feda0003a30 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 -- 172.21.15.144:0/2484505870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feda0003a30 msgr2=0x7feda0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/2484505870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feda0003a30 0x7feda0003e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feda8009b60 tx=0x7feda0005880 comp rx=0 tx=0).stop 2023-05-11T07:36:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedb77fe700 1 -- 172.21.15.144:0/2484505870 reap_dead start 2023-05-11T07:36:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 -- 172.21.15.144:0/2484505870 shutdown_connections 2023-05-11T07:36:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 -- 172.21.15.144:0/2484505870 >> 172.21.15.144:0/2484505870 conn(0x7fedb8072650 msgr2=0x7fedb806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 -- 172.21.15.144:0/2484505870 shutdown_connections 2023-05-11T07:36:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.669+0000 7fedbd5ff700 1 -- 172.21.15.144:0/2484505870 wait complete. 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.671+0000 7fedbd5ff700 1 Processor -- start 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.671+0000 7fedbd5ff700 1 -- start start 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb81f1490 0x7fedb81e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fedb81f1860 0x7fedb81e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8147810 con 0x7fedb80b4700 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b5460 con 0x7fedb81f1860 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedbd5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8146e70 con 0x7fedb81f1490 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41990/0 (socket says 172.21.15.144:41990) 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 -- 172.21.15.144:0/3656540765 learned_addr learned my addr 172.21.15.144:0/3656540765 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb81f1490 0x7fedb81e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb67fc700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fedb81f1860 0x7fedb81e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 -- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb81f1490 msgr2=0x7fedb81e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb81f1490 0x7fedb81e2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 -- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fedb81f1860 msgr2=0x7fedb81e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fedb81f1860 0x7fedb81e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.672+0000 7fedb77fe700 1 -- 172.21.15.144:0/3656540765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80cf8e0 con 0x7fedb80b4700 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fedb77fe700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedb8066ac0 tx=0x7fedb000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003c10 con 0x7fedb80b4700 2023-05-11T07:36:15.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0003db0 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80cdc20 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000db20 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.673+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80cdf00 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.674+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8147950 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.675+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedb000dc80 con 0x7fedb80b4700 2023-05-11T07:36:15.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.676+0000 7fed9f7fe700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 0x7feda406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:15.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.676+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fedb0089aa0 con 0x7fedb80b4700 2023-05-11T07:36:15.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.676+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 0x7feda406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:15.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.676+0000 7fedb6ffd700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 0x7feda406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda8000c00 tx=0x7feda801f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:15.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.680+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fedb8147950 con 0x7fedb80b4700 2023-05-11T07:36:15.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.876+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedb8147950 con 0x7fedb80b4700 2023-05-11T07:36:15.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.877+0000 7fed9f7fe700 1 -- 172.21.15.144:0/3656540765 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedb8147950 con 0x7fedb80b4700 2023-05-11T07:36:15.881 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 msgr2=0x7feda406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 0x7feda406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda8000c00 tx=0x7feda801f040 comp rx=0 tx=0).stop 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 msgr2=0x7fedb80b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedb8066ac0 tx=0x7fedb000d430 comp rx=0 tx=0).stop 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 shutdown_connections 2023-05-11T07:36:15.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feda406ace0 0x7feda406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fedb81f1490 0x7fedb81e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedb80b4700 0x7fedb80b4b70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 --2- 172.21.15.144:0/3656540765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fedb81f1860 0x7fedb81e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 >> 172.21.15.144:0/3656540765 conn(0x7feda0003a30 msgr2=0x7fedb815be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 shutdown_connections 2023-05-11T07:36:15.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:15.879+0000 7fedbd5ff700 1 -- 172.21.15.144:0/3656540765 wait complete. 2023-05-11T07:36:15.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:16.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.088+0000 7f0914fff700 1 Processor -- start 2023-05-11T07:36:16.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.089+0000 7f0914fff700 1 -- start start 2023-05-11T07:36:16.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f0914fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 0x7f09100cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f0914fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091015e200 con 0x7f09101599e0 2023-05-11T07:36:16.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f0914fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100b1020 con 0x7f09100b0720 2023-05-11T07:36:16.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f0914fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091015a100 con 0x7f09100b0bc0 2023-05-11T07:36:16.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f090e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f09101599e0 0x7f09100c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48156/0 (socket says 172.21.15.144:48156) 2023-05-11T07:36:16.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.090+0000 7f090e59c700 1 -- 172.21.15.144:0/1915439740 learned_addr learned my addr 172.21.15.144:0/1915439740 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:16.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090ed9d700 1 --2- 172.21.15.144:0/1915439740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 0x7f09100cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060861815 0 0) 0x7f091015e200 con 0x7f09101599e0 2023-05-11T07:36:16.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc0035b0 con 0x7f09101599e0 2023-05-11T07:36:16.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882425652 0 0) 0x7f09100b1020 con 0x7f09100b0720 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f091015e200 con 0x7f09100b0720 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090ed9d700 1 -- 172.21.15.144:0/1915439740 >> v1:172.21.15.145:6789/0 conn(0x7f09100b0720 legacy=0x7f09100ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090ed9d700 1 -- 172.21.15.144:0/1915439740 >> v1:172.21.15.144:6789/0 conn(0x7f09101599e0 legacy=0x7f09100c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278032370 0 0) 0x7f08fc0035b0 con 0x7f09101599e0 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.091+0000 7f090ed9d700 1 -- 172.21.15.144:0/1915439740 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091015a3e0 con 0x7f09100b0bc0 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f090ed9d700 1 --2- 172.21.15.144:0/1915439740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 0x7f09100cd5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0908009dc0 tx=0x7f090800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8243a03bc28d14dc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090800e070 con 0x7f09100b0bc0 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908003a20 con 0x7f09100b0bc0 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f090dd9b700 1 -- 172.21.15.144:0/1915439740 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900001670 con 0x7f09100b0bc0 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 -- 172.21.15.144:0/1915439740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 msgr2=0x7f09100cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 --2- 172.21.15.144:0/1915439740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 0x7f09100cd5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0908009dc0 tx=0x7f090800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 -- 172.21.15.144:0/1915439740 shutdown_connections 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 --2- 172.21.15.144:0/1915439740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0bc0 0x7f09100cd5f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 -- 172.21.15.144:0/1915439740 >> 172.21.15.144:0/1915439740 conn(0x7f09100cb720 msgr2=0x7f09100cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.092+0000 7f0914fff700 1 -- 172.21.15.144:0/1915439740 shutdown_connections 2023-05-11T07:36:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.093+0000 7f0914fff700 1 -- 172.21.15.144:0/1915439740 wait complete. 2023-05-11T07:36:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.095+0000 7f0914fff700 1 Processor -- start 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.095+0000 7f0914fff700 1 -- start start 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0720 0x7f0910157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09101599e0 0x7f0910070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910157840 con 0x7f09100b0bc0 2023-05-11T07:36:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910157ac0 con 0x7f09101599e0 2023-05-11T07:36:16.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0914fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910157da0 con 0x7f09100b0720 2023-05-11T07:36:16.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0907fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0907fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35220/0 (socket says 172.21.15.144:35220) 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f090ed9d700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09101599e0 0x7f0910070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f090e59c700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0720 0x7f0910157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.096+0000 7f0907fff700 1 -- 172.21.15.144:0/1237406128 learned_addr learned my addr 172.21.15.144:0/1237406128 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 -- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0720 msgr2=0x7f0910157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0720 0x7f0910157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 -- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09101599e0 msgr2=0x7f0910070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09101599e0 0x7f0910070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 -- 172.21.15.144:0/1237406128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908009a70 con 0x7f09100b0bc0 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0907fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c520 tx=0x7f08f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80052d0 con 0x7f09100b0bc0 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8005430 con 0x7f09100b0bc0 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.097+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091015a9a0 con 0x7f09100b0bc0 2023-05-11T07:36:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.098+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80038c0 con 0x7f09100b0bc0 2023-05-11T07:36:16.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.098+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091015a6c0 con 0x7f09100b0bc0 2023-05-11T07:36:16.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.099+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0910159db0 con 0x7f09100b0bc0 2023-05-11T07:36:16.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.100+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08f8003a20 con 0x7f09100b0bc0 2023-05-11T07:36:16.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.100+0000 7f0906ffd700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 0x7f08f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.100+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08f8088c00 con 0x7f09100b0bc0 2023-05-11T07:36:16.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.101+0000 7f090e59c700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 0x7f08f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.101+0000 7f090e59c700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 0x7f08f006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0900001380 tx=0x7f0900007be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.105+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f08f80539b0 con 0x7f09100b0bc0 2023-05-11T07:36:16.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.297+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09100b1700 con 0x7f09100b0bc0 2023-05-11T07:36:16.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.297+0000 7f0906ffd700 1 -- 172.21.15.144:0/1237406128 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08f8017020 con 0x7f09100b0bc0 2023-05-11T07:36:16.301 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 msgr2=0x7f08f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 0x7f08f006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0900001380 tx=0x7f0900007be0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 msgr2=0x7f091014c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c520 tx=0x7f08f800c830 comp rx=0 tx=0).stop 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 shutdown_connections 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f08f006ace0 0x7f08f006d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09100b0720 0x7f0910157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09101599e0 0x7f0910070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 --2- 172.21.15.144:0/1237406128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09100b0bc0 0x7f091014c640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 >> 172.21.15.144:0/1237406128 conn(0x7f09100cb720 msgr2=0x7f09100ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:16.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 shutdown_connections 2023-05-11T07:36:16.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.300+0000 7f0914fff700 1 -- 172.21.15.144:0/1237406128 wait complete. 2023-05-11T07:36:16.320 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.504+0000 7f1770fff700 1 Processor -- start 2023-05-11T07:36:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.505+0000 7f1770fff700 1 -- start start 2023-05-11T07:36:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176c15c940 0x7f176c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f176c0b5fd0 0x7f176c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c0b6420 0x7f176c06b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c161420 con 0x7f176c15c940 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0d0e80 con 0x7f176c0b5fd0 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.506+0000 7f1770fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0cdb00 con 0x7f176c0b6420 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176c15c940 0x7f176c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f176c15c940 0x7f176c160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35228/0 (socket says 172.21.15.144:35228) 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 -- 172.21.15.144:0/3390520542 learned_addr learned my addr 172.21.15.144:0/3390520542 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f1763fff700 1 --2- 172.21.15.144:0/3390520542 >> v2:172.21.15.145:3300/0 conn(0x7f176c0b5fd0 0x7f176c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176ad9d700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c0b6420 0x7f176c06b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 -- 172.21.15.144:0/3390520542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c0b6420 msgr2=0x7f176c06b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c0b6420 0x7f176c06b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 -- 172.21.15.144:0/3390520542 >> v2:172.21.15.145:3300/0 conn(0x7f176c0b5fd0 msgr2=0x7f176c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 --2- 172.21.15.144:0/3390520542 >> v2:172.21.15.145:3300/0 conn(0x7f176c0b5fd0 0x7f176c06ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 -- 172.21.15.144:0/3390520542 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0cdde0 con 0x7f176c15c940 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.507+0000 7f176a59c700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c15c940 0x7f176c160ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f176c0d3e60 tx=0x7f175c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2187ec633f41a34f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1769d9b700 1 -- 172.21.15.144:0/3390520542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011830 con 0x7f176c15c940 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1769d9b700 1 -- 172.21.15.144:0/3390520542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c011990 con 0x7f176c15c940 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1769d9b700 1 -- 172.21.15.144:0/3390520542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011d20 con 0x7f176c15c940 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 -- 172.21.15.144:0/3390520542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c15c940 msgr2=0x7f176c160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c15c940 0x7f176c160ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f176c0d3e60 tx=0x7f175c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 -- 172.21.15.144:0/3390520542 shutdown_connections 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c0b6420 0x7f176c06b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 --2- 172.21.15.144:0/3390520542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c15c940 0x7f176c160ee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 --2- 172.21.15.144:0/3390520542 >> v2:172.21.15.145:3300/0 conn(0x7f176c0b5fd0 0x7f176c06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 -- 172.21.15.144:0/3390520542 >> 172.21.15.144:0/3390520542 conn(0x7f176c0d3180 msgr2=0x7f176c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 -- 172.21.15.144:0/3390520542 shutdown_connections 2023-05-11T07:36:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.508+0000 7f1770fff700 1 -- 172.21.15.144:0/3390520542 wait complete. 2023-05-11T07:36:16.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.510+0000 7f1770fff700 1 Processor -- start 2023-05-11T07:36:16.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.510+0000 7f1770fff700 1 -- start start 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176c0b6420 0x7f176c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c15c940 0x7f176c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0ca960 con 0x7f176c0b5fd0 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0cac40 con 0x7f176c0b6420 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.511+0000 7f1770fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0caf20 con 0x7f176c15c940 2023-05-11T07:36:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35238/0 (socket says 172.21.15.144:35238) 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 -- 172.21.15.144:0/76403270 learned_addr learned my addr 172.21.15.144:0/76403270 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f1763fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176c0b6420 0x7f176c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176ad9d700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c15c940 0x7f176c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 -- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c15c940 msgr2=0x7f176c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c15c940 0x7f176c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 -- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176c0b6420 msgr2=0x7f176c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176c0b6420 0x7f176c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 -- 172.21.15.144:0/76403270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009550 con 0x7f176c0b5fd0 2023-05-11T07:36:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.512+0000 7f176a59c700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f175c009c10 tx=0x7f175c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.514+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c004450 con 0x7f176c0b5fd0 2023-05-11T07:36:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.515+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c01e070 con 0x7f176c0b5fd0 2023-05-11T07:36:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.515+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0d1400 con 0x7f176c0b5fd0 2023-05-11T07:36:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.515+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0038e0 con 0x7f176c0b5fd0 2023-05-11T07:36:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.515+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0d1120 con 0x7f176c0b5fd0 2023-05-11T07:36:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.516+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c15cd10 con 0x7f176c0b5fd0 2023-05-11T07:36:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.517+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f175c003a40 con 0x7f176c0b5fd0 2023-05-11T07:36:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.517+0000 7f1762ffd700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 0x7f174c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.518+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f175c08a4c0 con 0x7f176c0b5fd0 2023-05-11T07:36:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.518+0000 7f1763fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 0x7f174c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.518+0000 7f1763fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 0x7f174c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f176c0b5660 tx=0x7f1754009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.522+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f175c055290 con 0x7f176c0b5fd0 2023-05-11T07:36:16.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.715+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f176c0744c0 con 0x7f176c0b5fd0 2023-05-11T07:36:16.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.715+0000 7f1762ffd700 1 -- 172.21.15.144:0/76403270 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f175c0588b0 con 0x7f176c0b5fd0 2023-05-11T07:36:16.719 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:16.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 msgr2=0x7f174c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 0x7f174c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f176c0b5660 tx=0x7f1754009210 comp rx=0 tx=0).stop 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 msgr2=0x7f176c155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f175c009c10 tx=0x7f175c004750 comp rx=0 tx=0).stop 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 shutdown_connections 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f174c06ace0 0x7f174c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f176c15c940 0x7f176c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f176c0b5fd0 0x7f176c155640 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 --2- 172.21.15.144:0/76403270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f176c0b6420 0x7f176c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 >> 172.21.15.144:0/76403270 conn(0x7f176c0d3180 msgr2=0x7f176c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:16.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 shutdown_connections 2023-05-11T07:36:16.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.718+0000 7f1770fff700 1 -- 172.21.15.144:0/76403270 wait complete. 2023-05-11T07:36:16.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:16.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.921+0000 7f4b2c5ff700 1 Processor -- start 2023-05-11T07:36:16.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.922+0000 7f4b2c5ff700 1 -- start start 2023-05-11T07:36:16.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2c5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 0x7f4b240d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2c5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240d0e80 con 0x7f4b2415c940 2023-05-11T07:36:16.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2c5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240cdb00 con 0x7f4b24160ee0 2023-05-11T07:36:16.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2c5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cdde0 con 0x7f4b2406b350 2023-05-11T07:36:16.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2a39b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b2415c940 0x7f4b240b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48158/0 (socket says 172.21.15.144:48158) 2023-05-11T07:36:16.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2a39b700 1 -- 172.21.15.144:0/3073417527 learned_addr learned my addr 172.21.15.144:0/3073417527 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:16.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b2ab9c700 1 --2- 172.21.15.144:0/3073417527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 0x7f4b240d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511009313 0 0) 0x7f4b240d0e80 con 0x7f4b2415c940 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.923+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b100035b0 con 0x7f4b2415c940 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b2ab9c700 1 -- 172.21.15.144:0/3073417527 >> v1:172.21.15.145:6789/0 conn(0x7f4b24160ee0 legacy=0x7f4b2406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708150026 0 0) 0x7f4b240cdb00 con 0x7f4b24160ee0 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b2ab9c700 1 -- 172.21.15.144:0/3073417527 >> v1:172.21.15.144:6789/0 conn(0x7f4b2415c940 legacy=0x7f4b240b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b2ab9c700 1 -- 172.21.15.144:0/3073417527 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240d1120 con 0x7f4b2406b350 2023-05-11T07:36:16.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b2ab9c700 1 --2- 172.21.15.144:0/3073417527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 0x7f4b240d1920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009dc0 tx=0x7f4b1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9539326567807eb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00e070 con 0x7f4b2406b350 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00bb20 con 0x7f4b2406b350 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.924+0000 7f4b29399700 1 -- 172.21.15.144:0/3073417527 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00bed0 con 0x7f4b2406b350 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3073417527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 msgr2=0x7f4b240d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3073417527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 0x7f4b240d1920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009dc0 tx=0x7f4b1c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3073417527 shutdown_connections 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3073417527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b2406b350 0x7f4b240d1920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3073417527 >> 172.21.15.144:0/3073417527 conn(0x7f4b240d3180 msgr2=0x7f4b240d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:16.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3073417527 shutdown_connections 2023-05-11T07:36:16.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.925+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3073417527 wait complete. 2023-05-11T07:36:16.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.926+0000 7f4b2c5ff700 1 Processor -- start 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 -- start start 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b2406b350 0x7f4b241548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b24160ee0 0x7f4b240ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cad30 con 0x7f4b2415c940 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cb010 con 0x7f4b2406b350 2023-05-11T07:36:16.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.927+0000 7f4b2c5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cb2f0 con 0x7f4b24160ee0 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35246/0 (socket says 172.21.15.144:35246) 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 -- 172.21.15.144:0/3898090170 learned_addr learned my addr 172.21.15.144:0/3898090170 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b2a39b700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b2406b350 0x7f4b241548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b2ab9c700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b24160ee0 0x7f4b240ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 -- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b24160ee0 msgr2=0x7f4b240ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b24160ee0 0x7f4b240ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 -- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b2406b350 msgr2=0x7f4b241548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b2406b350 0x7f4b241548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 -- 172.21.15.144:0/3898090170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009a70 con 0x7f4b2415c940 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.928+0000 7f4b29b9a700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c550 tx=0x7f4b1400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.929+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140054e0 con 0x7f4b2415c940 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.929+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14003680 con 0x7f4b2415c940 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.929+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b240b66e0 con 0x7f4b2415c940 2023-05-11T07:36:16.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.929+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14003a30 con 0x7f4b2415c940 2023-05-11T07:36:16.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.929+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240d1400 con 0x7f4b2415c940 2023-05-11T07:36:16.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.930+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24161330 con 0x7f4b2415c940 2023-05-11T07:36:16.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.931+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b14003b90 con 0x7f4b2415c940 2023-05-11T07:36:16.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.932+0000 7f4b1affd700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 0x7f4b0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:16.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.932+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b14088b40 con 0x7f4b2415c940 2023-05-11T07:36:16.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.932+0000 7f4b2a39b700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 0x7f4b0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:16.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.932+0000 7f4b2a39b700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 0x7f4b0806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b20007fd0 tx=0x7f4b20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:16.936+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4b14053860 con 0x7f4b2415c940 2023-05-11T07:36:17.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.129+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b240744c0 con 0x7f4b2415c940 2023-05-11T07:36:17.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.130+0000 7f4b1affd700 1 -- 172.21.15.144:0/3898090170 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b140170a0 con 0x7f4b2415c940 2023-05-11T07:36:17.134 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 msgr2=0x7f4b0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 0x7f4b0806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b20007fd0 tx=0x7f4b20009040 comp rx=0 tx=0).stop 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 msgr2=0x7f4b240cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c550 tx=0x7f4b1400c860 comp rx=0 tx=0).stop 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 shutdown_connections 2023-05-11T07:36:17.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4b0806ace0 0x7f4b0806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4b24160ee0 0x7f4b240ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4b2406b350 0x7f4b241548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 --2- 172.21.15.144:0/3898090170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b2415c940 0x7f4b240cbdd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 >> 172.21.15.144:0/3898090170 conn(0x7f4b240d3180 msgr2=0x7f4b240b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 shutdown_connections 2023-05-11T07:36:17.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.132+0000 7f4b2c5ff700 1 -- 172.21.15.144:0/3898090170 wait complete. 2023-05-11T07:36:17.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:17.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.337+0000 7f9538bff700 1 Processor -- start 2023-05-11T07:36:17.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.337+0000 7f9538bff700 1 -- start start 2023-05-11T07:36:17.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f9538bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f953406b350 0x7f95340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f9538bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340d0e80 con 0x7f953415c940 2023-05-11T07:36:17.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f9538bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340cdb00 con 0x7f9534160ee0 2023-05-11T07:36:17.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f9538bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340cdde0 con 0x7f953406b350 2023-05-11T07:36:17.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f953259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f953415c940 0x7f95340b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48172/0 (socket says 172.21.15.144:48172) 2023-05-11T07:36:17.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.338+0000 7f953259c700 1 -- 172.21.15.144:0/4166219098 learned_addr learned my addr 172.21.15.144:0/4166219098 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:17.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f9532d9d700 1 --2- 172.21.15.144:0/4166219098 >> v2:172.21.15.145:3300/0 conn(0x7f953406b350 0x7f95340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693580212 0 0) 0x7f95340d0e80 con 0x7f953415c940 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f951c0035b0 con 0x7f953415c940 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027912512 0 0) 0x7f95340cdb00 con 0x7f9534160ee0 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95340d0e80 con 0x7f9534160ee0 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f9532d9d700 1 -- 172.21.15.144:0/4166219098 >> v1:172.21.15.145:6789/0 conn(0x7f9534160ee0 legacy=0x7f953406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f9532d9d700 1 -- 172.21.15.144:0/4166219098 >> v1:172.21.15.144:6789/0 conn(0x7f953415c940 legacy=0x7f95340b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f9532d9d700 1 -- 172.21.15.144:0/4166219098 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340d1120 con 0x7f953406b350 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.339+0000 7f9532d9d700 1 --2- 172.21.15.144:0/4166219098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f953406b350 0x7f95340d1920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f952c009d90 tx=0x7f952c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f2cae72a068b6b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00e070 con 0x7f953406b350 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00bb20 con 0x7f953406b350 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f953159a700 1 -- 172.21.15.144:0/4166219098 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c012430 con 0x7f953406b350 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 -- 172.21.15.144:0/4166219098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f953406b350 msgr2=0x7f95340d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 --2- 172.21.15.144:0/4166219098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f953406b350 0x7f95340d1920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f952c009d90 tx=0x7f952c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:17.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 -- 172.21.15.144:0/4166219098 shutdown_connections 2023-05-11T07:36:17.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 --2- 172.21.15.144:0/4166219098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f953406b350 0x7f95340d1920 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 -- 172.21.15.144:0/4166219098 >> 172.21.15.144:0/4166219098 conn(0x7f95340d3180 msgr2=0x7f95340d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:17.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 -- 172.21.15.144:0/4166219098 shutdown_connections 2023-05-11T07:36:17.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.340+0000 7f9538bff700 1 -- 172.21.15.144:0/4166219098 wait complete. 2023-05-11T07:36:17.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.342+0000 7f9538bff700 1 Processor -- start 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.342+0000 7f9538bff700 1 -- start start 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f953415c940 0x7f95340ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9534160ee0 0x7f95340cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953415da30 con 0x7f953406b350 2023-05-11T07:36:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953415cdb0 con 0x7f9534160ee0 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f9538bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953415d090 con 0x7f953415c940 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f953259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f953259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35248/0 (socket says 172.21.15.144:35248) 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.343+0000 7f953259c700 1 -- 172.21.15.144:0/2218654705 learned_addr learned my addr 172.21.15.144:0/2218654705 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 -- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f953415c940 msgr2=0x7f95340ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f953415c940 0x7f95340ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 -- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9534160ee0 msgr2=0x7f95340cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9534160ee0 0x7f95340cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 -- 172.21.15.144:0/2218654705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c009a70 con 0x7f953406b350 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f953259c700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f952400c700 tx=0x7f952400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524005d70 con 0x7f953406b350 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95240070d0 con 0x7f953406b350 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95340b66e0 con 0x7f953406b350 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524007480 con 0x7f953406b350 2023-05-11T07:36:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.344+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95340d1400 con 0x7f953406b350 2023-05-11T07:36:17.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.345+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9534161330 con 0x7f953406b350 2023-05-11T07:36:17.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.346+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95240075e0 con 0x7f953406b350 2023-05-11T07:36:17.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.347+0000 7f9522ffd700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.347+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9524089250 con 0x7f953406b350 2023-05-11T07:36:17.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.347+0000 7f9531d9b700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.348+0000 7f9531d9b700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 0x7f951406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95280010e0 tx=0x7f95280079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.350+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9524054000 con 0x7f953406b350 2023-05-11T07:36:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.544+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95340744c0 con 0x7f953406b350 2023-05-11T07:36:17.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.544+0000 7f9522ffd700 1 -- 172.21.15.144:0/2218654705 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9524057620 con 0x7f953406b350 2023-05-11T07:36:17.548 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:17.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 msgr2=0x7f951406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 0x7f951406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f95280010e0 tx=0x7f95280079e0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 msgr2=0x7f95340b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f952400c700 tx=0x7f952400cac0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 shutdown_connections 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9534160ee0 0x7f95340cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f953406b350 0x7f95340b7bc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 --2- 172.21.15.144:0/2218654705 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f953415c940 0x7f95340ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 >> 172.21.15.144:0/2218654705 conn(0x7f95340d3180 msgr2=0x7f953415a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:17.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 shutdown_connections 2023-05-11T07:36:17.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.547+0000 7f9538bff700 1 -- 172.21.15.144:0/2218654705 wait complete. 2023-05-11T07:36:17.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:36:17.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.749+0000 7ff174dff700 1 Processor -- start 2023-05-11T07:36:17.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.749+0000 7ff174dff700 1 -- start start 2023-05-11T07:36:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.750+0000 7ff174dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 0x7ff1700d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.750+0000 7ff174dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17015cef0 con 0x7ff1700d02c0 2023-05-11T07:36:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.750+0000 7ff174dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1700cd760 con 0x7ff1700b87e0 2023-05-11T07:36:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.750+0000 7ff174dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700b5a80 con 0x7ff1700b52a0 2023-05-11T07:36:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff1700d02c0 0x7ff1700d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48188/0 (socket says 172.21.15.144:48188) 2023-05-11T07:36:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16ed9d700 1 -- 172.21.15.144:0/1051924165 learned_addr learned my addr 172.21.15.144:0/1051924165 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff167fff700 1 --2- 172.21.15.144:0/1051924165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 0x7ff1700d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331354757 0 0) 0x7ff168001490 con 0x7ff1700d02c0 2023-05-11T07:36:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c0035b0 con 0x7ff1700d02c0 2023-05-11T07:36:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116875040 0 0) 0x7ff1700cd760 con 0x7ff1700b87e0 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff168001490 con 0x7ff1700b87e0 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff167fff700 1 -- 172.21.15.144:0/1051924165 >> v1:172.21.15.145:6789/0 conn(0x7ff1700b87e0 legacy=0x7ff1700b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff167fff700 1 -- 172.21.15.144:0/1051924165 >> v1:172.21.15.144:6789/0 conn(0x7ff1700d02c0 legacy=0x7ff1700d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.751+0000 7ff167fff700 1 -- 172.21.15.144:0/1051924165 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700d2d30 con 0x7ff1700b52a0 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff167fff700 1 --2- 172.21.15.144:0/1051924165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 0x7ff1700d2090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff158009870 tx=0x7ff158009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1de3713809f179 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011830 con 0x7ff1700b52a0 2023-05-11T07:36:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158011990 con 0x7ff1700b52a0 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff16dd9b700 1 -- 172.21.15.144:0/1051924165 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011d00 con 0x7ff1700b52a0 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff174dff700 1 -- 172.21.15.144:0/1051924165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 msgr2=0x7ff1700d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff174dff700 1 --2- 172.21.15.144:0/1051924165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 0x7ff1700d2090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff158009870 tx=0x7ff158009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff174dff700 1 -- 172.21.15.144:0/1051924165 shutdown_connections 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.752+0000 7ff174dff700 1 --2- 172.21.15.144:0/1051924165 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b52a0 0x7ff1700d2090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.753+0000 7ff174dff700 1 -- 172.21.15.144:0/1051924165 >> 172.21.15.144:0/1051924165 conn(0x7ff17006acf0 msgr2=0x7ff17006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.753+0000 7ff174dff700 1 -- 172.21.15.144:0/1051924165 shutdown_connections 2023-05-11T07:36:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.753+0000 7ff174dff700 1 -- 172.21.15.144:0/1051924165 wait complete. 2023-05-11T07:36:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.754+0000 7ff174dff700 1 Processor -- start 2023-05-11T07:36:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.754+0000 7ff174dff700 1 -- start start 2023-05-11T07:36:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b87e0 0x7ff170145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1700d02c0 0x7ff1700cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170144700 con 0x7ff1700b52a0 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701449e0 con 0x7ff1700d02c0 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.755+0000 7ff174dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff170144cc0 con 0x7ff1700b87e0 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35250/0 (socket says 172.21.15.144:35250) 2023-05-11T07:36:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 -- 172.21.15.144:0/136393295 learned_addr learned my addr 172.21.15.144:0/136393295 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16ed9d700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1700d02c0 0x7ff1700cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff167fff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b87e0 0x7ff170145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 -- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b87e0 msgr2=0x7ff170145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b87e0 0x7ff170145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 -- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1700d02c0 msgr2=0x7ff1700cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1700d02c0 0x7ff1700cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 -- 172.21.15.144:0/136393295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580094a0 con 0x7ff1700b52a0 2023-05-11T07:36:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.756+0000 7ff16e59c700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c520 tx=0x7ff16000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.757+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600052d0 con 0x7ff1700b52a0 2023-05-11T07:36:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.757+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160005430 con 0x7ff1700b52a0 2023-05-11T07:36:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.757+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600038c0 con 0x7ff1700b52a0 2023-05-11T07:36:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.757+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1700cdc90 con 0x7ff1700b52a0 2023-05-11T07:36:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.757+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1700cd9b0 con 0x7ff1700b52a0 2023-05-11T07:36:17.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.758+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1700b8bb0 con 0x7ff1700b52a0 2023-05-11T07:36:17.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.759+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff160003a20 con 0x7ff1700b52a0 2023-05-11T07:36:17.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.759+0000 7ff166ffd700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 0x7ff15006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:17.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.760+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff160088cc0 con 0x7ff1700b52a0 2023-05-11T07:36:17.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.760+0000 7ff167fff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 0x7ff15006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:17.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.760+0000 7ff167fff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 0x7ff15006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1700b5690 tx=0x7ff158008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:17.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:17.764+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff16008f080 con 0x7ff1700b52a0 2023-05-11T07:36:18.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.002+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1700b2a60 con 0x7ff1700b52a0 2023-05-11T07:36:18.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.002+0000 7ff166ffd700 1 -- 172.21.15.144:0/136393295 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7ff160017020 con 0x7ff1700b52a0 2023-05-11T07:36:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:18.006 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:36:18.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 msgr2=0x7ff15006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 0x7ff15006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1700b5690 tx=0x7ff158008030 comp rx=0 tx=0).stop 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 msgr2=0x7ff1701457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c520 tx=0x7ff16000c830 comp rx=0 tx=0).stop 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 shutdown_connections 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff15006ad10 0x7ff15006d1c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1700d02c0 0x7ff1700cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1700b52a0 0x7ff1701457a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 --2- 172.21.15.144:0/136393295 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff1700b87e0 0x7ff170145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 >> 172.21.15.144:0/136393295 conn(0x7ff17006acf0 msgr2=0x7ff1700b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 shutdown_connections 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.005+0000 7ff174dff700 1 -- 172.21.15.144:0/136393295 wait complete. 2023-05-11T07:36:18.010 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:36:18.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.207+0000 7fee951ff700 1 Processor -- start 2023-05-11T07:36:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.207+0000 7fee951ff700 1 -- start start 2023-05-11T07:36:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee951ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee900b52a0 0x7fee900d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee951ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee900d02c0 0x7fee900d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee951ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9015cef0 con 0x7fee900b87e0 2023-05-11T07:36:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee951ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900b5a80 con 0x7fee900d02c0 2023-05-11T07:36:18.212 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee951ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900cdf70 con 0x7fee900b52a0 2023-05-11T07:36:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee8ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fee900b87e0 0x7fee900b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48196/0 (socket says 172.21.15.144:48196) 2023-05-11T07:36:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.208+0000 7fee8ed9d700 1 -- 172.21.15.144:0/3345884916 learned_addr learned my addr 172.21.15.144:0/3345884916 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 --2- 172.21.15.144:0/3345884916 >> v2:172.21.15.144:3300/0 conn(0x7fee900d02c0 0x7fee900d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8e59c700 1 --2- 172.21.15.144:0/3345884916 >> v2:172.21.15.145:3300/0 conn(0x7fee900b52a0 0x7fee900d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 -- 172.21.15.144:0/3345884916 >> v2:172.21.15.145:3300/0 conn(0x7fee900b52a0 msgr2=0x7fee900d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:18.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 --2- 172.21.15.144:0/3345884916 >> v2:172.21.15.145:3300/0 conn(0x7fee900b52a0 0x7fee900d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 -- 172.21.15.144:0/3345884916 >> v1:172.21.15.144:6789/0 conn(0x7fee900b87e0 legacy=0x7fee900b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 -- 172.21.15.144:0/3345884916 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900cd760 con 0x7fee900d02c0 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8f59e700 1 --2- 172.21.15.144:0/3345884916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d02c0 0x7fee900d25d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee9008c0a0 tx=0x7fee8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8e6d706d2fa7c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8dd9b700 1 -- 172.21.15.144:0/3345884916 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800e070 con 0x7fee900d02c0 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8dd9b700 1 -- 172.21.15.144:0/3345884916 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800bb20 con 0x7fee900d02c0 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.209+0000 7fee8dd9b700 1 -- 172.21.15.144:0/3345884916 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88012430 con 0x7fee900d02c0 2023-05-11T07:36:18.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 -- 172.21.15.144:0/3345884916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d02c0 msgr2=0x7fee900d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 --2- 172.21.15.144:0/3345884916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d02c0 0x7fee900d25d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee9008c0a0 tx=0x7fee8800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 -- 172.21.15.144:0/3345884916 shutdown_connections 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 --2- 172.21.15.144:0/3345884916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d02c0 0x7fee900d25d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 --2- 172.21.15.144:0/3345884916 >> v2:172.21.15.145:3300/0 conn(0x7fee900b52a0 0x7fee900d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 -- 172.21.15.144:0/3345884916 >> 172.21.15.144:0/3345884916 conn(0x7fee9006acf0 msgr2=0x7fee9006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:18.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 -- 172.21.15.144:0/3345884916 shutdown_connections 2023-05-11T07:36:18.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.210+0000 7fee951ff700 1 -- 172.21.15.144:0/3345884916 wait complete. 2023-05-11T07:36:18.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.212+0000 7fee951ff700 1 Processor -- start 2023-05-11T07:36:18.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.212+0000 7fee951ff700 1 -- start start 2023-05-11T07:36:18.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee900b52a0 0x7fee90155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee900d02c0 0x7fee900c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90155eb0 con 0x7fee900b87e0 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9014e030 con 0x7fee900d02c0 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee951ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900ca9d0 con 0x7fee900b52a0 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35276/0 (socket says 172.21.15.144:35276) 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8e59c700 1 -- 172.21.15.144:0/2013537678 learned_addr learned my addr 172.21.15.144:0/2013537678 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8ed9d700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee900b52a0 0x7fee90155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8f59e700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee900d02c0 0x7fee900c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8e59c700 1 -- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee900b52a0 msgr2=0x7fee90155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.213+0000 7fee8e59c700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee900b52a0 0x7fee90155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee8e59c700 1 -- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee900d02c0 msgr2=0x7fee900c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee8e59c700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee900d02c0 0x7fee900c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee8e59c700 1 -- 172.21.15.144:0/2013537678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009a70 con 0x7fee900b87e0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee8e59c700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee8400e9b0 tx=0x7fee8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400c7f0 con 0x7fee900b87e0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400c950 con 0x7fee900b87e0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400ccc0 con 0x7fee900b87e0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee900cd9b0 con 0x7fee900b87e0 2023-05-11T07:36:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.214+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee900d2d30 con 0x7fee900b87e0 2023-05-11T07:36:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.215+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee900cdc90 con 0x7fee900b87e0 2023-05-11T07:36:18.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.216+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee84013470 con 0x7fee900b87e0 2023-05-11T07:36:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.217+0000 7fee777fe700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 0x7fee7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.217+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee840898a0 con 0x7fee900b87e0 2023-05-11T07:36:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.217+0000 7fee8ed9d700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 0x7fee7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.218+0000 7fee8ed9d700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 0x7fee7c06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee80005910 tx=0x7fee80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.222+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fee84054660 con 0x7fee900b87e0 2023-05-11T07:36:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.413+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee900ca1c0 con 0x7fee900b87e0 2023-05-11T07:36:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.415+0000 7fee777fe700 1 -- 172.21.15.144:0/2013537678 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fee84057c80 con 0x7fee900b87e0 2023-05-11T07:36:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:18.419 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:35:44.511892+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 msgr2=0x7fee7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 0x7fee7c06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee80005910 tx=0x7fee80009040 comp rx=0 tx=0).stop 2023-05-11T07:36:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 msgr2=0x7fee901f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee8400e9b0 tx=0x7fee8400ed70 comp rx=0 tx=0).stop 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 shutdown_connections 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee7c06ace0 0x7fee7c06d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee900b52a0 0x7fee90155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee900d02c0 0x7fee900c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 --2- 172.21.15.144:0/2013537678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900b87e0 0x7fee901f1c60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.417+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 >> 172.21.15.144:0/2013537678 conn(0x7fee9006acf0 msgr2=0x7fee900b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.418+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 shutdown_connections 2023-05-11T07:36:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.418+0000 7fee951ff700 1 -- 172.21.15.144:0/2013537678 wait complete. 2023-05-11T07:36:18.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:18.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:18.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.623+0000 7f5f5b5ff700 1 Processor -- start 2023-05-11T07:36:18.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.624+0000 7f5f5b5ff700 1 -- start start 2023-05-11T07:36:18.628 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f5b5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.628 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f5b5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f540ccee0 0x7f5f540cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f5b5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5415e200 con 0x7f5f541599e0 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f5b5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540b10d0 con 0x7f5f540ccee0 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f5b5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5415a100 con 0x7f5f540b0720 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f540ccee0 0x7f5f540cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f540ccee0 0x7f5f540cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35282/0 (socket says 172.21.15.144:35282) 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 -- 172.21.15.144:0/3014527331 learned_addr learned my addr 172.21.15.144:0/3014527331 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:18.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f58b9a700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 -- 172.21.15.144:0/3014527331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 msgr2=0x7f5f540b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 -- 172.21.15.144:0/3014527331 >> v1:172.21.15.145:6789/0 conn(0x7f5f541599e0 legacy=0x7f5f540c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.625+0000 7f5f59b9c700 1 -- 172.21.15.144:0/3014527331 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5415a3e0 con 0x7f5f540ccee0 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f59b9c700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f540cd340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009e50 tx=0x7f5f4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c971a257e0ef548f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f4bfff700 1 -- 172.21.15.144:0/3014527331 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00e070 con 0x7f5f540ccee0 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f4bfff700 1 -- 172.21.15.144:0/3014527331 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00b910 con 0x7f5f540ccee0 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f4bfff700 1 -- 172.21.15.144:0/3014527331 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00bcc0 con 0x7f5f540ccee0 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/3014527331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 msgr2=0x7f5f540cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f540cd340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009e50 tx=0x7f5f4c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/3014527331 shutdown_connections 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f540cd340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/3014527331 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.626+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/3014527331 >> 172.21.15.144:0/3014527331 conn(0x7f5f540cb720 msgr2=0x7f5f540cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:18.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.627+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/3014527331 shutdown_connections 2023-05-11T07:36:18.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.627+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/3014527331 wait complete. 2023-05-11T07:36:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.628+0000 7f5f5b5ff700 1 Processor -- start 2023-05-11T07:36:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.628+0000 7f5f5b5ff700 1 -- start start 2023-05-11T07:36:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f541599e0 0x7f5f540c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f7480 con 0x7f5f540ccee0 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f6ec0 con 0x7f5f541599e0 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.629+0000 7f5f5b5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f71a0 con 0x7f5f540b0720 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35292/0 (socket says 172.21.15.144:35292) 2023-05-11T07:36:18.636 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 -- 172.21.15.144:0/1872409777 learned_addr learned my addr 172.21.15.144:0/1872409777 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f5939b700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f59b9c700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f541599e0 0x7f5f540c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 -- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 msgr2=0x7f5f540713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 -- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f541599e0 msgr2=0x7f5f540c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f541599e0 0x7f5f540c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.637 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 -- 172.21.15.144:0/1872409777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c009b30 con 0x7f5f540ccee0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f5939b700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f58b9a700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9b0 tx=0x7f5f4400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44009710 con 0x7f5f540ccee0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400c850 con 0x7f5f540ccee0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400cbc0 con 0x7f5f540ccee0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.630+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5415a9a0 con 0x7f5f540ccee0 2023-05-11T07:36:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.631+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5415a6c0 con 0x7f5f540ccee0 2023-05-11T07:36:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.632+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54159db0 con 0x7f5f540ccee0 2023-05-11T07:36:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.633+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f4400cd20 con 0x7f5f540ccee0 2023-05-11T07:36:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.633+0000 7f5f49ffb700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 0x7f5f3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.634+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f44089810 con 0x7f5f540ccee0 2023-05-11T07:36:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.634+0000 7f5f5939b700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 0x7f5f3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.634+0000 7f5f5939b700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 0x7f5f3806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f54155730 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.638+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5f440545c0 con 0x7f5f540ccee0 2023-05-11T07:36:18.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.833+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f540b1700 con 0x7f5f540ccee0 2023-05-11T07:36:18.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.833+0000 7f5f49ffb700 1 -- 172.21.15.144:0/1872409777 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f44057be0 con 0x7f5f540ccee0 2023-05-11T07:36:18.837 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:18.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 msgr2=0x7f5f3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 0x7f5f3806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f54155730 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2023-05-11T07:36:18.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 msgr2=0x7f5f541f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:18.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9b0 tx=0x7f5f4400ecc0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 shutdown_connections 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5f3806ace0 0x7f5f3806d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5f540b0720 0x7f5f540713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f541599e0 0x7f5f540c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.835+0000 7f5f5b5ff700 1 --2- 172.21.15.144:0/1872409777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f540ccee0 0x7f5f541f6570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.836+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 >> 172.21.15.144:0/1872409777 conn(0x7f5f540cb720 msgr2=0x7f5f540cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.836+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 shutdown_connections 2023-05-11T07:36:18.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:18.836+0000 7f5f5b5ff700 1 -- 172.21.15.144:0/1872409777 wait complete. 2023-05-11T07:36:18.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.040+0000 7f1a14bff700 1 Processor -- start 2023-05-11T07:36:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.040+0000 7f1a14bff700 1 -- start start 2023-05-11T07:36:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a1015c940 0x7f1a10160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1a100b5fd0 0x7f1a1006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b6420 0x7f1a1006b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a10161420 con 0x7f1a1015c940 2023-05-11T07:36:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a100d0e80 con 0x7f1a100b5fd0 2023-05-11T07:36:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.041+0000 7f1a14bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100cdb00 con 0x7f1a100b6420 2023-05-11T07:36:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a1015c940 0x7f1a10160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a1015c940 0x7f1a10160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35298/0 (socket says 172.21.15.144:35298) 2023-05-11T07:36:19.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 -- 172.21.15.144:0/700233393 learned_addr learned my addr 172.21.15.144:0/700233393 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:19.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a07fff700 1 --2- 172.21.15.144:0/700233393 >> v2:172.21.15.145:3300/0 conn(0x7f1a100b5fd0 0x7f1a1006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0ed9d700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b6420 0x7f1a1006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 -- 172.21.15.144:0/700233393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b6420 msgr2=0x7f1a1006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b6420 0x7f1a1006b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 -- 172.21.15.144:0/700233393 >> v2:172.21.15.145:3300/0 conn(0x7f1a100b5fd0 msgr2=0x7f1a1006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/700233393 >> v2:172.21.15.145:3300/0 conn(0x7f1a100b5fd0 0x7f1a1006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 -- 172.21.15.144:0/700233393 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100cdde0 con 0x7f1a1015c940 2023-05-11T07:36:19.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.042+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1015c940 0x7f1a10160ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a100d3e60 tx=0x7f1a00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26bc8f77b02265f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a0dd9b700 1 -- 172.21.15.144:0/700233393 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000b870 con 0x7f1a1015c940 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a0dd9b700 1 -- 172.21.15.144:0/700233393 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0000b9d0 con 0x7f1a1015c940 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a0dd9b700 1 -- 172.21.15.144:0/700233393 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000bd60 con 0x7f1a1015c940 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 -- 172.21.15.144:0/700233393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1015c940 msgr2=0x7f1a10160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1015c940 0x7f1a10160ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a100d3e60 tx=0x7f1a00009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 -- 172.21.15.144:0/700233393 shutdown_connections 2023-05-11T07:36:19.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b6420 0x7f1a1006b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 --2- 172.21.15.144:0/700233393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a1015c940 0x7f1a10160ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 --2- 172.21.15.144:0/700233393 >> v2:172.21.15.145:3300/0 conn(0x7f1a100b5fd0 0x7f1a1006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 -- 172.21.15.144:0/700233393 >> 172.21.15.144:0/700233393 conn(0x7f1a100d3180 msgr2=0x7f1a100d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 -- 172.21.15.144:0/700233393 shutdown_connections 2023-05-11T07:36:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.043+0000 7f1a14bff700 1 -- 172.21.15.144:0/700233393 wait complete. 2023-05-11T07:36:19.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.045+0000 7f1a14bff700 1 Processor -- start 2023-05-11T07:36:19.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.045+0000 7f1a14bff700 1 -- start start 2023-05-11T07:36:19.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b5fd0 0x7f1a10155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 0x7f1a10156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100ca960 con 0x7f1a100b6420 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100cac40 con 0x7f1a1015c940 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a14bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100caf20 con 0x7f1a100b5fd0 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35312/0 (socket says 172.21.15.144:35312) 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.046+0000 7f1a07fff700 1 -- 172.21.15.144:0/2042282329 learned_addr learned my addr 172.21.15.144:0/2042282329 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a0ed9d700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 0x7f1a10156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b5fd0 0x7f1a10155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 -- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b5fd0 msgr2=0x7f1a10155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b5fd0 0x7f1a10155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 -- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 msgr2=0x7f1a10156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 0x7f1a10156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 -- 172.21.15.144:0/2042282329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00009550 con 0x7f1a100b6420 2023-05-11T07:36:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a0ed9d700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 0x7f1a10156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a07fff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19f800e810 tx=0x7f19f800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8013610 con 0x7f1a100b6420 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8013770 con 0x7f1a100b6420 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a100d1400 con 0x7f1a100b6420 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8013b00 con 0x7f1a100b6420 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.047+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a100d1120 con 0x7f1a100b6420 2023-05-11T07:36:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.048+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1015cd10 con 0x7f1a100b6420 2023-05-11T07:36:19.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.049+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f8013c60 con 0x7f1a100b6420 2023-05-11T07:36:19.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.050+0000 7f1a06ffd700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 0x7f19f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.050+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19f80893d0 con 0x7f1a100b6420 2023-05-11T07:36:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.050+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 0x7f19f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.051+0000 7f1a0e59c700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 0x7f19f006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015f760 tx=0x7f1a00008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.054+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f19f8054180 con 0x7f1a100b6420 2023-05-11T07:36:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.246+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a10159a10 con 0x7f1a100b6420 2023-05-11T07:36:19.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.247+0000 7f1a06ffd700 1 -- 172.21.15.144:0/2042282329 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f19f80577a0 con 0x7f1a100b6420 2023-05-11T07:36:19.251 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:19.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 msgr2=0x7f19f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 0x7f19f006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015f760 tx=0x7f1a00008030 comp rx=0 tx=0).stop 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 msgr2=0x7f1a10155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19f800e810 tx=0x7f19f800ebd0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 shutdown_connections 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f19f006ace0 0x7f19f006d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1a100b5fd0 0x7f1a10155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1a1015c940 0x7f1a10156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 --2- 172.21.15.144:0/2042282329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a100b6420 0x7f1a10155e40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 >> 172.21.15.144:0/2042282329 conn(0x7f1a100d3180 msgr2=0x7f1a1006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 shutdown_connections 2023-05-11T07:36:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.249+0000 7f1a14bff700 1 -- 172.21.15.144:0/2042282329 wait complete. 2023-05-11T07:36:19.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:19.457 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.453+0000 7feb42fff700 1 Processor -- start 2023-05-11T07:36:19.457 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.453+0000 7feb42fff700 1 -- start start 2023-05-11T07:36:19.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.454+0000 7feb42fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7feb3c15c940 0x7feb3c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.454+0000 7feb42fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb3c0b5fd0 0x7feb3c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb42fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0b6420 0x7feb3c06b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb42fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c161420 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb42fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0d0e80 con 0x7feb3c15c940 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb42fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0cdb00 con 0x7feb3c0b6420 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb3c0b5fd0 0x7feb3c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb3c0b5fd0 0x7feb3c06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35322/0 (socket says 172.21.15.144:35322) 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 -- 172.21.15.144:0/1123817460 learned_addr learned my addr 172.21.15.144:0/1123817460 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:19.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb4159c700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0b6420 0x7feb3c06b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb40d9b700 1 --2- 172.21.15.144:0/1123817460 >> v2:172.21.15.145:3300/0 conn(0x7feb3c15c940 0x7feb3c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 -- 172.21.15.144:0/1123817460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0b6420 msgr2=0x7feb3c06b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0b6420 0x7feb3c06b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 -- 172.21.15.144:0/1123817460 >> v2:172.21.15.145:3300/0 conn(0x7feb3c15c940 msgr2=0x7feb3c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 --2- 172.21.15.144:0/1123817460 >> v2:172.21.15.145:3300/0 conn(0x7feb3c15c940 0x7feb3c160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.455+0000 7feb3bfff700 1 -- 172.21.15.144:0/1123817460 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0cdde0 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb3bfff700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c06ac40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0d0e50 tx=0x7feb28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e22bc4a5c98ebe server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb3b7fe700 1 -- 172.21.15.144:0/1123817460 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28011830 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb3b7fe700 1 -- 172.21.15.144:0/1123817460 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb28011990 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb3b7fe700 1 -- 172.21.15.144:0/1123817460 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28011d20 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 -- 172.21.15.144:0/1123817460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b5fd0 msgr2=0x7feb3c06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c06ac40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0d0e50 tx=0x7feb28009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 -- 172.21.15.144:0/1123817460 shutdown_connections 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c0b6420 0x7feb3c06b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 --2- 172.21.15.144:0/1123817460 >> v2:172.21.15.145:3300/0 conn(0x7feb3c15c940 0x7feb3c160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 --2- 172.21.15.144:0/1123817460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c06ac40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 -- 172.21.15.144:0/1123817460 >> 172.21.15.144:0/1123817460 conn(0x7feb3c0d3180 msgr2=0x7feb3c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.456+0000 7feb42fff700 1 -- 172.21.15.144:0/1123817460 shutdown_connections 2023-05-11T07:36:19.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.457+0000 7feb42fff700 1 -- 172.21.15.144:0/1123817460 wait complete. 2023-05-11T07:36:19.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.458+0000 7feb42fff700 1 Processor -- start 2023-05-11T07:36:19.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.458+0000 7feb42fff700 1 -- start start 2023-05-11T07:36:19.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c1e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c15c940 0x7feb3c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c0cae70 con 0x7feb3c0b6420 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c1e7260 con 0x7feb3c0b5fd0 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb42fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c1e7540 con 0x7feb3c15c940 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35332/0 (socket says 172.21.15.144:35332) 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.459+0000 7feb3bfff700 1 -- 172.21.15.144:0/276670372 learned_addr learned my addr 172.21.15.144:0/276670372 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:19.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb40d9b700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c1e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb4159c700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c15c940 0x7feb3c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 -- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c15c940 msgr2=0x7feb3c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c15c940 0x7feb3c15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 -- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0b5fd0 msgr2=0x7feb3c1e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c1e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 -- 172.21.15.144:0/276670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28009550 con 0x7feb3c0b6420 2023-05-11T07:36:19.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb3bfff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb28000c00 tx=0x7feb28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28004300 con 0x7feb3c0b6420 2023-05-11T07:36:19.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2801f070 con 0x7feb3c0b6420 2023-05-11T07:36:19.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c0d1400 con 0x7feb3c0b6420 2023-05-11T07:36:19.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.460+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb280036a0 con 0x7feb3c0b6420 2023-05-11T07:36:19.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.461+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c0d1120 con 0x7feb3c0b6420 2023-05-11T07:36:19.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.461+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c15cd10 con 0x7feb3c0b6420 2023-05-11T07:36:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.462+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb28021030 con 0x7feb3c0b6420 2023-05-11T07:36:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.463+0000 7feb397fa700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 0x7feb2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.463+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb2808aaa0 con 0x7feb3c0b6420 2023-05-11T07:36:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.464+0000 7feb40d9b700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 0x7feb2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.464+0000 7feb40d9b700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 0x7feb2006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb30009b40 tx=0x7feb30009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.467+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feb28055970 con 0x7feb3c0b6420 2023-05-11T07:36:19.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.665+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb3c0cacd0 con 0x7feb3c0b6420 2023-05-11T07:36:19.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.665+0000 7feb397fa700 1 -- 172.21.15.144:0/276670372 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb3c0cacd0 con 0x7feb3c0b6420 2023-05-11T07:36:19.669 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 msgr2=0x7feb2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 0x7feb2006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb30009b40 tx=0x7feb30009210 comp rx=0 tx=0).stop 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 msgr2=0x7feb3c0ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb28000c00 tx=0x7feb28004750 comp rx=0 tx=0).stop 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 shutdown_connections 2023-05-11T07:36:19.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb2006ace0 0x7feb2006d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb3c15c940 0x7feb3c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb3c0b5fd0 0x7feb3c1e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 --2- 172.21.15.144:0/276670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb3c0b6420 0x7feb3c0ccc90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.667+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 >> 172.21.15.144:0/276670372 conn(0x7feb3c0d3180 msgr2=0x7feb3c0d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.668+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 shutdown_connections 2023-05-11T07:36:19.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.668+0000 7feb42fff700 1 -- 172.21.15.144:0/276670372 wait complete. 2023-05-11T07:36:19.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:19.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.874+0000 7f788bdff700 1 Processor -- start 2023-05-11T07:36:19.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.874+0000 7f788bdff700 1 -- start start 2023-05-11T07:36:19.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.875+0000 7f788bdff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f788415c930 0x7f788415d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.875+0000 7f788bdff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78840d14c0 0x7f78841604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.875+0000 7f788bdff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788415de80 con 0x7f78840cfe00 2023-05-11T07:36:19.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.875+0000 7f788bdff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78840cf640 con 0x7f78840d14c0 2023-05-11T07:36:19.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.875+0000 7f788bdff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788415cd00 con 0x7f788415c930 2023-05-11T07:36:19.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78840d14c0 0x7f78841604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f7889b9b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f788415c930 0x7f788415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788939a700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f78840cfe00 0x7f78840d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:40276/0 (socket says 172.21.15.144:40276) 2023-05-11T07:36:19.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788939a700 1 -- 172.21.15.144:0/29214014 learned_addr learned my addr 172.21.15.144:0/29214014 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:19.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78840d14c0 0x7f78841604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35348/0 (socket says 172.21.15.144:35348) 2023-05-11T07:36:19.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 -- 172.21.15.144:0/29214014 >> v2:172.21.15.145:3300/0 conn(0x7f788415c930 msgr2=0x7f788415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:19.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 --2- 172.21.15.144:0/29214014 >> v2:172.21.15.145:3300/0 conn(0x7f788415c930 0x7f788415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 -- 172.21.15.144:0/29214014 >> v1:172.21.15.145:6789/0 conn(0x7f78840cfe00 legacy=0x7f78840d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.876+0000 7f788a39c700 1 -- 172.21.15.144:0/29214014 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78840cd940 con 0x7f78840d14c0 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788a39c700 1 --2- 172.21.15.144:0/29214014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78840d14c0 0x7f78841604b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf6953143a1e055 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f7888b99700 1 -- 172.21.15.144:0/29214014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00e070 con 0x7f78840d14c0 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f7888b99700 1 -- 172.21.15.144:0/29214014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c00bae0 con 0x7f78840d14c0 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f7888b99700 1 -- 172.21.15.144:0/29214014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00be90 con 0x7f78840d14c0 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 -- 172.21.15.144:0/29214014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78840d14c0 msgr2=0x7f78841604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 --2- 172.21.15.144:0/29214014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78840d14c0 0x7f78841604b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f787c009d90 tx=0x7f787c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 -- 172.21.15.144:0/29214014 shutdown_connections 2023-05-11T07:36:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 --2- 172.21.15.144:0/29214014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78840d14c0 0x7f78841604b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 --2- 172.21.15.144:0/29214014 >> v2:172.21.15.145:3300/0 conn(0x7f788415c930 0x7f788415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 -- 172.21.15.144:0/29214014 >> 172.21.15.144:0/29214014 conn(0x7f7884072650 msgr2=0x7f788406acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:19.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.877+0000 7f788bdff700 1 -- 172.21.15.144:0/29214014 shutdown_connections 2023-05-11T07:36:19.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.878+0000 7f788bdff700 1 -- 172.21.15.144:0/29214014 wait complete. 2023-05-11T07:36:19.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.879+0000 7f788bdff700 1 Processor -- start 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.879+0000 7f788bdff700 1 -- start start 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 0x7f78840c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78840b2b10 0x7f78841e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840b3060 con 0x7f788415c930 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840b3340 con 0x7f78840b2b10 2023-05-11T07:36:19.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788bdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78840b3620 con 0x7f78840d14c0 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788939a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788939a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35350/0 (socket says 172.21.15.144:35350) 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.880+0000 7f788939a700 1 -- 172.21.15.144:0/4091014323 learned_addr learned my addr 172.21.15.144:0/4091014323 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788a39c700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78840b2b10 0x7f78841e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f7889b9b700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 0x7f78840c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 -- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 msgr2=0x7f78840c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 0x7f78840c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 -- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78840b2b10 msgr2=0x7f78841e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78840b2b10 0x7f78841e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 -- 172.21.15.144:0/4091014323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c009a70 con 0x7f788415c930 2023-05-11T07:36:19.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f7889b9b700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 0x7f78840c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:19.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788939a700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f787400c520 tx=0x7f787400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874005d70 con 0x7f788415c930 2023-05-11T07:36:19.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740070d0 con 0x7f788415c930 2023-05-11T07:36:19.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874007440 con 0x7f788415c930 2023-05-11T07:36:19.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78840cf8e0 con 0x7f788415c930 2023-05-11T07:36:19.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.881+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78840cdc20 con 0x7f788415c930 2023-05-11T07:36:19.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.882+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78840cdf00 con 0x7f788415c930 2023-05-11T07:36:19.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.883+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78740075a0 con 0x7f788415c930 2023-05-11T07:36:19.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.884+0000 7f787a7fc700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 0x7f786806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:19.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.884+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7874088c20 con 0x7f788415c930 2023-05-11T07:36:19.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.885+0000 7f7889b9b700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 0x7f786806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:19.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.885+0000 7f7889b9b700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 0x7f786806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7880009ac0 tx=0x7f7880008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:19.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:19.888+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f78740539f0 con 0x7f788415c930 2023-05-11T07:36:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.087+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78840744c0 con 0x7f788415c930 2023-05-11T07:36:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.088+0000 7f787a7fc700 1 -- 172.21.15.144:0/4091014323 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7874057010 con 0x7f788415c930 2023-05-11T07:36:20.092 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 msgr2=0x7f786806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 0x7f786806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7880009ac0 tx=0x7f7880008040 comp rx=0 tx=0).stop 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 msgr2=0x7f78841e5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f787400c520 tx=0x7f787400c8e0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 shutdown_connections 2023-05-11T07:36:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f786806ace0 0x7f786806d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f78840d14c0 0x7f78840c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78840b2b10 0x7f78841e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 --2- 172.21.15.144:0/4091014323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f788415c930 0x7f78841e5780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 >> 172.21.15.144:0/4091014323 conn(0x7f78840cfe00 msgr2=0x7f78840d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 shutdown_connections 2023-05-11T07:36:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.090+0000 7f788bdff700 1 -- 172.21.15.144:0/4091014323 wait complete. 2023-05-11T07:36:20.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.294+0000 7f91fefff700 1 Processor -- start 2023-05-11T07:36:20.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.295+0000 7f91fefff700 1 -- start start 2023-05-11T07:36:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fefff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91f815c940 0x7f91f8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fefff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 0x7f91f806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fefff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80d0e80 con 0x7f91f80b6420 2023-05-11T07:36:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fefff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f8161420 con 0x7f91f815c940 2023-05-11T07:36:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fefff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f80cdb00 con 0x7f91f80b5fd0 2023-05-11T07:36:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fcd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91f815c940 0x7f91f8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fcd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91f815c940 0x7f91f8160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35356/0 (socket says 172.21.15.144:35356) 2023-05-11T07:36:20.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fcd9b700 1 -- 172.21.15.144:0/3758864194 learned_addr learned my addr 172.21.15.144:0/3758864194 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:20.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91f7fff700 1 --2- 172.21.15.144:0/3758864194 >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 0x7f91f806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fcd9b700 1 -- 172.21.15.144:0/3758864194 >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 msgr2=0x7f91f806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.296+0000 7f91fcd9b700 1 --2- 172.21.15.144:0/3758864194 >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 0x7f91f806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91fcd9b700 1 -- 172.21.15.144:0/3758864194 >> v1:172.21.15.144:6789/0 conn(0x7f91f80b6420 legacy=0x7f91f80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91fcd9b700 1 -- 172.21.15.144:0/3758864194 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80cdde0 con 0x7f91f815c940 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91f7fff700 1 --2- 172.21.15.144:0/3758864194 >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 0x7f91f806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91fcd9b700 1 --2- 172.21.15.144:0/3758864194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f8160ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91f80d3e60 tx=0x7f91ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d47f834cafaca server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91f77fe700 1 -- 172.21.15.144:0/3758864194 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00b870 con 0x7f91f815c940 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91f77fe700 1 -- 172.21.15.144:0/3758864194 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00b9d0 con 0x7f91f815c940 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91f77fe700 1 -- 172.21.15.144:0/3758864194 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00bd60 con 0x7f91f815c940 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91fefff700 1 -- 172.21.15.144:0/3758864194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 msgr2=0x7f91f8160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.297+0000 7f91fefff700 1 --2- 172.21.15.144:0/3758864194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f8160ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91f80d3e60 tx=0x7f91ec009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 -- 172.21.15.144:0/3758864194 shutdown_connections 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 --2- 172.21.15.144:0/3758864194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f8160ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 --2- 172.21.15.144:0/3758864194 >> v2:172.21.15.145:3300/0 conn(0x7f91f80b5fd0 0x7f91f806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 -- 172.21.15.144:0/3758864194 >> 172.21.15.144:0/3758864194 conn(0x7f91f80d3180 msgr2=0x7f91f80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 -- 172.21.15.144:0/3758864194 shutdown_connections 2023-05-11T07:36:20.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.298+0000 7f91fefff700 1 -- 172.21.15.144:0/3758864194 wait complete. 2023-05-11T07:36:20.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.299+0000 7f91fefff700 1 Processor -- start 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 -- start start 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91f80b5fd0 0x7f91f8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 0x7f91f81f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8155ad0 con 0x7f91f815c940 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81f3480 con 0x7f91f80b6420 2023-05-11T07:36:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.300+0000 7f91fefff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8154e50 con 0x7f91f80b5fd0 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91f7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 0x7f91f81f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fcd9b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91f80b5fd0 0x7f91f8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91f7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 0x7f91f81f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:46696/0 (socket says 172.21.15.144:46696) 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91f7fff700 1 -- 172.21.15.144:0/2374057405 learned_addr learned my addr 172.21.15.144:0/2374057405 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 -- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91f80b5fd0 msgr2=0x7f91f8154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91f80b5fd0 0x7f91f8154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 -- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 msgr2=0x7f91f81f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 0x7f91f81f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 -- 172.21.15.144:0/2374057405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009550 con 0x7f91f815c940 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.301+0000 7f91fd59c700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f81502a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f91f000cb90 tx=0x7f91f000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.302+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0003c00 con 0x7f91f815c940 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.302+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0003d60 con 0x7f91f815c940 2023-05-11T07:36:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.302+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f000aa80 con 0x7f91f815c940 2023-05-11T07:36:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.302+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80d1400 con 0x7f91f815c940 2023-05-11T07:36:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.302+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f80d1120 con 0x7f91f815c940 2023-05-11T07:36:20.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.303+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f815cd10 con 0x7f91f815c940 2023-05-11T07:36:20.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.304+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91f000abe0 con 0x7f91f815c940 2023-05-11T07:36:20.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.305+0000 7f91f57fa700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 0x7f91dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.305+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91f0089590 con 0x7f91f815c940 2023-05-11T07:36:20.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.305+0000 7f91fcd9b700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 0x7f91dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.306+0000 7f91fcd9b700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 0x7f91dc06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c00 tx=0x7f91ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.309+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f91f0054490 con 0x7f91f815c940 2023-05-11T07:36:20.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.501+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f91f80744c0 con 0x7f91f815c940 2023-05-11T07:36:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.501+0000 7f91f57fa700 1 -- 172.21.15.144:0/2374057405 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f91f0057ab0 con 0x7f91f815c940 2023-05-11T07:36:20.505 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 msgr2=0x7f91dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 0x7f91dc06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c00 tx=0x7f91ec008030 comp rx=0 tx=0).stop 2023-05-11T07:36:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 msgr2=0x7f91f81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f81502a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f91f000cb90 tx=0x7f91f000cea0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 shutdown_connections 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91dc06ace0 0x7f91dc06d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f91f80b5fd0 0x7f91f8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91f815c940 0x7f91f81502a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 --2- 172.21.15.144:0/2374057405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f91f80b6420 0x7f91f81f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.503+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 >> 172.21.15.144:0/2374057405 conn(0x7f91f80d3180 msgr2=0x7f91f80b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.504+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 shutdown_connections 2023-05-11T07:36:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.504+0000 7f91fefff700 1 -- 172.21.15.144:0/2374057405 wait complete. 2023-05-11T07:36:20.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:36:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.709+0000 7fdf793ff700 1 Processor -- start 2023-05-11T07:36:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.709+0000 7fdf793ff700 1 -- start start 2023-05-11T07:36:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.710+0000 7fdf793ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdf74158be0 0x7fdf740ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf793ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf7406b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf793ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740cb2b0 con 0x7fdf7406bce0 2023-05-11T07:36:20.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf793ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf740c9790 con 0x7fdf74158be0 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf793ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7415d3c0 con 0x7fdf7406af50 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdf74158be0 0x7fdf740ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf6bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf7406b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdf74158be0 0x7fdf740ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:46710/0 (socket says 172.21.15.144:46710) 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 -- 172.21.15.144:0/2264011681 learned_addr learned my addr 172.21.15.144:0/2264011681 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 -- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 msgr2=0x7fdf7406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 --2- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf7406b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 -- 172.21.15.144:0/2264011681 >> v1:172.21.15.145:6789/0 conn(0x7fdf7406bce0 legacy=0x7fdf74070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.711+0000 7fdf72ffd700 1 -- 172.21.15.144:0/2264011681 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7415d6a0 con 0x7fdf74158be0 2023-05-11T07:36:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf72ffd700 1 --2- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf74158be0 0x7fdf740ce570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf640098f0 tx=0x7fdf64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d2119d99bcdcf9d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf727fc700 1 -- 172.21.15.144:0/2264011681 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64011830 con 0x7fdf74158be0 2023-05-11T07:36:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf727fc700 1 -- 172.21.15.144:0/2264011681 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64011990 con 0x7fdf74158be0 2023-05-11T07:36:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf727fc700 1 -- 172.21.15.144:0/2264011681 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64011d20 con 0x7fdf74158be0 2023-05-11T07:36:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf793ff700 1 -- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf74158be0 msgr2=0x7fdf740ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.712+0000 7fdf793ff700 1 --2- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf74158be0 0x7fdf740ce570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf640098f0 tx=0x7fdf64009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 -- 172.21.15.144:0/2264011681 shutdown_connections 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 --2- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf74158be0 0x7fdf740ce570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 --2- 172.21.15.144:0/2264011681 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf7406b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 -- 172.21.15.144:0/2264011681 >> 172.21.15.144:0/2264011681 conn(0x7fdf740cb7e0 msgr2=0x7fdf740cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 -- 172.21.15.144:0/2264011681 shutdown_connections 2023-05-11T07:36:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.713+0000 7fdf793ff700 1 -- 172.21.15.144:0/2264011681 wait complete. 2023-05-11T07:36:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.714+0000 7fdf793ff700 1 Processor -- start 2023-05-11T07:36:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.714+0000 7fdf793ff700 1 -- start start 2023-05-11T07:36:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf740c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf7406bce0 0x7fdf74153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7406fe90 con 0x7fdf74158be0 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74070170 con 0x7fdf7406bce0 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.715+0000 7fdf793ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74070450 con 0x7fdf7406af50 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf72ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf740c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35372/0 (socket says 172.21.15.144:35372) 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 -- 172.21.15.144:0/207982242 learned_addr learned my addr 172.21.15.144:0/207982242 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:20.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf6bfff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf7406bce0 0x7fdf74153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 -- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 msgr2=0x7fdf740c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf740c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 -- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf7406bce0 msgr2=0x7fdf74153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf7406bce0 0x7fdf74153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 -- 172.21.15.144:0/207982242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009550 con 0x7fdf74158be0 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.716+0000 7fdf737fe700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00cb50 tx=0x7fdf6c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.717+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c003c00 con 0x7fdf74158be0 2023-05-11T07:36:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.717+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c003d60 con 0x7fdf74158be0 2023-05-11T07:36:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.717+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf740ceab0 con 0x7fdf74158be0 2023-05-11T07:36:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.717+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00aa20 con 0x7fdf74158be0 2023-05-11T07:36:20.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.717+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf740c93b0 con 0x7fdf74158be0 2023-05-11T07:36:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.718+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf740caea0 con 0x7fdf74158be0 2023-05-11T07:36:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.719+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf6c00ab80 con 0x7fdf74158be0 2023-05-11T07:36:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.720+0000 7fdf6b7fe700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.720+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf6c089730 con 0x7fdf74158be0 2023-05-11T07:36:20.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.720+0000 7fdf72ffd700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:20.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.721+0000 7fdf72ffd700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 0x7fdf5406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009c40 tx=0x7fdf64008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:20.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.724+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdf6c0544b0 con 0x7fdf74158be0 2023-05-11T07:36:20.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.962+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf7406ffd0 con 0x7fdf74158be0 2023-05-11T07:36:20.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.962+0000 7fdf6b7fe700 1 -- 172.21.15.144:0/207982242 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7fdf7406ffd0 con 0x7fdf74158be0 2023-05-11T07:36:20.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:20.967 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:36:20.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 msgr2=0x7fdf5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 0x7fdf5406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009c40 tx=0x7fdf64008030 comp rx=0 tx=0).stop 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 msgr2=0x7fdf741536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00cb50 tx=0x7fdf6c00ce60 comp rx=0 tx=0).stop 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 shutdown_connections 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdf7406af50 0x7fdf740c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf74158be0 0x7fdf741536a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 --2- 172.21.15.144:0/207982242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf7406bce0 0x7fdf74153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 >> 172.21.15.144:0/207982242 conn(0x7fdf740cb7e0 msgr2=0x7fdf7415c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 shutdown_connections 2023-05-11T07:36:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:20.965+0000 7fdf793ff700 1 -- 172.21.15.144:0/207982242 wait complete. 2023-05-11T07:36:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:36:20.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:21.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.168+0000 7feb4d7ff700 1 Processor -- start 2023-05-11T07:36:21.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.168+0000 7feb4d7ff700 1 -- start start 2023-05-11T07:36:21.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb4d7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 0x7feb4815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.173 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb4d7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4815e1c0 con 0x7feb481597f0 2023-05-11T07:36:21.173 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb4d7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb48159bc0 con 0x7feb4806a2d0 2023-05-11T07:36:21.173 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb4d7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c9ba0 con 0x7feb480c9730 2023-05-11T07:36:21.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb46ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feb481597f0 0x7feb480cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48212/0 (socket says 172.21.15.144:48212) 2023-05-11T07:36:21.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.169+0000 7feb46ffd700 1 -- 172.21.15.144:0/1405158740 learned_addr learned my addr 172.21.15.144:0/1405158740 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:21.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb467fc700 1 --2- 172.21.15.144:0/1405158740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 0x7feb4815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.174 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293706205 0 0) 0x7feb4815e1c0 con 0x7feb481597f0 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb300035b0 con 0x7feb481597f0 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679322186 0 0) 0x7feb40001490 con 0x7feb4806a2d0 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4815e1c0 con 0x7feb4806a2d0 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb467fc700 1 -- 172.21.15.144:0/1405158740 >> v1:172.21.15.145:6789/0 conn(0x7feb4806a2d0 legacy=0x7feb4806fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb467fc700 1 -- 172.21.15.144:0/1405158740 >> v1:172.21.15.144:6789/0 conn(0x7feb481597f0 legacy=0x7feb480cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.170+0000 7feb467fc700 1 -- 172.21.15.144:0/1405158740 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480c9e30 con 0x7feb480c9730 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb467fc700 1 --2- 172.21.15.144:0/1405158740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 0x7feb4815dc80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009870 tx=0x7feb3c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574078ecb6859b9b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011830 con 0x7feb480c9730 2023-05-11T07:36:21.176 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c011990 con 0x7feb480c9730 2023-05-11T07:36:21.176 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb45ffb700 1 -- 172.21.15.144:0/1405158740 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011d20 con 0x7feb480c9730 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 -- 172.21.15.144:0/1405158740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 msgr2=0x7feb4815dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/1405158740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 0x7feb4815dc80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009870 tx=0x7feb3c009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 -- 172.21.15.144:0/1405158740 shutdown_connections 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/1405158740 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb480c9730 0x7feb4815dc80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 -- 172.21.15.144:0/1405158740 >> 172.21.15.144:0/1405158740 conn(0x7feb480cb7e0 msgr2=0x7feb480cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 -- 172.21.15.144:0/1405158740 shutdown_connections 2023-05-11T07:36:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.171+0000 7feb4d7ff700 1 -- 172.21.15.144:0/1405158740 wait complete. 2023-05-11T07:36:21.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.173+0000 7feb4d7ff700 1 Processor -- start 2023-05-11T07:36:21.178 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.173+0000 7feb4d7ff700 1 -- start start 2023-05-11T07:36:21.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb480c9730 0x7feb480c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb481597f0 0x7feb480b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb481f4390 con 0x7feb4806a2d0 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c5770 con 0x7feb480c9730 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb4d7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c6370 con 0x7feb481597f0 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb46ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb46ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35380/0 (socket says 172.21.15.144:35380) 2023-05-11T07:36:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb46ffd700 1 -- 172.21.15.144:0/2016991785 learned_addr learned my addr 172.21.15.144:0/2016991785 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb467fc700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb480c9730 0x7feb480c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.174+0000 7feb477fe700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb481597f0 0x7feb480b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 -- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb481597f0 msgr2=0x7feb480b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb481597f0 0x7feb480b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 -- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb480c9730 msgr2=0x7feb480c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb480c9730 0x7feb480c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 -- 172.21.15.144:0/2016991785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0094a0 con 0x7feb4806a2d0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb46ffd700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c700 tx=0x7feb3800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38005d70 con 0x7feb4806a2d0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380070d0 con 0x7feb4806a2d0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38007460 con 0x7feb4806a2d0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb480cccb0 con 0x7feb4806a2d0 2023-05-11T07:36:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.175+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb480ca110 con 0x7feb4806a2d0 2023-05-11T07:36:21.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.176+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480ccf90 con 0x7feb4806a2d0 2023-05-11T07:36:21.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.177+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb380075c0 con 0x7feb4806a2d0 2023-05-11T07:36:21.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.178+0000 7feb2f7fe700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 0x7feb3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.178+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb38088cb0 con 0x7feb4806a2d0 2023-05-11T07:36:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.178+0000 7feb467fc700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 0x7feb3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.179+0000 7feb467fc700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 0x7feb3406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097c0 tx=0x7feb3c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.182+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feb38053990 con 0x7feb4806a2d0 2023-05-11T07:36:21.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.378+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb480c9170 con 0x7feb4806a2d0 2023-05-11T07:36:21.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.380+0000 7feb2f7fe700 1 -- 172.21.15.144:0/2016991785 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20251 (secure 0 0 0) 0x7feb38017090 con 0x7feb4806a2d0 2023-05-11T07:36:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:21.384 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:20.522587+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:21.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 msgr2=0x7feb3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 0x7feb3406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097c0 tx=0x7feb3c01c040 comp rx=0 tx=0).stop 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 msgr2=0x7feb480c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c700 tx=0x7feb3800ca10 comp rx=0 tx=0).stop 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 shutdown_connections 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feb3406ace0 0x7feb3406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7feb481597f0 0x7feb480b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.386 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb4806a2d0 0x7feb480c5230 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 --2- 172.21.15.144:0/2016991785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feb480c9730 0x7feb480c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 >> 172.21.15.144:0/2016991785 conn(0x7feb480cb7e0 msgr2=0x7feb480cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:21.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 shutdown_connections 2023-05-11T07:36:21.387 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.382+0000 7feb4d7ff700 1 -- 172.21.15.144:0/2016991785 wait complete. 2023-05-11T07:36:21.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:36:21.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.586+0000 7f083b5ff700 1 Processor -- start 2023-05-11T07:36:21.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.586+0000 7f083b5ff700 1 -- start start 2023-05-11T07:36:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.587+0000 7f083b5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08340b87e0 0x7f08340b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083b5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f08340d27a0 0x7f08340b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083b5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083415cef0 con 0x7f08340d02c0 2023-05-11T07:36:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083b5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08340b5a80 con 0x7f08340b87e0 2023-05-11T07:36:21.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083b5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08340cdf70 con 0x7f08340d27a0 2023-05-11T07:36:21.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08340b87e0 0x7f08340b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08340b87e0 0x7f08340b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35392/0 (socket says 172.21.15.144:35392) 2023-05-11T07:36:21.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 -- 172.21.15.144:0/2995864164 learned_addr learned my addr 172.21.15.144:0/2995864164 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f0839b9c700 1 --2- 172.21.15.144:0/2995864164 >> v2:172.21.15.145:3300/0 conn(0x7f08340d27a0 0x7f08340b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 -- 172.21.15.144:0/2995864164 >> v2:172.21.15.145:3300/0 conn(0x7f08340d27a0 msgr2=0x7f08340b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 --2- 172.21.15.144:0/2995864164 >> v2:172.21.15.145:3300/0 conn(0x7f08340d27a0 0x7f08340b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 -- 172.21.15.144:0/2995864164 >> v1:172.21.15.145:6789/0 conn(0x7f08340d02c0 legacy=0x7f08340d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.588+0000 7f083939b700 1 -- 172.21.15.144:0/2995864164 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340cd760 con 0x7f08340b87e0 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083939b700 1 --2- 172.21.15.144:0/2995864164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340b87e0 0x7f08340b4b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f08340c6be0 tx=0x7f0830009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2fd975021dd49 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f082bfff700 1 -- 172.21.15.144:0/2995864164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830011830 con 0x7f08340b87e0 2023-05-11T07:36:21.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f082bfff700 1 -- 172.21.15.144:0/2995864164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830011990 con 0x7f08340b87e0 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f082bfff700 1 -- 172.21.15.144:0/2995864164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830011d20 con 0x7f08340b87e0 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 -- 172.21.15.144:0/2995864164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340b87e0 msgr2=0x7f08340b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 --2- 172.21.15.144:0/2995864164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340b87e0 0x7f08340b4b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f08340c6be0 tx=0x7f0830009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 -- 172.21.15.144:0/2995864164 shutdown_connections 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 --2- 172.21.15.144:0/2995864164 >> v2:172.21.15.145:3300/0 conn(0x7f08340d27a0 0x7f08340b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 --2- 172.21.15.144:0/2995864164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340b87e0 0x7f08340b4b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 -- 172.21.15.144:0/2995864164 >> 172.21.15.144:0/2995864164 conn(0x7f083406acf0 msgr2=0x7f083406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:21.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.589+0000 7f083b5ff700 1 -- 172.21.15.144:0/2995864164 shutdown_connections 2023-05-11T07:36:21.596 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.590+0000 7f083b5ff700 1 -- 172.21.15.144:0/2995864164 wait complete. 2023-05-11T07:36:21.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.591+0000 7f083b5ff700 1 Processor -- start 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.591+0000 7f083b5ff700 1 -- start start 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08340b87e0 0x7f083415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08340d27a0 0x7f08341e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340c6c40 con 0x7f08340d02c0 2023-05-11T07:36:21.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340c6e90 con 0x7f08340d27a0 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f083b5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08340c7170 con 0x7f08340b87e0 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.592+0000 7f0838b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35408/0 (socket says 172.21.15.144:35408) 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 -- 172.21.15.144:0/3441421163 learned_addr learned my addr 172.21.15.144:0/3441421163 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0839b9c700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08340d27a0 0x7f08341e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f083939b700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08340b87e0 0x7f083415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 -- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08340b87e0 msgr2=0x7f083415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.599 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08340b87e0 0x7f083415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 -- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08340d27a0 msgr2=0x7f08341e8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08340d27a0 0x7f08341e8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 -- 172.21.15.144:0/3441421163 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009550 con 0x7f08340d02c0 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0838b9a700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f082400c4e0 tx=0x7f082400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08240052d0 con 0x7f08340d02c0 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824005430 con 0x7f08340d02c0 2023-05-11T07:36:21.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.593+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08340cd9b0 con 0x7f08340d02c0 2023-05-11T07:36:21.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.594+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08240038c0 con 0x7f08340d02c0 2023-05-11T07:36:21.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.594+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08340d2d30 con 0x7f08340d02c0 2023-05-11T07:36:21.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.595+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08340cdc90 con 0x7f08340d02c0 2023-05-11T07:36:21.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.596+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0824003a20 con 0x7f08340d02c0 2023-05-11T07:36:21.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.597+0000 7f0829ffb700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 0x7f081806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:21.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.597+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0824088a70 con 0x7f08340d02c0 2023-05-11T07:36:21.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.597+0000 7f083939b700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 0x7f081806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:21.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.598+0000 7f083939b700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 0x7f081806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0830009c10 tx=0x7f0830008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:21.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.601+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0824053750 con 0x7f08340d02c0 2023-05-11T07:36:21.848 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.845+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f083415ced0 con 0x7f08340d02c0 2023-05-11T07:36:21.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.846+0000 7f0829ffb700 1 -- 172.21.15.144:0/3441421163 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f0824056d70 con 0x7f08340d02c0 2023-05-11T07:36:21.849 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:36:21.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 msgr2=0x7f081806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.851 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 0x7f081806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0830009c10 tx=0x7f0830008030 comp rx=0 tx=0).stop 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 msgr2=0x7f08341e85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f082400c4e0 tx=0x7f082400c7f0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 shutdown_connections 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f081806ace0 0x7f081806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f08340b87e0 0x7f083415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08340d27a0 0x7f08341e8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 --2- 172.21.15.144:0/3441421163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08340d02c0 0x7f08341e85a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 >> 172.21.15.144:0/3441421163 conn(0x7f083406acf0 msgr2=0x7f083415c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 shutdown_connections 2023-05-11T07:36:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:21.848+0000 7f083b5ff700 1 -- 172.21.15.144:0/3441421163 wait complete. 2023-05-11T07:36:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:36:22.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T07:35:39.989779+0000', 'modified': '2023-05-11T07:36:07.268421+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6834/3653158291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 3653158291}, {'type': 'v1', 'addr': '172.21.15.145:6834', 'nonce': 3653158291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-11T07:36:22.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T07:36:22.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-11T07:36:22.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.456+0000 7f06835ff700 1 Processor -- start 2023-05-11T07:36:22.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.456+0000 7f06835ff700 1 -- start start 2023-05-11T07:36:22.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f06835ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f067c15c940 0x7f067c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f06835ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f06835ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c0d0e80 con 0x7f067c0b6420 2023-05-11T07:36:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f06835ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c161420 con 0x7f067c15c940 2023-05-11T07:36:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f06835ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0cdb00 con 0x7f067c0b5fd0 2023-05-11T07:36:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f068139b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f067c15c940 0x7f067c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f068139b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f067c15c940 0x7f067c160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35422/0 (socket says 172.21.15.144:35422) 2023-05-11T07:36:22.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f068139b700 1 -- 172.21.15.144:0/3141091509 learned_addr learned my addr 172.21.15.144:0/3141091509 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f0680b9a700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.457+0000 7f068139b700 1 -- 172.21.15.144:0/3141091509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 msgr2=0x7f067c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f068139b700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c06ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f068139b700 1 -- 172.21.15.144:0/3141091509 >> v1:172.21.15.145:6789/0 conn(0x7f067c0b6420 legacy=0x7f067c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f068139b700 1 -- 172.21.15.144:0/3141091509 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0cdde0 con 0x7f067c15c940 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f0680b9a700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f068139b700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c15c940 0x7f067c160ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06780098f0 tx=0x7f0678009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1e11635799c177 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f0673fff700 1 -- 172.21.15.144:0/3141091509 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678004230 con 0x7f067c15c940 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f0673fff700 1 -- 172.21.15.144:0/3141091509 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678004390 con 0x7f067c15c940 2023-05-11T07:36:22.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.458+0000 7f0673fff700 1 -- 172.21.15.144:0/3141091509 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780036a0 con 0x7f067c15c940 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 -- 172.21.15.144:0/3141091509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c15c940 msgr2=0x7f067c160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c15c940 0x7f067c160ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06780098f0 tx=0x7f0678009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 -- 172.21.15.144:0/3141091509 shutdown_connections 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c15c940 0x7f067c160ee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 --2- 172.21.15.144:0/3141091509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 -- 172.21.15.144:0/3141091509 >> 172.21.15.144:0/3141091509 conn(0x7f067c0d3180 msgr2=0x7f067c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 -- 172.21.15.144:0/3141091509 shutdown_connections 2023-05-11T07:36:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.459+0000 7f06835ff700 1 -- 172.21.15.144:0/3141091509 wait complete. 2023-05-11T07:36:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.461+0000 7f06835ff700 1 Processor -- start 2023-05-11T07:36:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.461+0000 7f06835ff700 1 -- start start 2023-05-11T07:36:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f067c15c940 0x7f067c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c15cf30 con 0x7f067c0b6420 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c1f6cd0 con 0x7f067c15c940 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.462+0000 7f06835ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c15d760 con 0x7f067c0b5fd0 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35436/0 (socket says 172.21.15.144:35436) 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f068139b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 -- 172.21.15.144:0/841431576 learned_addr learned my addr 172.21.15.144:0/841431576 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0681b9c700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f067c15c940 0x7f067c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 -- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 msgr2=0x7f067c1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 -- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f067c15c940 msgr2=0x7f067c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f067c15c940 0x7f067c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 -- 172.21.15.144:0/841431576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009550 con 0x7f067c0b6420 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.463+0000 7f0680b9a700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c750 tx=0x7f066c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.464+0000 7f0671ffb700 1 -- 172.21.15.144:0/841431576 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c011800 con 0x7f067c0b6420 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.464+0000 7f0671ffb700 1 -- 172.21.15.144:0/841431576 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c011960 con 0x7f067c0b6420 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.464+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c0d1400 con 0x7f067c0b6420 2023-05-11T07:36:22.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.464+0000 7f0671ffb700 1 -- 172.21.15.144:0/841431576 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c011cd0 con 0x7f067c0b6420 2023-05-11T07:36:22.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.464+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c0d1120 con 0x7f067c0b6420 2023-05-11T07:36:22.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.466+0000 7f0671ffb700 1 -- 172.21.15.144:0/841431576 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f066c021350 con 0x7f067c0b6420 2023-05-11T07:36:22.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.467+0000 7f0671ffb700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 0x7f066006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.467+0000 7f0671ffb700 1 -- 172.21.15.144:0/841431576 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f066c0895d0 con 0x7f067c0b6420 2023-05-11T07:36:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.468+0000 7f068139b700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 0x7f066006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.468+0000 7f068139b700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 0x7f066006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0678009130 tx=0x7f0678008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.469+0000 7f0696f40b80 1 Processor -- start 2023-05-11T07:36:22.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.469+0000 7f0696f40b80 1 -- start start 2023-05-11T07:36:22.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5614910772d0 0x56149105b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56149102e740 0x56149105b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561490f1a600 con 0x561491076230 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561490f89790 con 0x56149102e740 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.470+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x561490f82a60 con 0x5614910772d0 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35438/0 (socket says 172.21.15.144:35438) 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 -- 172.21.15.144:0/33151935 learned_addr learned my addr 172.21.15.144:0/33151935 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f0680b9a700 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5614910772d0 0x56149105b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f0681b9c700 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56149102e740 0x56149105b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 -- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5614910772d0 msgr2=0x56149105b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5614910772d0 0x56149105b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 -- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56149102e740 msgr2=0x56149105b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56149102e740 0x56149105b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 -- 172.21.15.144:0/33151935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561490d76790 con 0x561491076230 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f068139b700 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f067800b0e0 tx=0x7f0678010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1274758fedd30035 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.471+0000 7f0666ffd700 1 -- 172.21.15.144:0/33151935 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800b660 con 0x561491076230 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0666ffd700 1 -- 172.21.15.144:0/33151935 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800b7c0 con 0x561491076230 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0666ffd700 1 -- 172.21.15.144:0/33151935 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800bb30 con 0x561491076230 2023-05-11T07:36:22.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 -- 172.21.15.144:0/33151935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 msgr2=0x561491076600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f067800b0e0 tx=0x7f0678010000 comp rx=0 tx=0).stop 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 -- 172.21.15.144:0/33151935 shutdown_connections 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56149102e740 0x56149105b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491076600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 --2- 172.21.15.144:0/33151935 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x5614910772d0 0x56149105b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 -- 172.21.15.144:0/33151935 >> 172.21.15.144:0/33151935 conn(0x561491025b60 msgr2=0x56149102b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 -- 172.21.15.144:0/33151935 shutdown_connections 2023-05-11T07:36:22.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.472+0000 7f0696f40b80 1 -- 172.21.15.144:0/33151935 wait complete. 2023-05-11T07:36:22.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.473+0000 7f0696f40b80 1 -- start start 2023-05-11T07:36:22.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.474+0000 7f0696f40b80 1 Processor -- start 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x561491076230 0x56149107a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x5614910579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561490f1ead0 con 0x56149102e740 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561490f1e770 con 0x5614910772d0 2023-05-11T07:36:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x561490d77390 con 0x561491076230 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f0696f40b80 10 client.0 _ll_register_callbacks cb 0x561490f20400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f068139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f068139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35444/0 (socket says 172.21.15.144:35444) 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.475+0000 7f068139b700 1 -- 172.21.15.144:0/4280862337 learned_addr learned my addr 172.21.15.144:0/4280862337 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 -- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x561491076230 msgr2=0x56149107a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x561491076230 0x56149107a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f0681b9c700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x5614910579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 -- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 msgr2=0x5614910579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x5614910579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 -- 172.21.15.144:0/4280862337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c0cdde0 con 0x56149102e740 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f0681b9c700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x5614910579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f068139b700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0678004140 tx=0x7f06780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a865c9b0c3ac4b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f065bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067802f480 con 0x56149102e740 2023-05-11T07:36:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f067802f5e0 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.476+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561491023170 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f067802f7a0 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 10 client.4851 fetch_fsmap learned FSMap version 9 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561490f492e0 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561491023170 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f067802f900 con 0x56149102e740 2023-05-11T07:36:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 10 client.4851 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 20 client.4851 populate_metadata read hostname 'smithi144' 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x5614910786c0 0x561491078a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 4 client.4851 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.477+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 --> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614910002f0 con 0x5614910786c0 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.478+0000 7f0680b9a700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x5614910786c0 0x561491078a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.478+0000 7f065bfff700 10 client.4851 ms_handle_connect on v2:172.21.15.145:6832/3653158291 2023-05-11T07:36:22.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.478+0000 7f0680b9a700 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x5614910786c0 0x561491078a90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a75cb57ed1c32d3 server_cookie=a50875e608c97cf5 in_seq=0 out_seq=0 2023-05-11T07:36:22.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f065bfff700 1 -- 172.21.15.144:0/4280862337 <== mds.0 v2:172.21.15.145:6832/3653158291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x5614910002f0 con 0x5614910786c0 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f065bfff700 10 client.4851 handle_command_reply: tid=0 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 client.4851 shutdown 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 msgr2=0x56149104f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0678004140 tx=0x7f06780047c0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 shutdown_connections 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x5614910786c0 0x561491078a90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x5614910579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56149102e740 0x56149104f8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f065bfff700 0 client.4851 ms_handle_reset on v2:172.21.15.145:6832/3653158291 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 --2- 172.21.15.144:0/4280862337 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x561491076230 0x56149107a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 >> 172.21.15.144:0/4280862337 conn(0x561491025b60 msgr2=0x5614910303d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.479+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 shutdown_connections 2023-05-11T07:36:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.480+0000 7f0696f40b80 1 -- 172.21.15.144:0/4280862337 wait complete. 2023-05-11T07:36:22.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.480+0000 7f0696f40b80 20 client.4851 trim_cache size 0 max 16384 2023-05-11T07:36:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.498+0000 7f0696f40b80 1 Processor -- start 2023-05-11T07:36:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.498+0000 7f0696f40b80 1 -- start start 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149102c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x561491030660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561491022e30 con 0x561491076230 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561491079c30 con 0x5614910772d0 2023-05-11T07:36:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x561491031610 con 0x56149102e740 2023-05-11T07:36:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f068139b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149102c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35458/0 (socket says 172.21.15.144:35458) 2023-05-11T07:36:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 -- 172.21.15.144:0/3004429748 learned_addr learned my addr 172.21.15.144:0/3004429748 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0681b9c700 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x561491030660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 -- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 msgr2=0x56149102c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149102c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 -- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 msgr2=0x561491030660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x561491030660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 -- 172.21.15.144:0/3004429748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561490f49030 con 0x561491076230 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.499+0000 7f0680b9a700 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f066c054500 tx=0x7f066c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1c1ee7d9f56a5d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f06677fe700 1 -- 172.21.15.144:0/3004429748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0563a0 con 0x561491076230 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f06677fe700 1 -- 172.21.15.144:0/3004429748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c05fec0 con 0x561491076230 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f06677fe700 1 -- 172.21.15.144:0/3004429748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0890b0 con 0x561491076230 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 -- 172.21.15.144:0/3004429748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 msgr2=0x561491030120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f066c054500 tx=0x7f066c000bc0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 -- 172.21.15.144:0/3004429748 shutdown_connections 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149102c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5614910772d0 0x561491030660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 --2- 172.21.15.144:0/3004429748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561491076230 0x561491030120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 -- 172.21.15.144:0/3004429748 >> 172.21.15.144:0/3004429748 conn(0x561491025b60 msgr2=0x56149102a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 -- 172.21.15.144:0/3004429748 shutdown_connections 2023-05-11T07:36:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.500+0000 7f0696f40b80 1 -- 172.21.15.144:0/3004429748 wait complete. 2023-05-11T07:36:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.501+0000 7f0696f40b80 1 -- start start 2023-05-11T07:36:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.501+0000 7f0696f40b80 1 Processor -- start 2023-05-11T07:36:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149104f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561491076230 0x56149106bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614910d4330 con 0x5614910772d0 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149108ea00 con 0x561491076230 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x56149108ece0 con 0x56149102e740 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.502+0000 7f0696f40b80 10 client.0 _ll_register_callbacks cb 0x561490f20400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:36:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0680b9a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561491076230 0x56149106bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35466/0 (socket says 172.21.15.144:35466) 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f068139b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149104f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 -- 172.21.15.144:0/2611878183 learned_addr learned my addr 172.21.15.144:0/2611878183 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 -- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 msgr2=0x56149104f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149104f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 -- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561491076230 msgr2=0x56149106bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561491076230 0x56149106bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 -- 172.21.15.144:0/2611878183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c0d1120 con 0x5614910772d0 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f0681b9c700 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0674015d90 tx=0x7f06740135b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e837223d56f1a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.503+0000 7f065bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674005020 con 0x5614910772d0 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0674005180 con 0x5614910772d0 2023-05-11T07:36:22.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f067800b7c0 con 0x5614910772d0 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0674005340 con 0x5614910772d0 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 10 client.4857 fetch_fsmap learned FSMap version 9 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561490f2fb10 con 0x5614910772d0 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800b7c0 con 0x5614910772d0 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0674013a90 con 0x5614910772d0 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 10 client.4857 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T07:36:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 20 client.4857 populate_metadata read hostname 'smithi144' 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x561491087be0 0x561491087fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 4 client.4857 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.504+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 --> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561490f7bba0 con 0x561491087be0 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f068139b700 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x561491087be0 0x561491087fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f068139b700 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x561491087be0 0x561491087fb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3921f1d2e28f9de5 server_cookie=5a5e54bb64a1d3fe in_seq=0 out_seq=0 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f065bfff700 10 client.4857 ms_handle_connect on v2:172.21.15.145:6832/3653158291 2023-05-11T07:36:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f065bfff700 1 -- 172.21.15.144:0/2611878183 <== mds.0 v2:172.21.15.145:6832/3653158291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561490f7bba0 con 0x561491087be0 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f065bfff700 10 client.4857 handle_command_reply: tid=0 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.505+0000 7f0696f40b80 1 client.4857 shutdown 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 msgr2=0x56149106c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0674015d90 tx=0x7f06740135b0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 shutdown_connections 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x56149102e740 0x56149104f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:6832/3653158291,v1:172.21.15.145:6834/3653158291] conn(0x561491087be0 0x561491087fb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5614910772d0 0x56149106c050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 --2- 172.21.15.144:0/2611878183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561491076230 0x56149106bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f065bfff700 0 client.4857 ms_handle_reset on v2:172.21.15.145:6832/3653158291 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 >> 172.21.15.144:0/2611878183 conn(0x561491025b60 msgr2=0x5614910270d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 shutdown_connections 2023-05-11T07:36:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 1 -- 172.21.15.144:0/2611878183 wait complete. 2023-05-11T07:36:22.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f0696f40b80 20 client.4857 trim_cache size 0 max 16384 2023-05-11T07:36:22.518 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-05-11T07:36:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "424d6242-b269-485d-aca8-83f4424787ea", 2023-05-11T07:36:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4306, 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 42.513212779, 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 9, 2023-05-11T07:36:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 29, 2023-05-11T07:36:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 27, 2023-05-11T07:36:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 48.503635410999998 2023-05-11T07:36:22.520 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-05-11T07:36:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 msgr2=0x7f066006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 0x7f066006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0678009130 tx=0x7f0678008030 comp rx=0 tx=0).stop 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 msgr2=0x7f067c14fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.506+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c750 tx=0x7f066c00ca60 comp rx=0 tx=0).stop 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 shutdown_connections 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f066006ace0 0x7f066006d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f067c0b5fd0 0x7f067c1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f067c15c940 0x7f067c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 --2- 172.21.15.144:0/841431576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f067c0b6420 0x7f067c14fcc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 >> 172.21.15.144:0/841431576 conn(0x7f067c0d3180 msgr2=0x7f067c0b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 shutdown_connections 2023-05-11T07:36:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:22.507+0000 7f06835ff700 1 -- 172.21.15.144:0/841431576 wait complete. 2023-05-11T07:36:22.526 INFO:teuthology.run_tasks:Running task kclient... 2023-05-11T07:36:22.540 INFO:tasks.kclient:Mounting kernel clients... 2023-05-11T07:36:22.540 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-11T07:36:22.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.541 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:36:22.583 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-11T07:36:22.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-11T07:36:22.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-05-11T07:36:22.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.781 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:36:22.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-05-11T07:36:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-05-11T07:36:22.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:36:22.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.936 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-05-11T07:36:22.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:22.985 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2023-05-11T07:36:23.055 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2023-05-11T07:36:23.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:36:23.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.058 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-05-11T07:36:23.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link delete ceph-brx 2023-05-11T07:36:23.205 INFO:teuthology.orchestra.run.smithi145.stderr:Cannot find device "ceph-brx" 2023-05-11T07:36:23.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:36:23.207 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-05-11T07:36:23.207 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T07:36:23.208 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T07:36:23.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:36:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.390+0000 7f06a05ff700 1 Processor -- start 2023-05-11T07:36:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.391+0000 7f06a05ff700 1 -- start start 2023-05-11T07:36:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f06a05ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06981597f0 0x7f06980c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f06a05ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f069806a2d0 0x7f069806a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f06a05ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0698159bc0 con 0x7f069815dc80 2023-05-11T07:36:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f06a05ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069806ac50 con 0x7f06981597f0 2023-05-11T07:36:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f06a05ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069815e120 con 0x7f069806a2d0 2023-05-11T07:36:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06981597f0 0x7f06980c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06981597f0 0x7f06980c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35476/0 (socket says 172.21.15.144:35476) 2023-05-11T07:36:23.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 -- 172.21.15.144:0/422953374 learned_addr learned my addr 172.21.15.144:0/422953374 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069eb9c700 1 --2- 172.21.15.144:0/422953374 >> v2:172.21.15.145:3300/0 conn(0x7f069806a2d0 0x7f069806a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 -- 172.21.15.144:0/422953374 >> v2:172.21.15.145:3300/0 conn(0x7f069806a2d0 msgr2=0x7f069806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 --2- 172.21.15.144:0/422953374 >> v2:172.21.15.145:3300/0 conn(0x7f069806a2d0 0x7f069806a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 -- 172.21.15.144:0/422953374 >> v1:172.21.15.144:6789/0 conn(0x7f069815dc80 legacy=0x7f06980cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.392+0000 7f069e39b700 1 -- 172.21.15.144:0/422953374 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980c9e30 con 0x7f06981597f0 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f069e39b700 1 --2- 172.21.15.144:0/422953374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06981597f0 0x7f06980c9730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f06980b4c90 tx=0x7f069400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe167dea752f7f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f069d399700 1 -- 172.21.15.144:0/422953374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400dd30 con 0x7f06981597f0 2023-05-11T07:36:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f069d399700 1 -- 172.21.15.144:0/422953374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400de90 con 0x7f06981597f0 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f069d399700 1 -- 172.21.15.144:0/422953374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694010690 con 0x7f06981597f0 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f06a05ff700 1 -- 172.21.15.144:0/422953374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06981597f0 msgr2=0x7f06980c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.393+0000 7f06a05ff700 1 --2- 172.21.15.144:0/422953374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06981597f0 0x7f06980c9730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f06980b4c90 tx=0x7f069400be70 comp rx=0 tx=0).stop 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 -- 172.21.15.144:0/422953374 shutdown_connections 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 --2- 172.21.15.144:0/422953374 >> v2:172.21.15.145:3300/0 conn(0x7f069806a2d0 0x7f069806a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 --2- 172.21.15.144:0/422953374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06981597f0 0x7f06980c9730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 -- 172.21.15.144:0/422953374 >> 172.21.15.144:0/422953374 conn(0x7f06980cb7e0 msgr2=0x7f06980cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 -- 172.21.15.144:0/422953374 shutdown_connections 2023-05-11T07:36:23.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.394+0000 7f06a05ff700 1 -- 172.21.15.144:0/422953374 wait complete. 2023-05-11T07:36:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.395+0000 7f06a05ff700 1 Processor -- start 2023-05-11T07:36:23.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.396+0000 7f06a05ff700 1 -- start start 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.396+0000 7f06a05ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.396+0000 7f06a05ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06981597f0 0x7f06980c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.396+0000 7f06a05ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f069815dc80 0x7f069806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f06a05ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7730 con 0x7f069806a2d0 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f06a05ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7920 con 0x7f069815dc80 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f06a05ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7c00 con 0x7f06981597f0 2023-05-11T07:36:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35484/0 (socket says 172.21.15.144:35484) 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069db9a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06981597f0 0x7f06980c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 -- 172.21.15.144:0/4130761560 learned_addr learned my addr 172.21.15.144:0/4130761560 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069eb9c700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f069815dc80 0x7f069806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 -- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06981597f0 msgr2=0x7f06980c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06981597f0 0x7f06980c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 -- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f069815dc80 msgr2=0x7f069806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f069815dc80 0x7f069806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 -- 172.21.15.144:0/4130761560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069400b7f0 con 0x7f069806a2d0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.397+0000 7f069e39b700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0694000c00 tx=0x7f0694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.398+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694003c70 con 0x7f069806a2d0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.398+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0694003df0 con 0x7f069806a2d0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.398+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980cccb0 con 0x7f069806a2d0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.398+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940106b0 con 0x7f069806a2d0 2023-05-11T07:36:23.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.398+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980ca110 con 0x7f069806a2d0 2023-05-11T07:36:23.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.399+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06980ccf90 con 0x7f069806a2d0 2023-05-11T07:36:23.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.400+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0694019400 con 0x7f069806a2d0 2023-05-11T07:36:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.401+0000 7f068effd700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 0x7f067c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.401+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f069408aac0 con 0x7f069806a2d0 2023-05-11T07:36:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.401+0000 7f069db9a700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 0x7f067c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:23.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.401+0000 7f069db9a700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 0x7f067c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06981589b0 tx=0x7f0688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:23.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.405+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0694055840 con 0x7f069806a2d0 2023-05-11T07:36:23.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.641+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0698074530 con 0x7f069806a2d0 2023-05-11T07:36:23.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.641+0000 7f068effd700 1 -- 172.21.15.144:0/4130761560 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0694058e60 con 0x7f069806a2d0 2023-05-11T07:36:23.645 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T07:36:23.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 msgr2=0x7f067c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 0x7f067c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06981589b0 tx=0x7f0688009040 comp rx=0 tx=0).stop 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 msgr2=0x7f06980c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0694000c00 tx=0x7f0694004750 comp rx=0 tx=0).stop 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 shutdown_connections 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f067c06ace0 0x7f067c06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f069815dc80 0x7f069806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f069806a2d0 0x7f06980c89c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 --2- 172.21.15.144:0/4130761560 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06981597f0 0x7f06980c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:23.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 >> 172.21.15.144:0/4130761560 conn(0x7f06980cb7e0 msgr2=0x7f0698070790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:23.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 shutdown_connections 2023-05-11T07:36:23.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:23.644+0000 7f06a05ff700 1 -- 172.21.15.144:0/4130761560 wait complete. 2023-05-11T07:36:23.664 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T07:36:23.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:36:23.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-05-11T07:36:23.665 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-11T07:36:23.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T07:36:23.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T07:36:23.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T07:36:23.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:36:23.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T07:36:23.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.667 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-05-11T07:36:23.708 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:23.709 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:23.709 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:23.709 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:23.709 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:23.709 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:23.710 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42291sec preferred_lft 42291sec 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-05-11T07:36:23.711 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:23.712 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T07:36:23.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.712 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:23.712 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:23.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-05-11T07:36:23.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-05-11T07:36:23.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-05-11T07:36:23.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T07:36:23.714 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:23.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.927 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:36:23.988 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-05-11T07:36:23.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:23.991 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-05-11T07:36:24.036 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-05-11T07:36:24.036 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:36:24.037 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:36:24.037 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:36:24.037 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:36:24.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.038 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:24.038 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:24.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:36:24.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:36:24.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:36:24.039 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:24.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.228 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:36:24.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.270 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-05-11T07:36:24.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.351 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:24.351 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:24.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T07:36:24.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-11T07:36:24.352 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:24.518 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-11T07:36:24.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.519 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:24.519 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:24.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-11T07:36:24.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T07:36:24.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-11T07:36:24.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-11T07:36:24.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-11T07:36:24.520 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:24.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:24.743 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:24.743 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:24.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-05-11T07:36:24.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T07:36:24.744 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:24.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:24.909 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-11T07:36:24.950 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-11T07:36:24.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:24.951 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-11T07:36:25.031 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-11T07:36:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:36:25.167 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:36:25.168 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:36:25.168 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:25.576 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:36:25.576 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:36:25.576 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:25.577 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:25.577 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:25.601 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:36:25.601 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:36:25.601 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:25.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:25.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:25.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790" 2023-05-11T07:36:25.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2023-05-11T07:36:25.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=424d6242-b269-485d-aca8-83f4424787ea" will pass to kernel 2023-05-11T07:36:25.606 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-11T07:36:25.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-11T07:36:25.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.671 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:25.750 INFO:teuthology.orchestra.run.smithi144.stdout:client4869 2023-05-11T07:36:25.750 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:25.751 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:25.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.793 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:25.911 INFO:teuthology.orchestra.run.smithi144.stdout:client4869 2023-05-11T07:36:25.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.912 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:25.990 INFO:teuthology.orchestra.run.smithi144.stdout:client4869 2023-05-11T07:36:25.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:25.991 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/424d6242-b269-485d-aca8-83f4424787ea.client4869/status') 2023-05-11T07:36:26.088 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4869 (3)192.168.0.1:0/1768567595 2023-05-11T07:36:26.088 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2023-05-11T07:36:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2023-05-11T07:36:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2023-05-11T07:36:26.089 INFO:teuthology.orchestra.run.smithi144.stderr:69 bytes copied, 6.6993e-05 s, 1.0 MB/s 2023-05-11T07:36:26.090 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-05-11T07:36:26.090 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T07:36:26.091 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-11T07:36:26.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:36:26.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.271+0000 7f35ff9ff700 1 Processor -- start 2023-05-11T07:36:26.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.272+0000 7f35ff9ff700 1 -- start start 2023-05-11T07:36:26.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35ff9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f35f81597f0 0x7f35f80c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35ff9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35f806a2d0 0x7f35f806a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35ff9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f8159bc0 con 0x7f35f815dc80 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35ff9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f806ac50 con 0x7f35f806a2d0 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35ff9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f815e120 con 0x7f35f81597f0 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35f806a2d0 0x7f35f806a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35f806a2d0 0x7f35f806a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42640/0 (socket says 172.21.15.144:42640) 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 -- 172.21.15.144:0/2000367339 learned_addr learned my addr 172.21.15.144:0/2000367339 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:26.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fd79b700 1 --2- 172.21.15.144:0/2000367339 >> v2:172.21.15.145:3300/0 conn(0x7f35f81597f0 0x7f35f80c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.278 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 -- 172.21.15.144:0/2000367339 >> v2:172.21.15.145:3300/0 conn(0x7f35f81597f0 msgr2=0x7f35f80c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 --2- 172.21.15.144:0/2000367339 >> v2:172.21.15.145:3300/0 conn(0x7f35f81597f0 0x7f35f80c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 -- 172.21.15.144:0/2000367339 >> v1:172.21.15.145:6789/0 conn(0x7f35f815dc80 legacy=0x7f35f80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.273+0000 7f35fdf9c700 1 -- 172.21.15.144:0/2000367339 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80c9e30 con 0x7f35f806a2d0 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35fdf9c700 1 --2- 172.21.15.144:0/2000367339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f806a2d0 0x7f35f806a710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f35f806fa30 tx=0x7f35f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32f3002913880ec server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35effff700 1 -- 172.21.15.144:0/2000367339 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000e070 con 0x7f35f806a2d0 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35effff700 1 -- 172.21.15.144:0/2000367339 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0003a20 con 0x7f35f806a2d0 2023-05-11T07:36:26.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35effff700 1 -- 172.21.15.144:0/2000367339 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0003dd0 con 0x7f35f806a2d0 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 -- 172.21.15.144:0/2000367339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f806a2d0 msgr2=0x7f35f806a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/2000367339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f806a2d0 0x7f35f806a710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f35f806fa30 tx=0x7f35f000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 -- 172.21.15.144:0/2000367339 shutdown_connections 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/2000367339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f806a2d0 0x7f35f806a710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/2000367339 >> v2:172.21.15.145:3300/0 conn(0x7f35f81597f0 0x7f35f80c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.274+0000 7f35ff9ff700 1 -- 172.21.15.144:0/2000367339 >> 172.21.15.144:0/2000367339 conn(0x7f35f80cb7e0 msgr2=0x7f35f80cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.275+0000 7f35ff9ff700 1 -- 172.21.15.144:0/2000367339 shutdown_connections 2023-05-11T07:36:26.281 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.275+0000 7f35ff9ff700 1 -- 172.21.15.144:0/2000367339 wait complete. 2023-05-11T07:36:26.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.276+0000 7f35ff9ff700 1 Processor -- start 2023-05-11T07:36:26.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.276+0000 7f35ff9ff700 1 -- start start 2023-05-11T07:36:26.282 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806a2d0 0x7f35f8151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 0x7f35f80c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80c38f0 con 0x7f35f81597f0 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b1ca0 con 0x7f35f815dc80 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.277+0000 7f35ff9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80c2c70 con 0x7f35f806a2d0 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42654/0 (socket says 172.21.15.144:42654) 2023-05-11T07:36:26.283 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 -- 172.21.15.144:0/391498325 learned_addr learned my addr 172.21.15.144:0/391498325 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fdf9c700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 0x7f35f80c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fd79b700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806a2d0 0x7f35f8151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 -- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806a2d0 msgr2=0x7f35f8151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806a2d0 0x7f35f8151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 -- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 msgr2=0x7f35f80c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 0x7f35f80c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 -- 172.21.15.144:0/391498325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009b30 con 0x7f35f81597f0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fdf9c700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 0x7f35f80c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35fcf9a700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c500 tx=0x7f35e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8011790 con 0x7f35f81597f0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80118f0 con 0x7f35f81597f0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f80cccb0 con 0x7f35f81597f0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.278+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8011ca0 con 0x7f35f81597f0 2023-05-11T07:36:26.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.279+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f80ca110 con 0x7f35f81597f0 2023-05-11T07:36:26.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.279+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f80ccf90 con 0x7f35f81597f0 2023-05-11T07:36:26.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.280+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35e801c460 con 0x7f35f81597f0 2023-05-11T07:36:26.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.281+0000 7f35edffb700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 0x7f35dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:26.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.281+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35e8089620 con 0x7f35f81597f0 2023-05-11T07:36:26.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.282+0000 7f35fd79b700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 0x7f35dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:26.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.282+0000 7f35fd79b700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 0x7f35dc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009930 tx=0x7f35f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:26.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.286+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f35e8054390 con 0x7f35f81597f0 2023-05-11T07:36:26.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.523+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35f80c3a30 con 0x7f35f81597f0 2023-05-11T07:36:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.523+0000 7f35edffb700 1 -- 172.21.15.144:0/391498325 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f35f80c3a30 con 0x7f35f81597f0 2023-05-11T07:36:26.527 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T07:36:26.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 msgr2=0x7f35dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:26.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 0x7f35dc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009930 tx=0x7f35f4008040 comp rx=0 tx=0).stop 2023-05-11T07:36:26.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 msgr2=0x7f35f81e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:26.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c500 tx=0x7f35e800c8c0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 shutdown_connections 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f35dc06ace0 0x7f35dc06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.525+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f35f806a2d0 0x7f35f8151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.526+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35f815dc80 0x7f35f80c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.526+0000 7f35ff9ff700 1 --2- 172.21.15.144:0/391498325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f81597f0 0x7f35f81e6550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.526+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 >> 172.21.15.144:0/391498325 conn(0x7f35f80cb7e0 msgr2=0x7f35f80cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.526+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 shutdown_connections 2023-05-11T07:36:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:26.526+0000 7f35ff9ff700 1 -- 172.21.15.144:0/391498325 wait complete. 2023-05-11T07:36:26.546 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T07:36:26.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:36:26.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-05-11T07:36:26.547 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-11T07:36:26.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-11T07:36:26.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T07:36:26.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T07:36:26.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:36:26.548 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-11T07:36:26.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.548 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-05-11T07:36:26.590 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:26.590 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:26.590 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:26.590 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:26.591 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-05-11T07:36:26.592 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:bc:82:48:be:48 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f8e9:c2ff:fe53:c8ef/64 scope link 2023-05-11T07:36:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.594 INFO:teuthology.orchestra.run.smithi144.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T07:36:26.594 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:bc:82:48:be:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T07:36:26.594 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::cbc:82ff:fe48:be48/64 scope link 2023-05-11T07:36:26.594 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:26.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.595 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:36:26.690 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-05-11T07:36:26.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.693 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-05-11T07:36:26.737 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-05-11T07:36:26.737 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:36:26.737 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:36:26.737 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:36:26.737 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:36:26.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.738 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:26.738 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:26.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:36:26.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:36:26.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:36:26.739 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:26.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.928 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:36:26.969 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-11T07:36:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:26.970 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-05-11T07:36:27.051 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-11T07:36:27.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.052 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:27.052 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:27.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-11T07:36:27.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-11T07:36:27.053 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:27.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-11T07:36:27.281 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.282 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether b2:fb:9e:ba:ce:a4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T07:36:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T07:36:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::b0fb:9eff:feba:cea4/64 scope link 2023-05-11T07:36:27.283 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:27.349 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether b2:fb:9e:ba:ce:a4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::b0fb:9eff:feba:cea4/64 scope link 2023-05-11T07:36:27.350 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:27.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-11T07:36:27.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.352 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:27.352 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:27.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-11T07:36:27.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-11T07:36:27.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-11T07:36:27.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-11T07:36:27.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-11T07:36:27.354 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:27.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.576 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:36:27.576 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:36:27.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2023-05-11T07:36:27.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2023-05-11T07:36:27.577 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:36:27.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:27.743 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-11T07:36:27.785 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-11T07:36:27.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:27.785 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-11T07:36:27.866 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-11T07:36:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:27.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-05-11T07:36:28.002 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-05-11T07:36:28.002 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-05-11T07:36:28.003 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:28.018 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-05-11T07:36:28.018 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-05-11T07:36:28.018 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:28.018 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:28.018 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:28.040 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790" 2023-05-11T07:36:28.041 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2023-05-11T07:36:28.041 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=424d6242-b269-485d-aca8-83f4424787ea" will pass to kernel 2023-05-11T07:36:28.044 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-11T07:36:28.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-11T07:36:28.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.107 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:28.185 INFO:teuthology.orchestra.run.smithi144.stdout:client4878 2023-05-11T07:36:28.186 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:28.186 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:28.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.229 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:28.346 INFO:teuthology.orchestra.run.smithi144.stdout:client4878 2023-05-11T07:36:28.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.347 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:28.425 INFO:teuthology.orchestra.run.smithi144.stdout:client4878 2023-05-11T07:36:28.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.426 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/424d6242-b269-485d-aca8-83f4424787ea.client4878/status') 2023-05-11T07:36:28.525 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4878 (3)192.168.0.2:0/522853050 2023-05-11T07:36:28.525 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2023-05-11T07:36:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2023-05-11T07:36:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2023-05-11T07:36:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:68 bytes copied, 4.8582e-05 s, 1.4 MB/s 2023-05-11T07:36:28.527 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-05-11T07:36:28.528 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T07:36:28.528 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-11T07:36:28.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:36:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.709+0000 7fdc70fff700 1 Processor -- start 2023-05-11T07:36:28.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.710+0000 7fdc70fff700 1 -- start start 2023-05-11T07:36:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc70fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 0x7fdc6c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc70fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdc6c06a2d0 0x7fdc6c06a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc70fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c15e1c0 con 0x7fdc6c1597f0 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc70fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6c06ac90 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc70fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c159bc0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc6a59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdc6c1597f0 0x7fdc6c0cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33706/0 (socket says 172.21.15.144:33706) 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc6a59c700 1 -- 172.21.15.144:0/2300863343 learned_addr learned my addr 172.21.15.144:0/2300863343 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc63fff700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 0x7fdc6c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc6ad9d700 1 --2- 172.21.15.144:0/2300863343 >> v2:172.21.15.145:3300/0 conn(0x7fdc6c06a2d0 0x7fdc6c06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc69d9b700 1 -- 172.21.15.144:0/2300863343 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009950849 0 0) 0x7fdc6c15e1c0 con 0x7fdc6c1597f0 2023-05-11T07:36:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.711+0000 7fdc69d9b700 1 -- 172.21.15.144:0/2300863343 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc580035b0 con 0x7fdc6c1597f0 2023-05-11T07:36:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc6ad9d700 1 -- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 msgr2=0x7fdc6c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc6ad9d700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 0x7fdc6c15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc6ad9d700 1 -- 172.21.15.144:0/2300863343 >> v1:172.21.15.144:6789/0 conn(0x7fdc6c1597f0 legacy=0x7fdc6c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc6ad9d700 1 -- 172.21.15.144:0/2300863343 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0c9ba0 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc63fff700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 0x7fdc6c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc6ad9d700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c06a2d0 0x7fdc6c06a750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009d90 tx=0x7fdc6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a314e070d2e5267d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc69d9b700 1 -- 172.21.15.144:0/2300863343 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400bd20 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc69d9b700 1 -- 172.21.15.144:0/2300863343 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400be80 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.712+0000 7fdc69d9b700 1 -- 172.21.15.144:0/2300863343 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640116a0 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 -- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c06a2d0 msgr2=0x7fdc6c06a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c06a2d0 0x7fdc6c06a750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009d90 tx=0x7fdc6400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 -- 172.21.15.144:0/2300863343 shutdown_connections 2023-05-11T07:36:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c06a2d0 0x7fdc6c06a750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2300863343 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c0c9730 0x7fdc6c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 -- 172.21.15.144:0/2300863343 >> 172.21.15.144:0/2300863343 conn(0x7fdc6c0cb7e0 msgr2=0x7fdc6c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 -- 172.21.15.144:0/2300863343 shutdown_connections 2023-05-11T07:36:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.713+0000 7fdc70fff700 1 -- 172.21.15.144:0/2300863343 wait complete. 2023-05-11T07:36:28.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.715+0000 7fdc70fff700 1 Processor -- start 2023-05-11T07:36:28.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.715+0000 7fdc70fff700 1 -- start start 2023-05-11T07:36:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c06a2d0 0x7fdc6c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c1597f0 0x7fdc6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c48c0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c4ba0 con 0x7fdc6c1597f0 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc70fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c0c4e80 con 0x7fdc6c06a2d0 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42662/0 (socket says 172.21.15.144:42662) 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 -- 172.21.15.144:0/2320623057 learned_addr learned my addr 172.21.15.144:0/2320623057 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc6a59c700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c06a2d0 0x7fdc6c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc6ad9d700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c1597f0 0x7fdc6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 -- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c06a2d0 msgr2=0x7fdc6c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c06a2d0 0x7fdc6c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 -- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c1597f0 msgr2=0x7fdc6c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c1597f0 0x7fdc6c06c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.716+0000 7fdc63fff700 1 -- 172.21.15.144:0/2320623057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540094a0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc63fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ebe0 tx=0x7fdc5400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400c850 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5400c9b0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc64009a70 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400cd40 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.717+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c0ca110 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.718+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c0c9e30 con 0x7fdc6c0c9730 2023-05-11T07:36:28.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.719+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc54013470 con 0x7fdc6c0c9730 2023-05-11T07:36:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.720+0000 7fdc62ffd700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 0x7fdc4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.720+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc540897d0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.720+0000 7fdc6a59c700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 0x7fdc4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:28.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.720+0000 7fdc6a59c700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 0x7fdc4c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c007fd0 tx=0x7fdc5c007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:28.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.724+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdc540545e0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.962+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc6c0cccb0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.963+0000 7fdc62ffd700 1 -- 172.21.15.144:0/2320623057 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdc5400cea0 con 0x7fdc6c0c9730 2023-05-11T07:36:28.967 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 msgr2=0x7fdc4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 0x7fdc4c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c007fd0 tx=0x7fdc5c007dc0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 msgr2=0x7fdc6c1e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ebe0 tx=0x7fdc5400eef0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 shutdown_connections 2023-05-11T07:36:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc4c06ace0 0x7fdc4c06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc6c06a2d0 0x7fdc6c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc6c1597f0 0x7fdc6c06c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 --2- 172.21.15.144:0/2320623057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc6c0c9730 0x7fdc6c1e3c20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 >> 172.21.15.144:0/2320623057 conn(0x7fdc6c0cb7e0 msgr2=0x7fdc6c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 shutdown_connections 2023-05-11T07:36:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:28.965+0000 7fdc70fff700 1 -- 172.21.15.144:0/2320623057 wait complete. 2023-05-11T07:36:28.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T07:36:28.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:36:28.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2023-05-11T07:36:28.987 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-11T07:36:28.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-11T07:36:28.987 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T07:36:28.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T07:36:28.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:36:28.988 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-11T07:36:28.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:28.988 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2023-05-11T07:36:29.035 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:29.036 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:29.036 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:29.036 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:29.036 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:29.036 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:29.037 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42266sec preferred_lft 42266sec 2023-05-11T07:36:29.038 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2023-05-11T07:36:29.039 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:29.039 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T07:36:29.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:29.040 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:29.041 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:29.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add name ceph-brx type bridge 2023-05-11T07:36:29.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr flush dev ceph-brx 2023-05-11T07:36:29.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set ceph-brx up 2023-05-11T07:36:29.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T07:36:29.043 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:29.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:29.451 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:36:29.516 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-05-11T07:36:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:29.519 DEBUG:teuthology.orchestra.run.smithi145:> route 2023-05-11T07:36:29.583 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2023-05-11T07:36:29.583 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:36:29.583 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:36:29.584 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:36:29.584 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:36:29.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:29.584 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:29.585 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:29.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:36:29.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:36:29.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:36:29.586 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:30.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:30.237 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-05-11T07:36:30.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:30.279 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2023-05-11T07:36:30.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:30.362 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:30.362 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:30.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-11T07:36:30.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-11T07:36:30.363 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:30.532 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-11T07:36:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:30.533 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:30.533 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:30.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-11T07:36:30.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T07:36:30.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-11T07:36:30.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-11T07:36:30.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-11T07:36:30.535 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:30.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:30.776 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:30.776 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:30.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.0 up 2023-05-11T07:36:30.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T07:36:30.777 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:30.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:30.942 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-11T07:36:30.983 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-11T07:36:30.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:30.984 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-11T07:36:31.064 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-11T07:36:31.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:31.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-05-11T07:36:31.210 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-05-11T07:36:31.210 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-05-11T07:36:31.210 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:31.639 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-05-11T07:36:31.639 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-05-11T07:36:31.640 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:31.640 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:31.640 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:31.663 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-05-11T07:36:31.663 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790" 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2023-05-11T07:36:31.664 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=424d6242-b269-485d-aca8-83f4424787ea" will pass to kernel 2023-05-11T07:36:31.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-11T07:36:31.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:31.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-11T07:36:31.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:31.734 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:31.822 INFO:teuthology.orchestra.run.smithi145.stdout:client4655 2023-05-11T07:36:31.823 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:31.823 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:31.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:31.864 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:31.982 INFO:teuthology.orchestra.run.smithi145.stdout:client4655 2023-05-11T07:36:31.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:31.984 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:32.065 INFO:teuthology.orchestra.run.smithi145.stdout:client4655 2023-05-11T07:36:32.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:32.066 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/424d6242-b269-485d-aca8-83f4424787ea.client4655/status') 2023-05-11T07:36:32.163 INFO:teuthology.orchestra.run.smithi145.stdout:instance: client.4655 (3)192.168.0.1:0/1679226843 2023-05-11T07:36:32.163 INFO:teuthology.orchestra.run.smithi145.stdout:blocklisted: false 2023-05-11T07:36:32.163 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records in 2023-05-11T07:36:32.164 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records out 2023-05-11T07:36:32.164 INFO:teuthology.orchestra.run.smithi145.stderr:69 bytes copied, 6.806e-05 s, 1.0 MB/s 2023-05-11T07:36:32.165 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-05-11T07:36:32.165 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T07:36:32.166 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-11T07:36:32.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:36:32.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.357+0000 7f3077bff700 1 Processor -- start 2023-05-11T07:36:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.357+0000 7f3077bff700 1 -- start start 2023-05-11T07:36:32.364 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f3077bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 0x7f30700d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:32.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f3077bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307015cef0 con 0x7f30700d02c0 2023-05-11T07:36:32.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f3077bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700cd760 con 0x7f30700b87e0 2023-05-11T07:36:32.365 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f3077bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700b5a80 con 0x7f30700b52a0 2023-05-11T07:36:32.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f307619c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f30700d02c0 0x7f30700d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33720/0 (socket says 172.21.15.144:33720) 2023-05-11T07:36:32.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f307619c700 1 -- 172.21.15.144:0/1097287846 learned_addr learned my addr 172.21.15.144:0/1097287846 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:32.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.358+0000 7f307519a700 1 --2- 172.21.15.144:0/1097287846 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 0x7f30700d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:32.366 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183827825 0 0) 0x7f3068001490 con 0x7f30700d02c0 2023-05-11T07:36:32.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f305c0035b0 con 0x7f30700d02c0 2023-05-11T07:36:32.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684339105 0 0) 0x7f30700cd760 con 0x7f30700b87e0 2023-05-11T07:36:32.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3068001490 con 0x7f30700b87e0 2023-05-11T07:36:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f307519a700 1 -- 172.21.15.144:0/1097287846 >> v1:172.21.15.145:6789/0 conn(0x7f30700b87e0 legacy=0x7f30700b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f307519a700 1 -- 172.21.15.144:0/1097287846 >> v1:172.21.15.144:6789/0 conn(0x7f30700d02c0 legacy=0x7f30700d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f307519a700 1 -- 172.21.15.144:0/1097287846 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700d2d30 con 0x7f30700b52a0 2023-05-11T07:36:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f307519a700 1 --2- 172.21.15.144:0/1097287846 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 0x7f30700d2090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3060009870 tx=0x7f3060009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f80a2bdce98702 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:32.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.359+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011830 con 0x7f30700b52a0 2023-05-11T07:36:32.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060011990 con 0x7f30700b52a0 2023-05-11T07:36:32.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3074999700 1 -- 172.21.15.144:0/1097287846 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011d00 con 0x7f30700b52a0 2023-05-11T07:36:32.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 -- 172.21.15.144:0/1097287846 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 msgr2=0x7f30700d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.369 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 --2- 172.21.15.144:0/1097287846 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 0x7f30700d2090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3060009870 tx=0x7f3060009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:32.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 -- 172.21.15.144:0/1097287846 shutdown_connections 2023-05-11T07:36:32.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 --2- 172.21.15.144:0/1097287846 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b52a0 0x7f30700d2090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 -- 172.21.15.144:0/1097287846 >> 172.21.15.144:0/1097287846 conn(0x7f307006acf0 msgr2=0x7f307006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:32.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 -- 172.21.15.144:0/1097287846 shutdown_connections 2023-05-11T07:36:32.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.360+0000 7f3077bff700 1 -- 172.21.15.144:0/1097287846 wait complete. 2023-05-11T07:36:32.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.362+0000 7f3077bff700 1 Processor -- start 2023-05-11T07:36:32.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.362+0000 7f3077bff700 1 -- start start 2023-05-11T07:36:32.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30700b52a0 0x7f307015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b87e0 0x7f307015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700cac90 con 0x7f30700d02c0 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015f000 con 0x7f30700b52a0 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f3077bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700ca360 con 0x7f30700b87e0 2023-05-11T07:36:32.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f307619c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f307619c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42672/0 (socket says 172.21.15.144:42672) 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f307619c700 1 -- 172.21.15.144:0/3997478062 learned_addr learned my addr 172.21.15.144:0/3997478062 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f307599b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30700b52a0 0x7f307015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.363+0000 7f307519a700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b87e0 0x7f307015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 -- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b87e0 msgr2=0x7f307015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b87e0 0x7f307015e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 -- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30700b52a0 msgr2=0x7f307015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30700b52a0 0x7f307015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 -- 172.21.15.144:0/3997478062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600094a0 con 0x7f30700d02c0 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f307619c700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f306800cc30 tx=0x7f306800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800ab00 con 0x7f30700d02c0 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800ac80 con 0x7f30700d02c0 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30700cdc90 con 0x7f30700d02c0 2023-05-11T07:36:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068012400 con 0x7f30700d02c0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.364+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700cd9b0 con 0x7f30700d02c0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.366+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30700b8bb0 con 0x7f30700d02c0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.366+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f306801b3b0 con 0x7f30700d02c0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.368+0000 7f30667fc700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 0x7f305406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.368+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3068089410 con 0x7f30700d02c0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.368+0000 7f307599b700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 0x7f305406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.369+0000 7f307599b700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 0x7f305406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f306c0011e0 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.372+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3068054190 con 0x7f30700d02c0 2023-05-11T07:36:32.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.612+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30700cae40 con 0x7f30700d02c0 2023-05-11T07:36:32.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.612+0000 7f30667fc700 1 -- 172.21.15.144:0/3997478062 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f30700cae40 con 0x7f30700d02c0 2023-05-11T07:36:32.616 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T07:36:32.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.614+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 msgr2=0x7f305406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.614+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 0x7f305406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f306c0011e0 tx=0x7f306c009040 comp rx=0 tx=0).stop 2023-05-11T07:36:32.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 msgr2=0x7f30700c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f306800cc30 tx=0x7f306800cf40 comp rx=0 tx=0).stop 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 shutdown_connections 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f305406ace0 0x7f305406d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30700d02c0 0x7f30700c8d20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30700b52a0 0x7f307015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 --2- 172.21.15.144:0/3997478062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30700b87e0 0x7f307015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 >> 172.21.15.144:0/3997478062 conn(0x7f307006acf0 msgr2=0x7f30700d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:32.619 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 shutdown_connections 2023-05-11T07:36:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:32.615+0000 7f3077bff700 1 -- 172.21.15.144:0/3997478062 wait complete. 2023-05-11T07:36:32.635 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T07:36:32.635 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:36:32.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi145.front.sepia.ceph.com 2023-05-11T07:36:32.636 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-11T07:36:32.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-11T07:36:32.636 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T07:36:32.637 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T07:36:32.637 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:36:32.637 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-11T07:36:32.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:32.638 DEBUG:teuthology.orchestra.run.smithi145:> ip addr 2023-05-11T07:36:32.681 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:32.681 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:32.681 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:32.681 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:66 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f0 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:d9:38:67 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout: altname enp7s0f1 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:90 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 0c:c4:7a:88:77:91 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:32.683 INFO:teuthology.orchestra.run.smithi145.stdout: inet 172.21.15.145/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::ec4:7aff:fe88:7791/64 scope link 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 8a:01:f1:60:94:78 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T07:36:32.684 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::8c67:63ff:fec8:1bbe/64 scope link 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 8a:01:f1:60:94:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::8801:f1ff:fe60:9478/64 scope link tentative 2023-05-11T07:36:32.685 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:32.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:32.686 DEBUG:teuthology.orchestra.run.smithi145:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:36:32.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:36:32.752 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:36:32.788 INFO:teuthology.orchestra.run.smithi145.stdout:1 2023-05-11T07:36:32.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:32.791 DEBUG:teuthology.orchestra.run.smithi145:> route 2023-05-11T07:36:32.876 INFO:teuthology.orchestra.run.smithi145.stdout:Kernel IP routing table 2023-05-11T07:36:32.876 INFO:teuthology.orchestra.run.smithi145.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:36:32.876 INFO:teuthology.orchestra.run.smithi145.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:36:32.876 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:36:32.876 INFO:teuthology.orchestra.run.smithi145.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:36:32.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:32.877 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:32.877 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:32.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:36:32.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:36:32.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:36:32.878 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:33.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.076 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list 2023-05-11T07:36:33.117 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-11T07:36:33.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.118 DEBUG:teuthology.orchestra.run.smithi145:> ip netns list-id 2023-05-11T07:36:33.199 INFO:teuthology.orchestra.run.smithi145.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-11T07:36:33.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.200 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:33.201 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:33.201 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-11T07:36:33.201 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-11T07:36:33.201 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:33.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-11T07:36:33.430 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:33.430 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 8e:09:75:7d:f1:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T07:36:33.431 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T07:36:33.432 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.432 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::8c09:75ff:fe7d:f11f/64 scope link 2023-05-11T07:36:33.432 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.433 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-11T07:36:33.497 INFO:teuthology.orchestra.run.smithi145.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:36:33.497 INFO:teuthology.orchestra.run.smithi145.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:36:33.497 INFO:teuthology.orchestra.run.smithi145.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:36:33.497 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.497 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 ::1/128 scope host 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: link/ether 8e:09:75:7d:f1:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: inet6 fe80::8c09:75ff:fe7d:f11f/64 scope link 2023-05-11T07:36:33.498 INFO:teuthology.orchestra.run.smithi145.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:36:33.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-11T07:36:33.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.500 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:33.500 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:33.500 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-11T07:36:33.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-11T07:36:33.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-11T07:36:33.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-11T07:36:33.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-11T07:36:33.502 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:33.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:33.719 DEBUG:teuthology.orchestra.run.smithi145:> (cd / && exec bash -c ' 2023-05-11T07:36:33.720 DEBUG:teuthology.orchestra.run.smithi145:> set -e 2023-05-11T07:36:33.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set brx.1 up 2023-05-11T07:36:33.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo ip link set dev brx.1 master ceph-brx 2023-05-11T07:36:33.720 DEBUG:teuthology.orchestra.run.smithi145:> ') 2023-05-11T07:36:33.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:33.886 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-11T07:36:33.927 INFO:teuthology.orchestra.run.smithi145.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-11T07:36:33.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:36:33.928 DEBUG:teuthology.orchestra.run.smithi145:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-11T07:36:34.007 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-11T07:36:34.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.009 DEBUG:teuthology.orchestra.run.smithi145:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-05-11T07:36:34.146 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-05-11T07:36:34.146 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-05-11T07:36:34.147 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:34.160 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-05-11T07:36:34.160 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-05-11T07:36:34.161 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:34.161 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:34.161 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:34.182 INFO:teuthology.orchestra.run.smithi145.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:invalid new device string format 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: resolved to: "172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790" 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2023-05-11T07:36:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=424d6242-b269-485d-aca8-83f4424787ea" will pass to kernel 2023-05-11T07:36:34.188 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-11T07:36:34.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-11T07:36:34.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.250 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:34.329 INFO:teuthology.orchestra.run.smithi145.stdout:client4664 2023-05-11T07:36:34.329 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:34.330 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:34.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.371 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:34.490 INFO:teuthology.orchestra.run.smithi145.stdout:client4664 2023-05-11T07:36:34.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.491 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:36:34.570 INFO:teuthology.orchestra.run.smithi145.stdout:client4664 2023-05-11T07:36:34.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:34.571 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/424d6242-b269-485d-aca8-83f4424787ea.client4664/status') 2023-05-11T07:36:34.668 INFO:teuthology.orchestra.run.smithi145.stdout:instance: client.4664 (3)192.168.0.2:0/751813319 2023-05-11T07:36:34.668 INFO:teuthology.orchestra.run.smithi145.stdout:blocklisted: false 2023-05-11T07:36:34.669 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records in 2023-05-11T07:36:34.669 INFO:teuthology.orchestra.run.smithi145.stderr:0+1 records out 2023-05-11T07:36:34.669 INFO:teuthology.orchestra.run.smithi145.stderr:68 bytes copied, 4.6084e-05 s, 1.5 MB/s 2023-05-11T07:36:34.670 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-11T07:36:34.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:34.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.883+0000 7f1b8cdff700 1 Processor -- start 2023-05-11T07:36:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.883+0000 7f1b8cdff700 1 -- start start 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b8cdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b8806df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b8cdff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1b880717d0 0x7f1b8815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b8cdff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8806e7e0 con 0x7f1b8806dac0 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b8cdff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8806eac0 con 0x7f1b880717d0 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b8cdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806cfe0 con 0x7f1b8815c960 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.884+0000 7f1b85d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b8806dac0 0x7f1b880710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33732/0 (socket says 172.21.15.144:33732) 2023-05-11T07:36:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b85d9b700 1 -- 172.21.15.144:0/1864282392 learned_addr learned my addr 172.21.15.144:0/1864282392 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8659c700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b8806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b86d9d700 1 --2- 172.21.15.144:0/1864282392 >> v2:172.21.15.145:3300/0 conn(0x7f1b880717d0 0x7f1b8815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900483136 0 0) 0x7f1b8806e7e0 con 0x7f1b8806dac0 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b700035b0 con 0x7f1b8806dac0 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991510073 0 0) 0x7f1b700035b0 con 0x7f1b8806dac0 2023-05-11T07:36:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 msgr2=0x7f1b8806df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b8806df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 >> v2:172.21.15.145:3300/0 conn(0x7f1b880717d0 msgr2=0x7f1b8815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 --2- 172.21.15.144:0/1864282392 >> v2:172.21.15.145:3300/0 conn(0x7f1b880717d0 0x7f1b8815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8806d2c0 con 0x7f1b8806dac0 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f1b7c001670 con 0x7f1b8806dac0 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 >> v1:172.21.15.144:6789/0 conn(0x7f1b8806dac0 legacy=0x7f1b880710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b70003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b70004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b70004d90 0x7f1b70005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806eac0 con 0x7f1b70004d90 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8806cfe0 con 0x7f1b70003fd0 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.885+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7000ba90 con 0x7f1b8815c960 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b86d9d700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b70004d90 0x7f1b70005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b8659c700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b70003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b70004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 -- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 msgr2=0x7f1b70003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b8815c960 0x7f1b70003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 -- 172.21.15.144:0/1864282392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b70004d90 msgr2=0x7f1b70005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b70004d90 0x7f1b70005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 -- 172.21.15.144:0/1864282392 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700035b0 con 0x7f1b70003fd0 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b86d9d700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b70004d90 0x7f1b70005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b70004850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c160 tx=0x7f1b70005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7e28f73770e80f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.886+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007b70 con 0x7f1b70003fd0 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00cd00 con 0x7f1b70003fd0 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8559a700 1 -- 172.21.15.144:0/1864282392 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c005ba0 con 0x7f1b70003fd0 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 -- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 msgr2=0x7f1b70004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/1864282392 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b70004850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c160 tx=0x7f1b70005880 comp rx=0 tx=0).stop 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b86d9d700 1 -- 172.21.15.144:0/1864282392 reap_dead start 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 -- 172.21.15.144:0/1864282392 shutdown_connections 2023-05-11T07:36:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 -- 172.21.15.144:0/1864282392 >> 172.21.15.144:0/1864282392 conn(0x7f1b880b26a0 msgr2=0x7f1b880cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 -- 172.21.15.144:0/1864282392 shutdown_connections 2023-05-11T07:36:34.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.887+0000 7f1b8cdff700 1 -- 172.21.15.144:0/1864282392 wait complete. 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.889+0000 7f1b8cdff700 1 Processor -- start 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.889+0000 7f1b8cdff700 1 -- start start 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b88154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b88156150 0x7f1b881565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88156b30 con 0x7f1b880aef40 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880c4790 con 0x7f1b70003fd0 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8cdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880c3b80 con 0x7f1b88156150 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b85d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b85d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42702/0 (socket says 172.21.15.144:42702) 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b85d9b700 1 -- 172.21.15.144:0/2583146393 learned_addr learned my addr 172.21.15.144:0/2583146393 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b86d9d700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b88156150 0x7f1b881565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.890+0000 7f1b8659c700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b88154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 -- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b88156150 msgr2=0x7f1b881565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b88156150 0x7f1b881565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 -- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 msgr2=0x7f1b88154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b88154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 -- 172.21.15.144:0/2583146393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88161040 con 0x7f1b880aef40 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b85d9b700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c750 tx=0x7f1b7c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ce70 con 0x7f1b880aef40 2023-05-11T07:36:34.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0070d0 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8806d5a0 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007480 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.891+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b881611d0 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.892+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b88070300 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.893+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b7c019030 con 0x7f1b880aef40 2023-05-11T07:36:34.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.895+0000 7f1b76ffd700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 0x7f1b6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.895+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b7c08ac90 con 0x7f1b880aef40 2023-05-11T07:36:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.895+0000 7f1b8659c700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 0x7f1b6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:34.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.895+0000 7f1b8659c700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 0x7f1b6806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b88161010 tx=0x7f1b78009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:34.900+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1b7c055a00 con 0x7f1b880aef40 2023-05-11T07:36:35.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.096+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b880c48d0 con 0x7f1b880aef40 2023-05-11T07:36:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.097+0000 7f1b76ffd700 1 -- 172.21.15.144:0/2583146393 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f1b7c017090 con 0x7f1b880aef40 2023-05-11T07:36:35.100 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:35.100 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:35.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 msgr2=0x7f1b6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 0x7f1b6806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b88161010 tx=0x7f1b78009210 comp rx=0 tx=0).stop 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 msgr2=0x7f1b880af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c750 tx=0x7f1b7c001930 comp rx=0 tx=0).stop 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 shutdown_connections 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b6806ace0 0x7f1b6806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1b88156150 0x7f1b881565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b70003fd0 0x7f1b88154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 --2- 172.21.15.144:0/2583146393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b880aef40 0x7f1b880af3b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 >> 172.21.15.144:0/2583146393 conn(0x7f1b880b26a0 msgr2=0x7f1b880af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 shutdown_connections 2023-05-11T07:36:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.100+0000 7f1b8cdff700 1 -- 172.21.15.144:0/2583146393 wait complete. 2023-05-11T07:36:35.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:35.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:35.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.305+0000 7fee3a7ff700 1 Processor -- start 2023-05-11T07:36:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.305+0000 7fee3a7ff700 1 -- start start 2023-05-11T07:36:35.308 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.306+0000 7fee3a7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.306+0000 7fee3a7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 0x7fee340b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.306+0000 7fee3a7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340b5680 con 0x7fee3406b920 2023-05-11T07:36:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.306+0000 7fee3a7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee340b28c0 con 0x7fee340cfb10 2023-05-11T07:36:35.309 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.306+0000 7fee3a7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3415d1e0 con 0x7fee3415ce10 2023-05-11T07:36:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee38d9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 0x7fee340b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee38d9c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 0x7fee340b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:45470/0 (socket says 172.21.15.144:45470) 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:39216/0 (socket says 172.21.15.144:39216) 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee38d9c700 1 -- 172.21.15.144:0/1378154 learned_addr learned my addr 172.21.15.144:0/1378154 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee32ffd700 1 -- 172.21.15.144:0/1378154 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545537338 0 0) 0x7fee340b5680 con 0x7fee3406b920 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 -- 172.21.15.144:0/1378154 >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 msgr2=0x7fee340b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 --2- 172.21.15.144:0/1378154 >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 0x7fee340b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 -- 172.21.15.144:0/1378154 >> v1:172.21.15.145:6789/0 conn(0x7fee3406b920 legacy=0x7fee340b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.307+0000 7fee33fff700 1 -- 172.21.15.144:0/1378154 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340b4790 con 0x7fee3415ce10 2023-05-11T07:36:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee33fff700 1 --2- 172.21.15.144:0/1378154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee24009820 tx=0x7fee24009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eab235c309e244 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee32ffd700 1 -- 172.21.15.144:0/1378154 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24005e30 con 0x7fee3415ce10 2023-05-11T07:36:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee32ffd700 1 -- 172.21.15.144:0/1378154 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24006030 con 0x7fee3415ce10 2023-05-11T07:36:35.312 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee32ffd700 1 -- 172.21.15.144:0/1378154 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240063c0 con 0x7fee3415ce10 2023-05-11T07:36:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1378154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 msgr2=0x7fee3406b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1378154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fee24009820 tx=0x7fee24009b30 comp rx=0 tx=0).stop 2023-05-11T07:36:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1378154 shutdown_connections 2023-05-11T07:36:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1378154 >> v2:172.21.15.145:3300/0 conn(0x7fee340cfb10 0x7fee340b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.313 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1378154 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee3415ce10 0x7fee3406b3e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1378154 >> 172.21.15.144:0/1378154 conn(0x7fee3409a2c0 msgr2=0x7fee340d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1378154 shutdown_connections 2023-05-11T07:36:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.308+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1378154 wait complete. 2023-05-11T07:36:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.310+0000 7fee3a7ff700 1 Processor -- start 2023-05-11T07:36:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.310+0000 7fee3a7ff700 1 -- start start 2023-05-11T07:36:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee340cfb10 0x7fee341f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 0x7fee341f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee340ccea0 con 0x7fee3406b920 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee341f2290 con 0x7fee3415ce10 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee3a7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340cc290 con 0x7fee340cfb10 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee33fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee33fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42708/0 (socket says 172.21.15.144:42708) 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.311+0000 7fee33fff700 1 -- 172.21.15.144:0/1972957367 learned_addr learned my addr 172.21.15.144:0/1972957367 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee38d9c700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 0x7fee341f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee337fe700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee340cfb10 0x7fee341f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 -- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee340cfb10 msgr2=0x7fee341f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee340cfb10 0x7fee341f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 -- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 msgr2=0x7fee341f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 0x7fee341f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 -- 172.21.15.144:0/1972957367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24009430 con 0x7fee3406b920 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee38d9c700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 0x7fee341f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee33fff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee24000c00 tx=0x7fee24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240063a0 con 0x7fee3406b920 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24020070 con 0x7fee3406b920 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24006760 con 0x7fee3406b920 2023-05-11T07:36:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.312+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee340b4d50 con 0x7fee3406b920 2023-05-11T07:36:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.313+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee340b4a70 con 0x7fee3406b920 2023-05-11T07:36:35.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.314+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee340b5030 con 0x7fee3406b920 2023-05-11T07:36:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.315+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee24022030 con 0x7fee3406b920 2023-05-11T07:36:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.315+0000 7fee30ff9700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 0x7fee2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.315+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee2408ae20 con 0x7fee3406b920 2023-05-11T07:36:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.316+0000 7fee337fe700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 0x7fee2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.316+0000 7fee337fe700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 0x7fee2006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee341e84d0 tx=0x7fee28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.322 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.320+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fee24055b20 con 0x7fee3406b920 2023-05-11T07:36:35.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.514+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee3406b680 con 0x7fee3406b920 2023-05-11T07:36:35.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.518+0000 7fee30ff9700 1 -- 172.21.15.144:0/1972957367 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee24059140 con 0x7fee3406b920 2023-05-11T07:36:35.521 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 msgr2=0x7fee2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 0x7fee2006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee341e84d0 tx=0x7fee28009040 comp rx=0 tx=0).stop 2023-05-11T07:36:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 msgr2=0x7fee340cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee24000c00 tx=0x7fee24004750 comp rx=0 tx=0).stop 2023-05-11T07:36:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 shutdown_connections 2023-05-11T07:36:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fee2006ace0 0x7fee2006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee3415ce10 0x7fee341f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee3406b920 0x7fee340cdd00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 --2- 172.21.15.144:0/1972957367 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fee340cfb10 0x7fee341f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 >> 172.21.15.144:0/1972957367 conn(0x7fee3409a2c0 msgr2=0x7fee3406f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 shutdown_connections 2023-05-11T07:36:35.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.521+0000 7fee3a7ff700 1 -- 172.21.15.144:0/1972957367 wait complete. 2023-05-11T07:36:35.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.727+0000 7f06de5ff700 1 Processor -- start 2023-05-11T07:36:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.727+0000 7f06de5ff700 1 -- start start 2023-05-11T07:36:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06de5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f06d815c940 0x7f06d8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06de5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06de5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80d0e80 con 0x7f06d80b5fd0 2023-05-11T07:36:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06de5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d8161420 con 0x7f06d815c940 2023-05-11T07:36:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06de5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80cdb00 con 0x7f06d806b350 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06dcb9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.728+0000 7f06d7fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f06d815c940 0x7f06d8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:39228/0 (socket says 172.21.15.144:39228) 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 -- 172.21.15.144:0/1008428122 learned_addr learned my addr 172.21.15.144:0/1008428122 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 -- 172.21.15.144:0/1008428122 >> v2:172.21.15.145:3300/0 conn(0x7f06d815c940 msgr2=0x7f06d8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 --2- 172.21.15.144:0/1008428122 >> v2:172.21.15.145:3300/0 conn(0x7f06d815c940 0x7f06d8160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 -- 172.21.15.144:0/1008428122 >> v1:172.21.15.145:6789/0 conn(0x7f06d80b5fd0 legacy=0x7f06d806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 -- 172.21.15.144:0/1008428122 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80cdde0 con 0x7f06d806b350 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06dcb9c700 1 --2- 172.21.15.144:0/1008428122 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009e50 tx=0x7f06d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bffb2b5307ee1d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.729+0000 7f06d6ffd700 1 -- 172.21.15.144:0/1008428122 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000e070 con 0x7f06d806b350 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06d6ffd700 1 -- 172.21.15.144:0/1008428122 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000b910 con 0x7f06d806b350 2023-05-11T07:36:35.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06d6ffd700 1 -- 172.21.15.144:0/1008428122 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000bcc0 con 0x7f06d806b350 2023-05-11T07:36:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 -- 172.21.15.144:0/1008428122 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 msgr2=0x7f06d80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1008428122 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009e50 tx=0x7f06d000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 -- 172.21.15.144:0/1008428122 shutdown_connections 2023-05-11T07:36:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1008428122 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d806b350 0x7f06d80d1920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1008428122 >> v2:172.21.15.145:3300/0 conn(0x7f06d815c940 0x7f06d8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 -- 172.21.15.144:0/1008428122 >> 172.21.15.144:0/1008428122 conn(0x7f06d80d3180 msgr2=0x7f06d80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 -- 172.21.15.144:0/1008428122 shutdown_connections 2023-05-11T07:36:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.730+0000 7f06de5ff700 1 -- 172.21.15.144:0/1008428122 wait complete. 2023-05-11T07:36:35.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.732+0000 7f06de5ff700 1 Processor -- start 2023-05-11T07:36:35.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.732+0000 7f06de5ff700 1 -- start start 2023-05-11T07:36:35.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80b5fd0 0x7f06d81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 0x7f06d80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8157f30 con 0x7f06d806b350 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b56e0 con 0x7f06d815c940 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06de5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80ca260 con 0x7f06d80b5fd0 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42710/0 (socket says 172.21.15.144:42710) 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06d7fff700 1 -- 172.21.15.144:0/1123416624 learned_addr learned my addr 172.21.15.144:0/1123416624 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06d77fe700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80b5fd0 0x7f06d81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.733+0000 7f06dcb9c700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 0x7f06d80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 -- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80b5fd0 msgr2=0x7f06d81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80b5fd0 0x7f06d81579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 -- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 msgr2=0x7f06d80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 0x7f06d80b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 -- 172.21.15.144:0/1123416624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009b30 con 0x7f06d806b350 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06dcb9c700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 0x7f06d80b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d7fff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06c800e870 tx=0x7f06c800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8009590 con 0x7f06d806b350 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8013680 con 0x7f06d806b350 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d80d1400 con 0x7f06d806b350 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80139f0 con 0x7f06d806b350 2023-05-11T07:36:35.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.734+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80d1120 con 0x7f06d806b350 2023-05-11T07:36:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.735+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d815cd10 con 0x7f06d806b350 2023-05-11T07:36:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.736+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06c8013b50 con 0x7f06d806b350 2023-05-11T07:36:35.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.737+0000 7f06d4ff9700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 0x7f06c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.737+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06c80897b0 con 0x7f06d806b350 2023-05-11T07:36:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.737+0000 7f06d77fe700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 0x7f06c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.738+0000 7f06d77fe700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 0x7f06c406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06d8160080 tx=0x7f06cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:35.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.741+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f06c8054490 con 0x7f06d806b350 2023-05-11T07:36:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.935+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06d80744c0 con 0x7f06d806b350 2023-05-11T07:36:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.935+0000 7f06d4ff9700 1 -- 172.21.15.144:0/1123416624 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06c8057ab0 con 0x7f06d806b350 2023-05-11T07:36:35.944 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 msgr2=0x7f06c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 0x7f06c406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06d8160080 tx=0x7f06cc009040 comp rx=0 tx=0).stop 2023-05-11T07:36:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 msgr2=0x7f06d815fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06c800e870 tx=0x7f06c800eb80 comp rx=0 tx=0).stop 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 shutdown_connections 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f06c406ace0 0x7f06c406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f06d815c940 0x7f06d80b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d806b350 0x7f06d815fb40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 --2- 172.21.15.144:0/1123416624 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f06d80b5fd0 0x7f06d81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 >> 172.21.15.144:0/1123416624 conn(0x7f06d80d3180 msgr2=0x7f06d81588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:35.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 shutdown_connections 2023-05-11T07:36:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:35.938+0000 7f06de5ff700 1 -- 172.21.15.144:0/1123416624 wait complete. 2023-05-11T07:36:35.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:36.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.145+0000 7f8e259ff700 1 Processor -- start 2023-05-11T07:36:36.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.145+0000 7f8e259ff700 1 -- start start 2023-05-11T07:36:36.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e259ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 0x7f8e200c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e259ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 0x7f8e200b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e259ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200b10c0 con 0x7f8e200b0c60 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e259ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2015e200 con 0x7f8e201599e0 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e259ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2015a100 con 0x7f8e200ca020 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e1f7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8e200b0c60 0x7f8e2006c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56060/0 (socket says 172.21.15.144:56060) 2023-05-11T07:36:36.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.146+0000 7f8e1f7fe700 1 -- 172.21.15.144:0/2319550397 learned_addr learned my addr 172.21.15.144:0/2319550397 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1effd700 1 --2- 172.21.15.144:0/2319550397 >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 0x7f8e200c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/2319550397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 0x7f8e200b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1dffb700 1 -- 172.21.15.144:0/2319550397 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590551747 0 0) 0x7f8e200b10c0 con 0x7f8e200b0c60 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1dffb700 1 -- 172.21.15.144:0/2319550397 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e080035b0 con 0x7f8e200b0c60 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/2319550397 >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 msgr2=0x7f8e200c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:36.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/2319550397 >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 0x7f8e200c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/2319550397 >> v1:172.21.15.144:6789/0 conn(0x7f8e200b0c60 legacy=0x7f8e2006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/2319550397 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2015a3e0 con 0x7f8e200ca020 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1effd700 1 --2- 172.21.15.144:0/2319550397 >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 0x7f8e200c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.147+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/2319550397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 0x7f8e200b0720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009840 tx=0x7f8e14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1763f7b66aa857e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e1dffb700 1 -- 172.21.15.144:0/2319550397 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14011830 con 0x7f8e200ca020 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e1dffb700 1 -- 172.21.15.144:0/2319550397 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14011990 con 0x7f8e200ca020 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e1dffb700 1 -- 172.21.15.144:0/2319550397 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14011d00 con 0x7f8e200ca020 2023-05-11T07:36:36.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 -- 172.21.15.144:0/2319550397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 msgr2=0x7f8e200b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 --2- 172.21.15.144:0/2319550397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 0x7f8e200b0720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009840 tx=0x7f8e14009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 -- 172.21.15.144:0/2319550397 shutdown_connections 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 --2- 172.21.15.144:0/2319550397 >> v2:172.21.15.145:3300/0 conn(0x7f8e201599e0 0x7f8e200c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 --2- 172.21.15.144:0/2319550397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e200ca020 0x7f8e200b0720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 -- 172.21.15.144:0/2319550397 >> 172.21.15.144:0/2319550397 conn(0x7f8e200cb720 msgr2=0x7f8e200cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 -- 172.21.15.144:0/2319550397 shutdown_connections 2023-05-11T07:36:36.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.148+0000 7f8e259ff700 1 -- 172.21.15.144:0/2319550397 wait complete. 2023-05-11T07:36:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.150+0000 7f8e259ff700 1 Processor -- start 2023-05-11T07:36:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.150+0000 7f8e259ff700 1 -- start start 2023-05-11T07:36:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e200b0c60 0x7f8e20148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e201599e0 0x7f8e201503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200c6010 con 0x7f8e200ca020 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200cf800 con 0x7f8e200b0c60 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e259ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20148bd0 con 0x7f8e201599e0 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e1e7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e1e7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47240/0 (socket says 172.21.15.144:47240) 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/1586394289 learned_addr learned my addr 172.21.15.144:0/1586394289 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:36.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.151+0000 7f8e1effd700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e200b0c60 0x7f8e20148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1f7fe700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e201599e0 0x7f8e201503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e201599e0 msgr2=0x7f8e201503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e201599e0 0x7f8e201503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e200b0c60 msgr2=0x7f8e20148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e200b0c60 0x7f8e20148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 -- 172.21.15.144:0/1586394289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100094a0 con 0x7f8e200ca020 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e1e7fc700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8e14013000 tx=0x7f8e14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140045d0 con 0x7f8e200ca020 2023-05-11T07:36:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1401f070 con 0x7f8e200ca020 2023-05-11T07:36:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140038c0 con 0x7f8e200ca020 2023-05-11T07:36:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140094a0 con 0x7f8e200ca020 2023-05-11T07:36:36.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.152+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2015a9a0 con 0x7f8e200ca020 2023-05-11T07:36:36.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.153+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2015a6c0 con 0x7f8e200ca020 2023-05-11T07:36:36.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.154+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e14003a20 con 0x7f8e200ca020 2023-05-11T07:36:36.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.155+0000 7f8e07fff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.155+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e14021070 con 0x7f8e200ca020 2023-05-11T07:36:36.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.155+0000 7f8e1effd700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.156+0000 7f8e1effd700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009cd0 tx=0x7f8e10009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.159+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8e14055d60 con 0x7f8e200ca020 2023-05-11T07:36:36.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.353+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e200b1700 con 0x7f8e200ca020 2023-05-11T07:36:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.353+0000 7f8e07fff700 1 -- 172.21.15.144:0/1586394289 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e1402b020 con 0x7f8e200ca020 2023-05-11T07:36:36.356 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 msgr2=0x7f8e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009cd0 tx=0x7f8e10009210 comp rx=0 tx=0).stop 2023-05-11T07:36:36.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 msgr2=0x7f8e2014fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8e14013000 tx=0x7f8e14004750 comp rx=0 tx=0).stop 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 shutdown_connections 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f8e0c06ace0 0x7f8e0c06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f8e201599e0 0x7f8e201503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e200b0c60 0x7f8e20148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 --2- 172.21.15.144:0/1586394289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e200ca020 0x7f8e2014fe70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 >> 172.21.15.144:0/1586394289 conn(0x7f8e200cb720 msgr2=0x7f8e20158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 shutdown_connections 2023-05-11T07:36:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.356+0000 7f8e259ff700 1 -- 172.21.15.144:0/1586394289 wait complete. 2023-05-11T07:36:36.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:36.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.564+0000 7fdc943ff700 1 Processor -- start 2023-05-11T07:36:36.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.564+0000 7fdc943ff700 1 -- start start 2023-05-11T07:36:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc943ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8c06b350 0x7fdc8c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc943ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c0d0e80 con 0x7fdc8c15c940 2023-05-11T07:36:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc943ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c0cdb00 con 0x7fdc8c160ee0 2023-05-11T07:36:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc943ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0cdde0 con 0x7fdc8c06b350 2023-05-11T07:36:36.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc9299c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8c06b350 0x7fdc8c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc9299c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8c06b350 0x7fdc8c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47252/0 (socket says 172.21.15.144:47252) 2023-05-11T07:36:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc9299c700 1 -- 172.21.15.144:0/1069805819 learned_addr learned my addr 172.21.15.144:0/1069805819 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:36.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.565+0000 7fdc9219b700 1 --1- 172.21.15.144:0/1069805819 >> v1:172.21.15.144:6789/0 conn(0x7fdc8c15c940 0x7fdc8c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56064/0 (socket says 172.21.15.144:56064) 2023-05-11T07:36:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc9299c700 1 -- 172.21.15.144:0/1069805819 >> v1:172.21.15.145:6789/0 conn(0x7fdc8c160ee0 legacy=0x7fdc8c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc9299c700 1 -- 172.21.15.144:0/1069805819 >> v1:172.21.15.144:6789/0 conn(0x7fdc8c15c940 legacy=0x7fdc8c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc9299c700 1 -- 172.21.15.144:0/1069805819 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0d1120 con 0x7fdc8c06b350 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc91199700 1 -- 172.21.15.144:0/1069805819 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484097059 0 0) 0x7fdc8c0d0e80 con 0x7fdc8c15c940 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc9299c700 1 --2- 172.21.15.144:0/1069805819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0d1920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009e50 tx=0x7fdc8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172db6e717cf6d33 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc91199700 1 -- 172.21.15.144:0/1069805819 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400e070 con 0x7fdc8c06b350 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc91199700 1 -- 172.21.15.144:0/1069805819 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400b9c0 con 0x7fdc8c06b350 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.566+0000 7fdc91199700 1 -- 172.21.15.144:0/1069805819 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400bd70 con 0x7fdc8c06b350 2023-05-11T07:36:36.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 -- 172.21.15.144:0/1069805819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 msgr2=0x7fdc8c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 --2- 172.21.15.144:0/1069805819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0d1920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009e50 tx=0x7fdc8400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 -- 172.21.15.144:0/1069805819 shutdown_connections 2023-05-11T07:36:36.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 --2- 172.21.15.144:0/1069805819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0d1920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 -- 172.21.15.144:0/1069805819 >> 172.21.15.144:0/1069805819 conn(0x7fdc8c0d3180 msgr2=0x7fdc8c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 -- 172.21.15.144:0/1069805819 shutdown_connections 2023-05-11T07:36:36.573 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.567+0000 7fdc943ff700 1 -- 172.21.15.144:0/1069805819 wait complete. 2023-05-11T07:36:36.574 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.569+0000 7fdc943ff700 1 Processor -- start 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.569+0000 7fdc943ff700 1 -- start start 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8c15c940 0x7fdc8c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8c160ee0 0x7fdc8c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c15dd00 con 0x7fdc8c06b350 2023-05-11T07:36:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0ca570 con 0x7fdc8c160ee0 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc943ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c15d180 con 0x7fdc8c15c940 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47266/0 (socket says 172.21.15.144:47266) 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 -- 172.21.15.144:0/467156233 learned_addr learned my addr 172.21.15.144:0/467156233 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9299c700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8c160ee0 0x7fdc8c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9199a700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8c15c940 0x7fdc8c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 -- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8c15c940 msgr2=0x7fdc8c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8c15c940 0x7fdc8c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 -- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8c160ee0 msgr2=0x7fdc8c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8c160ee0 0x7fdc8c0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 -- 172.21.15.144:0/467156233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009b30 con 0x7fdc8c06b350 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.571+0000 7fdc9219b700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800c520 tx=0x7fdc8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.572+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004c80 con 0x7fdc8c06b350 2023-05-11T07:36:36.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.572+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc88004e00 con 0x7fdc8c06b350 2023-05-11T07:36:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.572+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c0b66e0 con 0x7fdc8c06b350 2023-05-11T07:36:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.572+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88007310 con 0x7fdc8c06b350 2023-05-11T07:36:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.572+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c0d1400 con 0x7fdc8c06b350 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.573+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c161330 con 0x7fdc8c06b350 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.574+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc88007470 con 0x7fdc8c06b350 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.575+0000 7fdc82ffd700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 0x7fdc7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.575+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc88089580 con 0x7fdc8c06b350 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.575+0000 7fdc9199a700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 0x7fdc7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.576+0000 7fdc9199a700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 0x7fdc7006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c15bb20 tx=0x7fdc7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.579+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdc88054260 con 0x7fdc8c06b350 2023-05-11T07:36:36.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.773+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc8c0744c0 con 0x7fdc8c06b350 2023-05-11T07:36:36.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.774+0000 7fdc82ffd700 1 -- 172.21.15.144:0/467156233 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc88057880 con 0x7fdc8c06b350 2023-05-11T07:36:36.777 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:36.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 msgr2=0x7fdc7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 0x7fdc7006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c15bb20 tx=0x7fdc7c009040 comp rx=0 tx=0).stop 2023-05-11T07:36:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 msgr2=0x7fdc8c0cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800c520 tx=0x7fdc8800c8e0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 shutdown_connections 2023-05-11T07:36:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdc7006ace0 0x7fdc7006d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc8c160ee0 0x7fdc8c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8c06b350 0x7fdc8c0cd240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 --2- 172.21.15.144:0/467156233 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdc8c15c940 0x7fdc8c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.776+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 >> 172.21.15.144:0/467156233 conn(0x7fdc8c0d3180 msgr2=0x7fdc8c0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.777+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 shutdown_connections 2023-05-11T07:36:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.777+0000 7fdc943ff700 1 -- 172.21.15.144:0/467156233 wait complete. 2023-05-11T07:36:36.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.982+0000 7f84b1bff700 1 Processor -- start 2023-05-11T07:36:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.982+0000 7f84b1bff700 1 -- start start 2023-05-11T07:36:36.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84b1bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 0x7f84ac15d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84b1bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 0x7f84ac0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84b1bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac15de80 con 0x7f84ac0d0270 2023-05-11T07:36:36.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84b1bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac0cf640 con 0x7f84ac15c930 2023-05-11T07:36:36.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84b1bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac15cd00 con 0x7f84ac0cfe00 2023-05-11T07:36:36.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84abfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f84ac0d0270 0x7f84ac0b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56080/0 (socket says 172.21.15.144:56080) 2023-05-11T07:36:36.988 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84abfff700 1 -- 172.21.15.144:0/57997123 learned_addr learned my addr 172.21.15.144:0/57997123 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84a3fff700 1 --2- 172.21.15.144:0/57997123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 0x7f84ac0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84ab7fe700 1 --2- 172.21.15.144:0/57997123 >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 0x7f84ac15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84aaffd700 1 -- 172.21.15.144:0/57997123 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306013830 0 0) 0x7f84ac15de80 con 0x7f84ac0d0270 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.984+0000 7f84aaffd700 1 -- 172.21.15.144:0/57997123 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84980035b0 con 0x7f84ac0d0270 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84a3fff700 1 -- 172.21.15.144:0/57997123 >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 msgr2=0x7f84ac15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84a3fff700 1 --2- 172.21.15.144:0/57997123 >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 0x7f84ac15d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84a3fff700 1 -- 172.21.15.144:0/57997123 >> v1:172.21.15.144:6789/0 conn(0x7f84ac0d0270 legacy=0x7f84ac0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84a3fff700 1 -- 172.21.15.144:0/57997123 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0cd940 con 0x7f84ac0cfe00 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84ab7fe700 1 --2- 172.21.15.144:0/57997123 >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 0x7f84ac15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84a3fff700 1 --2- 172.21.15.144:0/57997123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 0x7f84ac0d0db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8494009840 tx=0x7f8494009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68da8b5a247d09d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84aaffd700 1 -- 172.21.15.144:0/57997123 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011830 con 0x7f84ac0cfe00 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84aaffd700 1 -- 172.21.15.144:0/57997123 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494011990 con 0x7f84ac0cfe00 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.985+0000 7f84aaffd700 1 -- 172.21.15.144:0/57997123 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494011d00 con 0x7f84ac0cfe00 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 -- 172.21.15.144:0/57997123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 msgr2=0x7f84ac0d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 --2- 172.21.15.144:0/57997123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 0x7f84ac0d0db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8494009840 tx=0x7f8494009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 -- 172.21.15.144:0/57997123 shutdown_connections 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 --2- 172.21.15.144:0/57997123 >> v2:172.21.15.145:3300/0 conn(0x7f84ac15c930 0x7f84ac15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 --2- 172.21.15.144:0/57997123 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac0cfe00 0x7f84ac0d0db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 -- 172.21.15.144:0/57997123 >> 172.21.15.144:0/57997123 conn(0x7f84ac072650 msgr2=0x7f84ac06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 -- 172.21.15.144:0/57997123 shutdown_connections 2023-05-11T07:36:36.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.986+0000 7f84b1bff700 1 -- 172.21.15.144:0/57997123 wait complete. 2023-05-11T07:36:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.987+0000 7f84b1bff700 1 Processor -- start 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.988+0000 7f84b1bff700 1 -- start start 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.988+0000 7f84b1bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84ac0d0270 0x7f84ac153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.988+0000 7f84b1bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.988+0000 7f84b1bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac154400 0x7f84ac1f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.988+0000 7f84b1bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156870 con 0x7f84ac15c930 2023-05-11T07:36:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84b1bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156b50 con 0x7f84ac0d0270 2023-05-11T07:36:36.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84b1bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156e30 con 0x7f84ac154400 2023-05-11T07:36:36.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47276/0 (socket says 172.21.15.144:47276) 2023-05-11T07:36:36.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 -- 172.21.15.144:0/743103926 learned_addr learned my addr 172.21.15.144:0/743103926 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:36.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84ab7fe700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84ac0d0270 0x7f84ac153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84abfff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac154400 0x7f84ac1f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 -- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac154400 msgr2=0x7f84ac1f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac154400 0x7f84ac1f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 -- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84ac0d0270 msgr2=0x7f84ac153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84ac0d0270 0x7f84ac153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 -- 172.21.15.144:0/743103926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0094a0 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.989+0000 7f84a3fff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f84940090b0 tx=0x7f8494004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.990+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84940045d0 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.990+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849401f070 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.990+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84940094a0 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.990+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84940038a0 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.990+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac0cf8e0 con 0x7f84ac15c930 2023-05-11T07:36:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.991+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac0cdc20 con 0x7f84ac15c930 2023-05-11T07:36:36.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.992+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8494003a00 con 0x7f84ac15c930 2023-05-11T07:36:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.992+0000 7f84a8ff9700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.993+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8494021070 con 0x7f84ac15c930 2023-05-11T07:36:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.993+0000 7f84ab7fe700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.993+0000 7f84ab7fe700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 0x7f848c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f849c009c60 tx=0x7f849c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:36.997+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8494055e60 con 0x7f84ac15c930 2023-05-11T07:36:37.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.192+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84ac0cdf00 con 0x7f84ac15c930 2023-05-11T07:36:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.192+0000 7f84a8ff9700 1 -- 172.21.15.144:0/743103926 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8494003cb0 con 0x7f84ac15c930 2023-05-11T07:36:37.195 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 msgr2=0x7f848c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 0x7f848c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f849c009c60 tx=0x7f849c008040 comp rx=0 tx=0).stop 2023-05-11T07:36:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 msgr2=0x7f84ac0c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f84940090b0 tx=0x7f8494004750 comp rx=0 tx=0).stop 2023-05-11T07:36:37.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 shutdown_connections 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f848c06ace0 0x7f848c06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.194+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f84ac154400 0x7f84ac1f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.195+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84ac0d0270 0x7f84ac153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.195+0000 7f84b1bff700 1 --2- 172.21.15.144:0/743103926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15c930 0x7f84ac0c99f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.195+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 >> 172.21.15.144:0/743103926 conn(0x7f84ac0cfe00 msgr2=0x7f84ac0b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.195+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 shutdown_connections 2023-05-11T07:36:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.195+0000 7f84b1bff700 1 -- 172.21.15.144:0/743103926 wait complete. 2023-05-11T07:36:37.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:37.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.395+0000 7f85ff3ff700 1 Processor -- start 2023-05-11T07:36:37.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.395+0000 7f85ff3ff700 1 -- start start 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85ff3ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f85f80d27a0 0x7f85f80d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85ff3ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f815cef0 con 0x7f85f80b52a0 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85ff3ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80cd760 con 0x7f85f80b87e0 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85ff3ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80b5a80 con 0x7f85f80d27a0 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85fc99a700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f85f80b52a0 0x7f85f80d2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56088/0 (socket says 172.21.15.144:56088) 2023-05-11T07:36:37.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.396+0000 7f85fc99a700 1 -- 172.21.15.144:0/4008467300 learned_addr learned my addr 172.21.15.144:0/4008467300 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85fd99c700 1 --2- 172.21.15.144:0/4008467300 >> v2:172.21.15.145:3300/0 conn(0x7f85f80d27a0 0x7f85f80d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860506621 0 0) 0x7f85e8001110 con 0x7f85f80b52a0 2023-05-11T07:36:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e40035b0 con 0x7f85f80b52a0 2023-05-11T07:36:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438599409 0 0) 0x7f85f80cd760 con 0x7f85f80b87e0 2023-05-11T07:36:37.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e8001110 con 0x7f85f80b87e0 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85fd99c700 1 -- 172.21.15.144:0/4008467300 >> v1:172.21.15.145:6789/0 conn(0x7f85f80b87e0 legacy=0x7f85f80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85fd99c700 1 -- 172.21.15.144:0/4008467300 >> v1:172.21.15.144:6789/0 conn(0x7f85f80b52a0 legacy=0x7f85f80d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486485372 0 0) 0x7f85e40035b0 con 0x7f85f80b52a0 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85fd99c700 1 -- 172.21.15.144:0/4008467300 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80d2d30 con 0x7f85f80d27a0 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.397+0000 7f85fd99c700 1 --2- 172.21.15.144:0/4008467300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80d27a0 0x7f85f80d0ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9c288da1e67f3a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000e070 con 0x7f85f80d27a0 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0003a20 con 0x7f85f80d27a0 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85effff700 1 -- 172.21.15.144:0/4008467300 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8001800 con 0x7f85f80d27a0 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 -- 172.21.15.144:0/4008467300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80d27a0 msgr2=0x7f85f80d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/4008467300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80d27a0 0x7f85f80d0ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 -- 172.21.15.144:0/4008467300 shutdown_connections 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/4008467300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80d27a0 0x7f85f80d0ce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 -- 172.21.15.144:0/4008467300 >> 172.21.15.144:0/4008467300 conn(0x7f85f806acf0 msgr2=0x7f85f806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:37.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 -- 172.21.15.144:0/4008467300 shutdown_connections 2023-05-11T07:36:37.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.398+0000 7f85ff3ff700 1 -- 172.21.15.144:0/4008467300 wait complete. 2023-05-11T07:36:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.400+0000 7f85ff3ff700 1 Processor -- start 2023-05-11T07:36:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.400+0000 7f85ff3ff700 1 -- start start 2023-05-11T07:36:37.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80b87e0 0x7f85f80c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f80d27a0 0x7f85f80c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80c7620 con 0x7f85f80b52a0 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80c8480 con 0x7f85f80b87e0 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85ff3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80c7870 con 0x7f85f80d27a0 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85fd19b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85fd19b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47284/0 (socket says 172.21.15.144:47284) 2023-05-11T07:36:37.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.401+0000 7f85fd19b700 1 -- 172.21.15.144:0/887117711 learned_addr learned my addr 172.21.15.144:0/887117711 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 -- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f80d27a0 msgr2=0x7f85f80c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f80d27a0 0x7f85f80c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 -- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80b87e0 msgr2=0x7f85f80c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80b87e0 0x7f85f80c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 -- 172.21.15.144:0/887117711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009a70 con 0x7f85f80b52a0 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85fd19b700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c550 tx=0x7f85f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40052d0 con 0x7f85f80b52a0 2023-05-11T07:36:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4005430 con 0x7f85f80b52a0 2023-05-11T07:36:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40038c0 con 0x7f85f80b52a0 2023-05-11T07:36:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80cdc90 con 0x7f85f80b52a0 2023-05-11T07:36:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.402+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f80cd9b0 con 0x7f85f80b52a0 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.403+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80b8bb0 con 0x7f85f80b52a0 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.404+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85f4003a20 con 0x7f85f80b52a0 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.405+0000 7f85edffb700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.405+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f85f4088d60 con 0x7f85f80b52a0 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.405+0000 7f85fc99a700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.406+0000 7f85fc99a700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 0x7f85dc06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85e8001370 tx=0x7f85e8001b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.410+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f85f4053ae0 con 0x7f85f80b52a0 2023-05-11T07:36:37.610 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.608+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f808b830 con 0x7f85f80b52a0 2023-05-11T07:36:37.611 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.609+0000 7f85edffb700 1 -- 172.21.15.144:0/887117711 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f85f4074f30 con 0x7f85f80b52a0 2023-05-11T07:36:37.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:37.612 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:37.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 msgr2=0x7f85dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 0x7f85dc06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85e8001370 tx=0x7f85e8001b90 comp rx=0 tx=0).stop 2023-05-11T07:36:37.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 msgr2=0x7f85f814d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c550 tx=0x7f85f400c910 comp rx=0 tx=0).stop 2023-05-11T07:36:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 shutdown_connections 2023-05-11T07:36:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f85dc06ace0 0x7f85dc06d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f85f80d27a0 0x7f85f80c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85f80b52a0 0x7f85f814d4c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 --2- 172.21.15.144:0/887117711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85f80b87e0 0x7f85f80c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 >> 172.21.15.144:0/887117711 conn(0x7f85f806acf0 msgr2=0x7f85f80b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:37.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 shutdown_connections 2023-05-11T07:36:37.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.612+0000 7f85ff3ff700 1 -- 172.21.15.144:0/887117711 wait complete. 2023-05-11T07:36:37.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:37.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.818+0000 7fe1e9bff700 1 Processor -- start 2023-05-11T07:36:37.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.818+0000 7fe1e9bff700 1 -- start start 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.819+0000 7fe1e9bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 0x7fe1e406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.819+0000 7fe1e9bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40d0e80 con 0x7fe1e415c940 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.819+0000 7fe1e9bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40cdb00 con 0x7fe1e406b180 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.819+0000 7fe1e9bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e406b600 con 0x7fe1e4160ee0 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.819+0000 7fe1e37fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1e415c940 0x7fe1e40b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56098/0 (socket says 172.21.15.144:56098) 2023-05-11T07:36:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e37fe700 1 -- 172.21.15.144:0/2307796523 learned_addr learned my addr 172.21.15.144:0/2307796523 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e2ffd700 1 --2- 172.21.15.144:0/2307796523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 0x7fe1e406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667529877 0 0) 0x7fe1e40d0e80 con 0x7fe1e415c940 2023-05-11T07:36:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc0035b0 con 0x7fe1e415c940 2023-05-11T07:36:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e2ffd700 1 -- 172.21.15.144:0/2307796523 >> v1:172.21.15.145:6789/0 conn(0x7fe1e406b180 legacy=0x7fe1e40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558120830 0 0) 0x7fe1e40cdb00 con 0x7fe1e406b180 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e2ffd700 1 -- 172.21.15.144:0/2307796523 >> v1:172.21.15.144:6789/0 conn(0x7fe1e415c940 legacy=0x7fe1e40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.820+0000 7fe1e2ffd700 1 -- 172.21.15.144:0/2307796523 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40cdde0 con 0x7fe1e4160ee0 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e2ffd700 1 --2- 172.21.15.144:0/2307796523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 0x7fe1e406ac40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f202fdaf7cb47e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011830 con 0x7fe1e4160ee0 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8011990 con 0x7fe1e4160ee0 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e27fc700 1 -- 172.21.15.144:0/2307796523 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011d20 con 0x7fe1e4160ee0 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2307796523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 msgr2=0x7fe1e406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2307796523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 0x7fe1e406ac40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d8009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2307796523 shutdown_connections 2023-05-11T07:36:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2307796523 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e4160ee0 0x7fe1e406ac40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.821+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2307796523 >> 172.21.15.144:0/2307796523 conn(0x7fe1e40d3180 msgr2=0x7fe1e40d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.822+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2307796523 shutdown_connections 2023-05-11T07:36:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.822+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2307796523 wait complete. 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.823+0000 7fe1e9bff700 1 Processor -- start 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.823+0000 7fe1e9bff700 1 -- start start 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406b180 0x7fe1e41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e415c940 0x7fe1e415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415d6e0 con 0x7fe1e4160ee0 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e41f2fb0 con 0x7fe1e415c940 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e9bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415cdb0 con 0x7fe1e406b180 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47286/0 (socket says 172.21.15.144:47286) 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.824+0000 7fe1e3fff700 1 -- 172.21.15.144:0/2121526105 learned_addr learned my addr 172.21.15.144:0/2121526105 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e37fe700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406b180 0x7fe1e41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e2ffd700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e415c940 0x7fe1e415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 -- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406b180 msgr2=0x7fe1e41549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406b180 0x7fe1e41549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 -- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e415c940 msgr2=0x7fe1e415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e415c940 0x7fe1e415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 -- 172.21.15.144:0/2121526105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80094a0 con 0x7fe1e4160ee0 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e3fff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001560 tx=0x7fe1dc00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc003e30 con 0x7fe1e4160ee0 2023-05-11T07:36:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc005070 con 0x7fe1e4160ee0 2023-05-11T07:36:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40d1400 con 0x7fe1e4160ee0 2023-05-11T07:36:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.825+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc005420 con 0x7fe1e4160ee0 2023-05-11T07:36:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.826+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40d1120 con 0x7fe1e4160ee0 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.827+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40b66e0 con 0x7fe1e4160ee0 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.828+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1dc005580 con 0x7fe1e4160ee0 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.828+0000 7fe1cbfff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 0x7fe1d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.829+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe1dc088eb0 con 0x7fe1e4160ee0 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.829+0000 7fe1e37fe700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 0x7fe1d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.829+0000 7fe1e37fe700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 0x7fe1d006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4007fd0 tx=0x7fe1d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:37.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:37.834+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe1dc053b90 con 0x7fe1e4160ee0 2023-05-11T07:36:38.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.028+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e40744c0 con 0x7fe1e4160ee0 2023-05-11T07:36:38.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.029+0000 7fe1cbfff700 1 -- 172.21.15.144:0/2121526105 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1dc017020 con 0x7fe1e4160ee0 2023-05-11T07:36:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:38.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 msgr2=0x7fe1d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 0x7fe1d006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4007fd0 tx=0x7fe1d4009040 comp rx=0 tx=0).stop 2023-05-11T07:36:38.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 msgr2=0x7fe1e415e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc001560 tx=0x7fe1dc00cb50 comp rx=0 tx=0).stop 2023-05-11T07:36:38.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 shutdown_connections 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe1d006ace0 0x7fe1d006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe1e406b180 0x7fe1e41549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e4160ee0 0x7fe1e415e630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 --2- 172.21.15.144:0/2121526105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1e415c940 0x7fe1e415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 >> 172.21.15.144:0/2121526105 conn(0x7fe1e40d3180 msgr2=0x7fe1e40b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.031+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 shutdown_connections 2023-05-11T07:36:38.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.032+0000 7fe1e9bff700 1 -- 172.21.15.144:0/2121526105 wait complete. 2023-05-11T07:36:38.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:38.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.236+0000 7f35011ff700 1 Processor -- start 2023-05-11T07:36:38.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.237+0000 7f35011ff700 1 -- start start 2023-05-11T07:36:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f35011ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 0x7f34fc167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f35011ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0cf640 con 0x7f34fc0cfe00 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f35011ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc15cd00 con 0x7f34fc15c930 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f35011ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0cd940 con 0x7f34fc0d14c0 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f34fa59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f34fc0cfe00 0x7f34fc0d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56114/0 (socket says 172.21.15.144:56114) 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f34fa59c700 1 -- 172.21.15.144:0/2802743347 learned_addr learned my addr 172.21.15.144:0/2802743347 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.238+0000 7f34fb59e700 1 --2- 172.21.15.144:0/2802743347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 0x7f34fc167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941128015 0 0) 0x7f34fc15cd00 con 0x7f34fc15c930 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e40035b0 con 0x7f34fc15c930 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657457903 0 0) 0x7f34fc0cf640 con 0x7f34fc0cfe00 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc15cd00 con 0x7f34fc0cfe00 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34fb59e700 1 -- 172.21.15.144:0/2802743347 >> v1:172.21.15.145:6789/0 conn(0x7f34fc15c930 legacy=0x7f34fc15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34fb59e700 1 -- 172.21.15.144:0/2802743347 >> v1:172.21.15.144:6789/0 conn(0x7f34fc0cfe00 legacy=0x7f34fc0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34fb59e700 1 -- 172.21.15.144:0/2802743347 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0cdc20 con 0x7f34fc0d14c0 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34fb59e700 1 --2- 172.21.15.144:0/2802743347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 0x7f34fc167840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009df0 tx=0x7f34f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c44ac28cff42418 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400e070 con 0x7f34fc0d14c0 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f400bae0 con 0x7f34fc0d14c0 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.239+0000 7f34f9d9b700 1 -- 172.21.15.144:0/2802743347 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400be90 con 0x7f34fc0d14c0 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 -- 172.21.15.144:0/2802743347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 msgr2=0x7f34fc167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 --2- 172.21.15.144:0/2802743347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 0x7f34fc167840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009df0 tx=0x7f34f400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 -- 172.21.15.144:0/2802743347 shutdown_connections 2023-05-11T07:36:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 --2- 172.21.15.144:0/2802743347 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc0d14c0 0x7f34fc167840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 -- 172.21.15.144:0/2802743347 >> 172.21.15.144:0/2802743347 conn(0x7f34fc072650 msgr2=0x7f34fc06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 -- 172.21.15.144:0/2802743347 shutdown_connections 2023-05-11T07:36:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.240+0000 7f35011ff700 1 -- 172.21.15.144:0/2802743347 wait complete. 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.242+0000 7f35011ff700 1 Processor -- start 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.242+0000 7f35011ff700 1 -- start start 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc15c930 0x7f34fc0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34fc0cbfd0 0x7f34fc14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0ccb10 con 0x7f34fc0d14c0 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0cc550 con 0x7f34fc0cbfd0 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f35011ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0cc830 con 0x7f34fc15c930 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47294/0 (socket says 172.21.15.144:47294) 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 -- 172.21.15.144:0/967835582 learned_addr learned my addr 172.21.15.144:0/967835582 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fa59c700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc15c930 0x7f34fc0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fb59e700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34fc0cbfd0 0x7f34fc14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 -- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc15c930 msgr2=0x7f34fc0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc15c930 0x7f34fc0cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 -- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34fc0cbfd0 msgr2=0x7f34fc14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34fc0cbfd0 0x7f34fc14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.243+0000 7f34fad9d700 1 -- 172.21.15.144:0/967835582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4009a70 con 0x7f34fc0d14c0 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f34fad9d700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0010e0 tx=0x7f34ec00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0052d0 con 0x7f34fc0d14c0 2023-05-11T07:36:38.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec005430 con 0x7f34fc0d14c0 2023-05-11T07:36:38.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0038a0 con 0x7f34fc0d14c0 2023-05-11T07:36:38.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc0cdf00 con 0x7f34fc0d14c0 2023-05-11T07:36:38.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.244+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc0cf8e0 con 0x7f34fc0d14c0 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.245+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc0ce090 con 0x7f34fc0d14c0 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.246+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34ec003a00 con 0x7f34fc0d14c0 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.247+0000 7f34e37fe700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 0x7f34e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.247+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34ec088cb0 con 0x7f34fc0d14c0 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.247+0000 7f34fa59c700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 0x7f34e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.248+0000 7f34fa59c700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 0x7f34e806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15ba40 tx=0x7f34f0007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.251+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f34ec053900 con 0x7f34fc0d14c0 2023-05-11T07:36:38.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.443+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34fc0b2b10 con 0x7f34fc0d14c0 2023-05-11T07:36:38.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.444+0000 7f34e37fe700 1 -- 172.21.15.144:0/967835582 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34fc0b2b10 con 0x7f34fc0d14c0 2023-05-11T07:36:38.447 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:38.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 msgr2=0x7f34e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 0x7f34e806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15ba40 tx=0x7f34f0007dc0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 msgr2=0x7f34fc157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0010e0 tx=0x7f34ec00c7b0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 shutdown_connections 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f34e806ace0 0x7f34e806d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34fc0cbfd0 0x7f34fc14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34fc0d14c0 0x7f34fc157750 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 --2- 172.21.15.144:0/967835582 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f34fc15c930 0x7f34fc0cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 >> 172.21.15.144:0/967835582 conn(0x7f34fc0cfe00 msgr2=0x7f34fc0d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:38.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 shutdown_connections 2023-05-11T07:36:38.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.446+0000 7f35011ff700 1 -- 172.21.15.144:0/967835582 wait complete. 2023-05-11T07:36:38.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:38.653 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.650+0000 7f46a95ff700 1 Processor -- start 2023-05-11T07:36:38.653 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.651+0000 7f46a95ff700 1 -- start start 2023-05-11T07:36:38.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a95ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 0x7f46a40b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a95ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 0x7f46a406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a95ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a406b750 con 0x7f46a415e530 2023-05-11T07:36:38.655 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a95ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a415aec0 con 0x7f46a40b49d0 2023-05-11T07:36:38.655 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a95ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415eaa0 con 0x7f46a415aaf0 2023-05-11T07:36:38.655 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a2ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 0x7f46a40b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.655 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f46a37fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 0x7f46a406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f469bfff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f46a415e530 0x7f46a40b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:40816/0 (socket says 172.21.15.144:40816) 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.652+0000 7f469bfff700 1 -- 172.21.15.144:0/588655477 learned_addr learned my addr 172.21.15.144:0/588655477 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a2ffd700 1 -- 172.21.15.144:0/588655477 >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 msgr2=0x7f46a406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a2ffd700 1 --2- 172.21.15.144:0/588655477 >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 0x7f46a406bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a2ffd700 1 -- 172.21.15.144:0/588655477 >> v1:172.21.15.145:6789/0 conn(0x7f46a415e530 legacy=0x7f46a40b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.656 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a2ffd700 1 -- 172.21.15.144:0/588655477 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a415ed80 con 0x7f46a415aaf0 2023-05-11T07:36:38.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a37fe700 1 --2- 172.21.15.144:0/588655477 >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 0x7f46a406bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:38.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a2ffd700 1 --2- 172.21.15.144:0/588655477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 0x7f46a40b0a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4694009840 tx=0x7f4694009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3598183c5291361 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.653+0000 7f46a27fc700 1 -- 172.21.15.144:0/588655477 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011830 con 0x7f46a415aaf0 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a27fc700 1 -- 172.21.15.144:0/588655477 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694011990 con 0x7f46a415aaf0 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a27fc700 1 -- 172.21.15.144:0/588655477 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694011d20 con 0x7f46a415aaf0 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 -- 172.21.15.144:0/588655477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 msgr2=0x7f46a40b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 --2- 172.21.15.144:0/588655477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 0x7f46a40b0a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4694009840 tx=0x7f4694009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 -- 172.21.15.144:0/588655477 shutdown_connections 2023-05-11T07:36:38.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 --2- 172.21.15.144:0/588655477 >> v2:172.21.15.145:3300/0 conn(0x7f46a40b49d0 0x7f46a406bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 --2- 172.21.15.144:0/588655477 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a415aaf0 0x7f46a40b0a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 -- 172.21.15.144:0/588655477 >> 172.21.15.144:0/588655477 conn(0x7f46a40cb720 msgr2=0x7f46a40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 -- 172.21.15.144:0/588655477 shutdown_connections 2023-05-11T07:36:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.654+0000 7f46a95ff700 1 -- 172.21.15.144:0/588655477 wait complete. 2023-05-11T07:36:38.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.656+0000 7f46a95ff700 1 Processor -- start 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.656+0000 7f46a95ff700 1 -- start start 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a40b49d0 0x7f46a40cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46a415aaf0 0x7f46a415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415cc50 con 0x7f46a415e530 2023-05-11T07:36:38.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415c0c0 con 0x7f46a415aaf0 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a95ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40cb410 con 0x7f46a40b49d0 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47296/0 (socket says 172.21.15.144:47296) 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a37fe700 1 -- 172.21.15.144:0/3301942488 learned_addr learned my addr 172.21.15.144:0/3301942488 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f469bfff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46a415aaf0 0x7f46a415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.657+0000 7f46a2ffd700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a40b49d0 0x7f46a40cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 -- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a40b49d0 msgr2=0x7f46a40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a40b49d0 0x7f46a40cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 -- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46a415aaf0 msgr2=0x7f46a415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46a415aaf0 0x7f46a415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 -- 172.21.15.144:0/3301942488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c009a70 con 0x7f46a415e530 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a37fe700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e00 tx=0x7f469c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00cc90 con 0x7f46a415e530 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00f040 con 0x7f46a415e530 2023-05-11T07:36:38.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c014480 con 0x7f46a415e530 2023-05-11T07:36:38.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940094a0 con 0x7f46a415e530 2023-05-11T07:36:38.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.658+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a415f340 con 0x7f46a415e530 2023-05-11T07:36:38.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.659+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a415f060 con 0x7f46a415e530 2023-05-11T07:36:38.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.660+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f469c0145e0 con 0x7f46a415e530 2023-05-11T07:36:38.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.661+0000 7f469b7fe700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:38.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.661+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f469c08a100 con 0x7f46a415e530 2023-05-11T07:36:38.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.661+0000 7f46a2ffd700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:38.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.662+0000 7f46a2ffd700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 0x7f468406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4694000c00 tx=0x7f469401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:38.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.666+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f469c054d60 con 0x7f46a415e530 2023-05-11T07:36:38.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.858+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46a40b0fd0 con 0x7f46a415e530 2023-05-11T07:36:38.865 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.859+0000 7f469b7fe700 1 -- 172.21.15.144:0/3301942488 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f469c058380 con 0x7f46a415e530 2023-05-11T07:36:38.865 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 msgr2=0x7f468406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 0x7f468406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4694000c00 tx=0x7f469401c040 comp rx=0 tx=0).stop 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 msgr2=0x7f46a40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f469c009e00 tx=0x7f469c00c3a0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 shutdown_connections 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46a40b49d0 0x7f46a40cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46a415e530 0x7f46a40c9d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 --2- 172.21.15.144:0/3301942488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46a415aaf0 0x7f46a415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 >> 172.21.15.144:0/3301942488 conn(0x7f46a40cb720 msgr2=0x7f46a40cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.861+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 shutdown_connections 2023-05-11T07:36:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:38.862+0000 7f46a95ff700 1 -- 172.21.15.144:0/3301942488 wait complete. 2023-05-11T07:36:38.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.066+0000 7f0c6d9ff700 1 Processor -- start 2023-05-11T07:36:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.067+0000 7f0c6d9ff700 1 -- start start 2023-05-11T07:36:39.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0c6815c930 0x7f0c6815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c680cfe00 0x7f0c680d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6815de80 con 0x7f0c680cfe00 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680cf640 con 0x7f0c6815c930 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c6d9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6815cd00 con 0x7f0c680d02a0 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c680cfe00 0x7f0c680d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c680cfe00 0x7f0c680d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47306/0 (socket says 172.21.15.144:47306) 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 -- 172.21.15.144:0/1970082630 learned_addr learned my addr 172.21.15.144:0/1970082630 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c66ffd700 1 --2- 172.21.15.144:0/1970082630 >> v2:172.21.15.145:3300/0 conn(0x7f0c6815c930 0x7f0c6815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c677fe700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 -- 172.21.15.144:0/1970082630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 msgr2=0x7f0c680d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:39.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 -- 172.21.15.144:0/1970082630 >> v2:172.21.15.145:3300/0 conn(0x7f0c6815c930 msgr2=0x7f0c6815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:39.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 --2- 172.21.15.144:0/1970082630 >> v2:172.21.15.145:3300/0 conn(0x7f0c6815c930 0x7f0c6815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.068+0000 7f0c5ffff700 1 -- 172.21.15.144:0/1970082630 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680cd940 con 0x7f0c680cfe00 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c5ffff700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c680cfe00 0x7f0c680d0db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098f0 tx=0x7f0c50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc96468f098ef4ae server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c667fc700 1 -- 172.21.15.144:0/1970082630 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011830 con 0x7f0c680cfe00 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c667fc700 1 -- 172.21.15.144:0/1970082630 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50011990 con 0x7f0c680cfe00 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c667fc700 1 -- 172.21.15.144:0/1970082630 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011d20 con 0x7f0c680cfe00 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/1970082630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c680cfe00 msgr2=0x7f0c680d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c680cfe00 0x7f0c680d0db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c500098f0 tx=0x7f0c50009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:39.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/1970082630 shutdown_connections 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.069+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.070+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/1970082630 >> v2:172.21.15.145:3300/0 conn(0x7f0c6815c930 0x7f0c6815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.070+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/1970082630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c680cfe00 0x7f0c680d0db0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.070+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/1970082630 >> 172.21.15.144:0/1970082630 conn(0x7f0c68072650 msgr2=0x7f0c6806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.070+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/1970082630 shutdown_connections 2023-05-11T07:36:39.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.070+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/1970082630 wait complete. 2023-05-11T07:36:39.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.071+0000 7f0c6d9ff700 1 Processor -- start 2023-05-11T07:36:39.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.071+0000 7f0c6d9ff700 1 -- start start 2023-05-11T07:36:39.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c6815c930 0x7f0c680c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6814bab0 con 0x7f0c68158770 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c8180 con 0x7f0c6815c930 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.072+0000 7f0c6d9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c9b70 con 0x7f0c680d02a0 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47318/0 (socket says 172.21.15.144:47318) 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 -- 172.21.15.144:0/124357777 learned_addr learned my addr 172.21.15.144:0/124357777 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c66ffd700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c5ffff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c6815c930 0x7f0c680c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 -- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 msgr2=0x7f0c680c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 -- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c6815c930 msgr2=0x7f0c680c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c6815c930 0x7f0c680c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 -- 172.21.15.144:0/124357777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c50009550 con 0x7f0c68158770 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c677fe700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000eed0 tx=0x7f0c6000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60010040 con 0x7f0c68158770 2023-05-11T07:36:39.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000b9f0 con 0x7f0c68158770 2023-05-11T07:36:39.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.073+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680cf8e0 con 0x7f0c68158770 2023-05-11T07:36:39.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.074+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000bda0 con 0x7f0c68158770 2023-05-11T07:36:39.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.074+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c680cdc20 con 0x7f0c68158770 2023-05-11T07:36:39.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.075+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680cdf00 con 0x7f0c68158770 2023-05-11T07:36:39.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.076+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c6001d400 con 0x7f0c68158770 2023-05-11T07:36:39.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.076+0000 7f0c64ff9700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.077+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c60089d90 con 0x7f0c68158770 2023-05-11T07:36:39.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.077+0000 7f0c66ffd700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.077+0000 7f0c66ffd700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 0x7f0c4806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009be0 tx=0x7f0c58009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.081+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0c60054b00 con 0x7f0c68158770 2023-05-11T07:36:39.276 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.273+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c680c9ce0 con 0x7f0c68158770 2023-05-11T07:36:39.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.274+0000 7f0c64ff9700 1 -- 172.21.15.144:0/124357777 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c60058120 con 0x7f0c68158770 2023-05-11T07:36:39.277 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:39.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 msgr2=0x7f0c4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 0x7f0c4806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009be0 tx=0x7f0c58009210 comp rx=0 tx=0).stop 2023-05-11T07:36:39.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 msgr2=0x7f0c6814b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.279 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000eed0 tx=0x7f0c6000ef00 comp rx=0 tx=0).stop 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 shutdown_connections 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0c680d02a0 0x7f0c680c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c68158770 0x7f0c6814b570 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 --2- 172.21.15.144:0/124357777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c6815c930 0x7f0c680c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.276+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 >> 172.21.15.144:0/124357777 conn(0x7f0c680cfe00 msgr2=0x7f0c680b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.277+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 shutdown_connections 2023-05-11T07:36:39.280 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.277+0000 7f0c6d9ff700 1 -- 172.21.15.144:0/124357777 wait complete. 2023-05-11T07:36:39.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:39.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.483+0000 7fd7c0dff700 1 Processor -- start 2023-05-11T07:36:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.483+0000 7fd7c0dff700 1 -- start start 2023-05-11T07:36:39.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7c0dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc160ee0 0x7fd7bc06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7c0dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7bc06b180 0x7fd7bc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7c0dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0d0e80 con 0x7fd7bc15c940 2023-05-11T07:36:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7c0dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc06b600 con 0x7fd7bc06b180 2023-05-11T07:36:39.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7c0dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0cdb00 con 0x7fd7bc160ee0 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.484+0000 7fd7bad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7bc06b180 0x7fd7bc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7bc06b180 0x7fd7bc0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47324/0 (socket says 172.21.15.144:47324) 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 -- 172.21.15.144:0/327885156 learned_addr learned my addr 172.21.15.144:0/327885156 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7b9d9b700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc160ee0 0x7fd7bc06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 -- 172.21.15.144:0/327885156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc160ee0 msgr2=0x7fd7bc06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:39.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc160ee0 0x7fd7bc06ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 -- 172.21.15.144:0/327885156 >> v1:172.21.15.145:6789/0 conn(0x7fd7bc15c940 legacy=0x7fd7bc0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 -- 172.21.15.144:0/327885156 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0cdde0 con 0x7fd7bc06b180 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7bad9d700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc06b180 0x7fd7bc0d1920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009e50 tx=0x7fd7b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ec14ec7af586a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.485+0000 7fd7b959a700 1 -- 172.21.15.144:0/327885156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400e070 con 0x7fd7bc06b180 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7b959a700 1 -- 172.21.15.144:0/327885156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400b9c0 con 0x7fd7bc06b180 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7b959a700 1 -- 172.21.15.144:0/327885156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400bd70 con 0x7fd7bc06b180 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 -- 172.21.15.144:0/327885156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc06b180 msgr2=0x7fd7bc0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc06b180 0x7fd7bc0d1920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009e50 tx=0x7fd7b400b330 comp rx=0 tx=0).stop 2023-05-11T07:36:39.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 -- 172.21.15.144:0/327885156 shutdown_connections 2023-05-11T07:36:39.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc06b180 0x7fd7bc0d1920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/327885156 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc160ee0 0x7fd7bc06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.492 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 -- 172.21.15.144:0/327885156 >> 172.21.15.144:0/327885156 conn(0x7fd7bc0d3180 msgr2=0x7fd7bc0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 -- 172.21.15.144:0/327885156 shutdown_connections 2023-05-11T07:36:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.486+0000 7fd7c0dff700 1 -- 172.21.15.144:0/327885156 wait complete. 2023-05-11T07:36:39.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.488+0000 7fd7c0dff700 1 Processor -- start 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.488+0000 7fd7c0dff700 1 -- start start 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc06b180 0x7fd7bc15f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7bc160ee0 0x7fd7bc156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc159730 con 0x7fd7bc15c940 2023-05-11T07:36:39.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc158bb0 con 0x7fd7bc160ee0 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7c0dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc158e90 con 0x7fd7bc06b180 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7b9d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7b9d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47336/0 (socket says 172.21.15.144:47336) 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.489+0000 7fd7b9d9b700 1 -- 172.21.15.144:0/2977046942 learned_addr learned my addr 172.21.15.144:0/2977046942 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7ba59c700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc06b180 0x7fd7bc15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7bad9d700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7bc160ee0 0x7fd7bc156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 -- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc06b180 msgr2=0x7fd7bc15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc06b180 0x7fd7bc15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 -- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7bc160ee0 msgr2=0x7fd7bc156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7bc160ee0 0x7fd7bc156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 -- 172.21.15.144:0/2977046942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009b30 con 0x7fd7bc15c940 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7b9d9b700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000d800 tx=0x7fd7b000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00125f0 con 0x7fd7bc15c940 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b0012750 con 0x7fd7bc15c940 2023-05-11T07:36:39.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012b00 con 0x7fd7bc15c940 2023-05-11T07:36:39.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc0d1400 con 0x7fd7bc15c940 2023-05-11T07:36:39.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.490+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc0d1120 con 0x7fd7bc15c940 2023-05-11T07:36:39.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.492+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc0b66e0 con 0x7fd7bc15c940 2023-05-11T07:36:39.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.492+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7b0012c60 con 0x7fd7bc15c940 2023-05-11T07:36:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.493+0000 7fd7aaffd700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 0x7fd79c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.493+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7b0089ad0 con 0x7fd7bc15c940 2023-05-11T07:36:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.493+0000 7fd7ba59c700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 0x7fd79c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.494+0000 7fd7ba59c700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 0x7fd79c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000f60 tx=0x7fd7ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.497+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7b00548e0 con 0x7fd7bc15c940 2023-05-11T07:36:39.695 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.692+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7bc0744c0 con 0x7fd7bc15c940 2023-05-11T07:36:39.695 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.693+0000 7fd7aaffd700 1 -- 172.21.15.144:0/2977046942 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7b0057f00 con 0x7fd7bc15c940 2023-05-11T07:36:39.696 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:39.697 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 msgr2=0x7fd79c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 0x7fd79c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac000f60 tx=0x7fd7ac009040 comp rx=0 tx=0).stop 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 msgr2=0x7fd7bc151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000d800 tx=0x7fd7b000dbc0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 shutdown_connections 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd79c06ace0 0x7fd79c06d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7bc06b180 0x7fd7bc15f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7bc160ee0 0x7fd7bc156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 --2- 172.21.15.144:0/2977046942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7bc15c940 0x7fd7bc151c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 >> 172.21.15.144:0/2977046942 conn(0x7fd7bc0d3180 msgr2=0x7fd7bc0b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:39.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 shutdown_connections 2023-05-11T07:36:39.699 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.695+0000 7fd7c0dff700 1 -- 172.21.15.144:0/2977046942 wait complete. 2023-05-11T07:36:39.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.898+0000 7fec191ff700 1 Processor -- start 2023-05-11T07:36:39.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.898+0000 7fec191ff700 1 -- start start 2023-05-11T07:36:39.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec191ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 0x7fec140c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec191ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1406a2d0 0x7fec1406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec191ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec14159bc0 con 0x7fec1415dc80 2023-05-11T07:36:39.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec191ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1406ac90 con 0x7fec1406a2d0 2023-05-11T07:36:39.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec191ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec140c9e30 con 0x7fec141597f0 2023-05-11T07:36:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec1359e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1406a2d0 0x7fec1406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec1359e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1406a2d0 0x7fec1406a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47338/0 (socket says 172.21.15.144:47338) 2023-05-11T07:36:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec1259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec1415dc80 0x7fec140cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56118/0 (socket says 172.21.15.144:56118) 2023-05-11T07:36:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.899+0000 7fec1359e700 1 -- 172.21.15.144:0/3587004181 learned_addr learned my addr 172.21.15.144:0/3587004181 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec12d9d700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 0x7fec140c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.904 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec1359e700 1 -- 172.21.15.144:0/3587004181 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 msgr2=0x7fec140c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec1359e700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 0x7fec140c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec1359e700 1 -- 172.21.15.144:0/3587004181 >> v1:172.21.15.144:6789/0 conn(0x7fec1415dc80 legacy=0x7fec140cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec1359e700 1 -- 172.21.15.144:0/3587004181 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140ca110 con 0x7fec1406a2d0 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec12d9d700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 0x7fec140c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec11d9b700 1 -- 172.21.15.144:0/3587004181 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119479982 0 0) 0x7fec08001110 con 0x7fec1415dc80 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec1359e700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1406a2d0 0x7fec1406a750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009e50 tx=0x7fec0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52208fe1e70b982b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec11d9b700 1 -- 172.21.15.144:0/3587004181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00e070 con 0x7fec1406a2d0 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec11d9b700 1 -- 172.21.15.144:0/3587004181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00b9c0 con 0x7fec1406a2d0 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.900+0000 7fec11d9b700 1 -- 172.21.15.144:0/3587004181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00bd70 con 0x7fec1406a2d0 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 -- 172.21.15.144:0/3587004181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1406a2d0 msgr2=0x7fec1406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1406a2d0 0x7fec1406a750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009e50 tx=0x7fec0c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 -- 172.21.15.144:0/3587004181 shutdown_connections 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1406a2d0 0x7fec1406a750 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 --2- 172.21.15.144:0/3587004181 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec141597f0 0x7fec140c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 -- 172.21.15.144:0/3587004181 >> 172.21.15.144:0/3587004181 conn(0x7fec140cb7e0 msgr2=0x7fec140cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 -- 172.21.15.144:0/3587004181 shutdown_connections 2023-05-11T07:36:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.901+0000 7fec191ff700 1 -- 172.21.15.144:0/3587004181 wait complete. 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.903+0000 7fec191ff700 1 Processor -- start 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.903+0000 7fec191ff700 1 -- start start 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec1406a2d0 0x7fec140b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec141597f0 0x7fec141542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140c4590 con 0x7fec1415dc80 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1415b340 con 0x7fec141597f0 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec191ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec140c3c60 con 0x7fec1406a2d0 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47344/0 (socket says 172.21.15.144:47344) 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 -- 172.21.15.144:0/1310392441 learned_addr learned my addr 172.21.15.144:0/1310392441 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 -- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec1406a2d0 msgr2=0x7fec140b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec1406a2d0 0x7fec140b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 -- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec141597f0 msgr2=0x7fec141542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec141597f0 0x7fec141542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.904+0000 7fec1359e700 1 -- 172.21.15.144:0/1310392441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009b30 con 0x7fec1415dc80 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7fec1359e700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fec1406d8c0 tx=0x7fec0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c003ea0 con 0x7fec1415dc80 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c0099b0 con 0x7fec1415dc80 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec140ccf90 con 0x7fec1415dc80 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01b670 con 0x7fec1415dc80 2023-05-11T07:36:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.905+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec140cccb0 con 0x7fec1415dc80 2023-05-11T07:36:39.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.906+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec140cd270 con 0x7fec1415dc80 2023-05-11T07:36:39.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.907+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec0c01b7d0 con 0x7fec1415dc80 2023-05-11T07:36:39.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.908+0000 7febfb7fe700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 0x7fec0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:39.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.908+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec0c08b130 con 0x7fec1415dc80 2023-05-11T07:36:39.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.908+0000 7fec12d9d700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 0x7fec0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:39.913 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.908+0000 7fec12d9d700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 0x7fec0006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec04006fd0 tx=0x7fec04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:39.912+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec0c055ea0 con 0x7fec1415dc80 2023-05-11T07:36:40.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.112+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec140c46d0 con 0x7fec1415dc80 2023-05-11T07:36:40.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.113+0000 7febfb7fe700 1 -- 172.21.15.144:0/1310392441 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fec140c46d0 con 0x7fec1415dc80 2023-05-11T07:36:40.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:40.117 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:40.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 msgr2=0x7fec0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 0x7fec0006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec04006fd0 tx=0x7fec04008040 comp rx=0 tx=0).stop 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 msgr2=0x7fec140af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fec1406d8c0 tx=0x7fec0c004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 shutdown_connections 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fec0006ace0 0x7fec0006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fec1406a2d0 0x7fec140b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1415dc80 0x7fec140af750 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 --2- 172.21.15.144:0/1310392441 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec141597f0 0x7fec141542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 >> 172.21.15.144:0/1310392441 conn(0x7fec140cb7e0 msgr2=0x7fec14155a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:40.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 shutdown_connections 2023-05-11T07:36:40.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.116+0000 7fec191ff700 1 -- 172.21.15.144:0/1310392441 wait complete. 2023-05-11T07:36:40.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:40.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:40.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.321+0000 7fd0acbff700 1 Processor -- start 2023-05-11T07:36:40.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.321+0000 7fd0acbff700 1 -- start start 2023-05-11T07:36:40.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0acbff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 0x7fd0a8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0acbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 0x7fd0a80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0acbff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80d0e80 con 0x7fd0a80b5fd0 2023-05-11T07:36:40.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0acbff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a8161420 con 0x7fd0a815c940 2023-05-11T07:36:40.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0acbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80cdb00 con 0x7fd0a806b350 2023-05-11T07:36:40.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd09ffff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd0a80b5fd0 0x7fd0a806ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56124/0 (socket says 172.21.15.144:56124) 2023-05-11T07:36:40.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd09ffff700 1 -- 172.21.15.144:0/3418400089 learned_addr learned my addr 172.21.15.144:0/3418400089 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:40.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0a659c700 1 --2- 172.21.15.144:0/3418400089 >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 0x7fd0a8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0a6d9d700 1 --2- 172.21.15.144:0/3418400089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 0x7fd0a80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.323+0000 7fd0a5d9b700 1 -- 172.21.15.144:0/3418400089 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294201379 0 0) 0x7fd0a80d0e80 con 0x7fd0a80b5fd0 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a5d9b700 1 -- 172.21.15.144:0/3418400089 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0940035b0 con 0x7fd0a80b5fd0 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a6d9d700 1 -- 172.21.15.144:0/3418400089 >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 msgr2=0x7fd0a8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a6d9d700 1 --2- 172.21.15.144:0/3418400089 >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 0x7fd0a8160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a6d9d700 1 -- 172.21.15.144:0/3418400089 >> v1:172.21.15.144:6789/0 conn(0x7fd0a80b5fd0 legacy=0x7fd0a806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a6d9d700 1 -- 172.21.15.144:0/3418400089 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80cdde0 con 0x7fd0a806b350 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a659c700 1 --2- 172.21.15.144:0/3418400089 >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 0x7fd0a8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:40.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a6d9d700 1 --2- 172.21.15.144:0/3418400089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 0x7fd0a80d1920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009d90 tx=0x7fd0a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=301926e6462de6c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a5d9b700 1 -- 172.21.15.144:0/3418400089 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000e070 con 0x7fd0a806b350 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a5d9b700 1 -- 172.21.15.144:0/3418400089 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a000bb20 con 0x7fd0a806b350 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.324+0000 7fd0a5d9b700 1 -- 172.21.15.144:0/3418400089 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0012430 con 0x7fd0a806b350 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 -- 172.21.15.144:0/3418400089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 msgr2=0x7fd0a80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 --2- 172.21.15.144:0/3418400089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 0x7fd0a80d1920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009d90 tx=0x7fd0a000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 -- 172.21.15.144:0/3418400089 shutdown_connections 2023-05-11T07:36:40.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 --2- 172.21.15.144:0/3418400089 >> v2:172.21.15.145:3300/0 conn(0x7fd0a815c940 0x7fd0a8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 --2- 172.21.15.144:0/3418400089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a806b350 0x7fd0a80d1920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 -- 172.21.15.144:0/3418400089 >> 172.21.15.144:0/3418400089 conn(0x7fd0a80d3180 msgr2=0x7fd0a80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:40.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 -- 172.21.15.144:0/3418400089 shutdown_connections 2023-05-11T07:36:40.331 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.325+0000 7fd0acbff700 1 -- 172.21.15.144:0/3418400089 wait complete. 2023-05-11T07:36:40.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.327+0000 7fd0acbff700 1 Processor -- start 2023-05-11T07:36:40.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.327+0000 7fd0acbff700 1 -- start start 2023-05-11T07:36:40.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0a80b5fd0 0x7fd0a815e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a815c940 0x7fd0a815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815f420 con 0x7fd0a806b350 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815f700 con 0x7fd0a80b5fd0 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0acbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815f9e0 con 0x7fd0a815c940 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47354/0 (socket says 172.21.15.144:47354) 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 -- 172.21.15.144:0/2269187425 learned_addr learned my addr 172.21.15.144:0/2269187425 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 -- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a815c940 msgr2=0x7fd0a815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a815c940 0x7fd0a815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 -- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0a80b5fd0 msgr2=0x7fd0a815e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0a80b5fd0 0x7fd0a815e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 -- 172.21.15.144:0/2269187425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980094a0 con 0x7fd0a806b350 2023-05-11T07:36:40.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.328+0000 7fd0a659c700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd09800ebe0 tx=0x7fd098009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.329+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800c8b0 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.329+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800ca10 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.329+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800cd80 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.329+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a0009a70 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.329+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80d1400 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.330+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80d1120 con 0x7fd0a806b350 2023-05-11T07:36:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.331+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd098013470 con 0x7fd0a806b350 2023-05-11T07:36:40.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.332+0000 7fd09effd700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.332+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd098089900 con 0x7fd0a806b350 2023-05-11T07:36:40.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.332+0000 7fd09ffff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.332+0000 7fd09ffff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 0x7fd08806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.336+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd098054670 con 0x7fd0a806b350 2023-05-11T07:36:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.529+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0a815cd10 con 0x7fd0a806b350 2023-05-11T07:36:40.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.529+0000 7fd09effd700 1 -- 172.21.15.144:0/2269187425 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd098057c90 con 0x7fd0a806b350 2023-05-11T07:36:40.532 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:40.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 msgr2=0x7fd08806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 0x7fd08806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd090007fd0 tx=0x7fd090007980 comp rx=0 tx=0).stop 2023-05-11T07:36:40.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 msgr2=0x7fd0a81f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd09800ebe0 tx=0x7fd098009e20 comp rx=0 tx=0).stop 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 shutdown_connections 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0a815c940 0x7fd0a815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0a806b350 0x7fd0a81f1e60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 --2- 172.21.15.144:0/2269187425 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0a80b5fd0 0x7fd0a815e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 >> 172.21.15.144:0/2269187425 conn(0x7fd0a80d3180 msgr2=0x7fd0a8073780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:40.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 shutdown_connections 2023-05-11T07:36:40.536 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.532+0000 7fd0acbff700 1 -- 172.21.15.144:0/2269187425 wait complete. 2023-05-11T07:36:40.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.738+0000 7febc7fff700 1 Processor -- start 2023-05-11T07:36:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.738+0000 7febc7fff700 1 -- start start 2023-05-11T07:36:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 0x7febc0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7febc00b5fd0 0x7febc006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7febc00b6420 0x7febc006b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc0161420 con 0x7febc00b5fd0 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00d0e80 con 0x7febc00b6420 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc7fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00cdb00 con 0x7febc015c940 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc559a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7febc00b5fd0 0x7febc006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc559a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7febc00b5fd0 0x7febc006ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47366/0 (socket says 172.21.15.144:47366) 2023-05-11T07:36:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc559a700 1 -- 172.21.15.144:0/264559730 learned_addr learned my addr 172.21.15.144:0/264559730 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc5d9b700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 0x7febc0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.739+0000 7febc659c700 1 --2- 172.21.15.144:0/264559730 >> v2:172.21.15.145:3300/0 conn(0x7febc00b6420 0x7febc006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 -- 172.21.15.144:0/264559730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 msgr2=0x7febc0160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 0x7febc0160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 -- 172.21.15.144:0/264559730 >> v2:172.21.15.145:3300/0 conn(0x7febc00b6420 msgr2=0x7febc006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 --2- 172.21.15.144:0/264559730 >> v2:172.21.15.145:3300/0 conn(0x7febc00b6420 0x7febc006b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 -- 172.21.15.144:0/264559730 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00cdde0 con 0x7febc00b5fd0 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc5d9b700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 0x7febc0160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc559a700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc006ac40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7febc006bcb0 tx=0x7febb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acbeb13183d4b47 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc4d99700 1 -- 172.21.15.144:0/264559730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000b870 con 0x7febc00b5fd0 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc4d99700 1 -- 172.21.15.144:0/264559730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000b9d0 con 0x7febc00b5fd0 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.740+0000 7febc4d99700 1 -- 172.21.15.144:0/264559730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000bd60 con 0x7febc00b5fd0 2023-05-11T07:36:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 -- 172.21.15.144:0/264559730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 msgr2=0x7febc006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc006ac40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7febc006bcb0 tx=0x7febb0009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 -- 172.21.15.144:0/264559730 shutdown_connections 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 --2- 172.21.15.144:0/264559730 >> v2:172.21.15.145:3300/0 conn(0x7febc00b6420 0x7febc006b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc015c940 0x7febc0160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 --2- 172.21.15.144:0/264559730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc006ac40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 -- 172.21.15.144:0/264559730 >> 172.21.15.144:0/264559730 conn(0x7febc00d3180 msgr2=0x7febc00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 -- 172.21.15.144:0/264559730 shutdown_connections 2023-05-11T07:36:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.741+0000 7febc7fff700 1 -- 172.21.15.144:0/264559730 wait complete. 2023-05-11T07:36:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.743+0000 7febc7fff700 1 Processor -- start 2023-05-11T07:36:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.743+0000 7febc7fff700 1 -- start start 2023-05-11T07:36:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc00b6420 0x7febc01f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febc015c940 0x7febc00c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01f2c60 con 0x7febc00b5fd0 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01f2f40 con 0x7febc015c940 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc7fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01f3220 con 0x7febc00b6420 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47376/0 (socket says 172.21.15.144:47376) 2023-05-11T07:36:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 -- 172.21.15.144:0/3157719618 learned_addr learned my addr 172.21.15.144:0/3157719618 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc559a700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc00b6420 0x7febc01f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc659c700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febc015c940 0x7febc00c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 -- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc00b6420 msgr2=0x7febc01f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc00b6420 0x7febc01f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 -- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febc015c940 msgr2=0x7febc00c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febc015c940 0x7febc00c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.744+0000 7febc5d9b700 1 -- 172.21.15.144:0/3157719618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0009550 con 0x7febc00b5fd0 2023-05-11T07:36:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febc5d9b700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c7f0 tx=0x7febbc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc011800 con 0x7febc00b5fd0 2023-05-11T07:36:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc011960 con 0x7febc00b5fd0 2023-05-11T07:36:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc00d1400 con 0x7febc00b5fd0 2023-05-11T07:36:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc011cf0 con 0x7febc00b5fd0 2023-05-11T07:36:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.745+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc00d1120 con 0x7febc00b5fd0 2023-05-11T07:36:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.746+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc015cd10 con 0x7febc00b5fd0 2023-05-11T07:36:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.747+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febbc018360 con 0x7febc00b5fd0 2023-05-11T07:36:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.748+0000 7febb67fc700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 0x7feba406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.748+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febbc089700 con 0x7febc00b5fd0 2023-05-11T07:36:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.748+0000 7febc559a700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 0x7feba406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.749+0000 7febc559a700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 0x7feba406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.752+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7febbc054490 con 0x7febc00b5fd0 2023-05-11T07:36:40.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.947+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febc01f2da0 con 0x7febc00b5fd0 2023-05-11T07:36:40.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.948+0000 7febb67fc700 1 -- 172.21.15.144:0/3157719618 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7febc01f2da0 con 0x7febc00b5fd0 2023-05-11T07:36:40.951 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 msgr2=0x7feba406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 0x7feba406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008030 comp rx=0 tx=0).stop 2023-05-11T07:36:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 msgr2=0x7febc00cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7febbc00c7f0 tx=0x7febbc00cb00 comp rx=0 tx=0).stop 2023-05-11T07:36:40.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 shutdown_connections 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7feba406ace0 0x7feba406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febc015c940 0x7febc00c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc00b5fd0 0x7febc00cd030 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 --2- 172.21.15.144:0/3157719618 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7febc00b6420 0x7febc01f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 >> 172.21.15.144:0/3157719618 conn(0x7febc00d3180 msgr2=0x7febc006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 shutdown_connections 2023-05-11T07:36:40.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:40.950+0000 7febc7fff700 1 -- 172.21.15.144:0/3157719618 wait complete. 2023-05-11T07:36:40.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.157+0000 7ff36dfff700 1 Processor -- start 2023-05-11T07:36:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.157+0000 7ff36dfff700 1 -- start start 2023-05-11T07:36:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff36dfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815e530 0x7ff3680b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff36dfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff3680c92f0 0x7ff3680b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff36dfff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36806b750 con 0x7ff36815aaf0 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff36dfff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36815aec0 con 0x7ff3680c92f0 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff36dfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36815eaa0 con 0x7ff36815e530 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff3677fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff36815aaf0 0x7ff3680b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56134/0 (socket says 172.21.15.144:56134) 2023-05-11T07:36:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.158+0000 7ff3677fe700 1 -- 172.21.15.144:0/1342281162 learned_addr learned my addr 172.21.15.144:0/1342281162 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 --2- 172.21.15.144:0/1342281162 >> v2:172.21.15.145:3300/0 conn(0x7ff3680c92f0 0x7ff3680b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff366ffd700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815e530 0x7ff3680b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff3667fc700 1 -- 172.21.15.144:0/1342281162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855214963 0 0) 0x7ff36806b750 con 0x7ff36815aaf0 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff3667fc700 1 -- 172.21.15.144:0/1342281162 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3500035b0 con 0x7ff36815aaf0 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 -- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815e530 msgr2=0x7ff3680b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815e530 0x7ff3680b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 -- 172.21.15.144:0/1342281162 >> v1:172.21.15.144:6789/0 conn(0x7ff36815aaf0 legacy=0x7ff3680b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 -- 172.21.15.144:0/1342281162 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36815ed80 con 0x7ff3680c92f0 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.159+0000 7ff367fff700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3680c92f0 0x7ff3680b4800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f92a11c50d44c3a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff3667fc700 1 -- 172.21.15.144:0/1342281162 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000e070 con 0x7ff3680c92f0 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff3667fc700 1 -- 172.21.15.144:0/1342281162 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000bb20 con 0x7ff3680c92f0 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff3667fc700 1 -- 172.21.15.144:0/1342281162 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360012430 con 0x7ff3680c92f0 2023-05-11T07:36:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 -- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3680c92f0 msgr2=0x7ff3680b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3680c92f0 0x7ff3680b4800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff360009d90 tx=0x7ff36000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 -- 172.21.15.144:0/1342281162 shutdown_connections 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3680c92f0 0x7ff3680b4800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 --2- 172.21.15.144:0/1342281162 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815e530 0x7ff3680b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 -- 172.21.15.144:0/1342281162 >> 172.21.15.144:0/1342281162 conn(0x7ff3680cb720 msgr2=0x7ff3680cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 -- 172.21.15.144:0/1342281162 shutdown_connections 2023-05-11T07:36:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.160+0000 7ff36dfff700 1 -- 172.21.15.144:0/1342281162 wait complete. 2023-05-11T07:36:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.162+0000 7ff36dfff700 1 Processor -- start 2023-05-11T07:36:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.162+0000 7ff36dfff700 1 -- start start 2023-05-11T07:36:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 0x7ff3680b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff36815e530 0x7ff3680c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680c8500 con 0x7ff3680c92f0 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b2730 con 0x7ff36815e530 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff36dfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b1b90 con 0x7ff36815aaf0 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff3677fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47390/0 (socket says 172.21.15.144:47390) 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff3677fe700 1 -- 172.21.15.144:0/3388031374 learned_addr learned my addr 172.21.15.144:0/3388031374 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff367fff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff36815e530 0x7ff3680c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.163+0000 7ff366ffd700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 0x7ff3680b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 -- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 msgr2=0x7ff3680b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 0x7ff3680b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 -- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff36815e530 msgr2=0x7ff3680c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff36815e530 0x7ff3680c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 -- 172.21.15.144:0/3388031374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360009a70 con 0x7ff3680c92f0 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff366ffd700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 0x7ff3680b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff3677fe700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c730 tx=0x7ff35800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358005d70 con 0x7ff3680c92f0 2023-05-11T07:36:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3580070d0 con 0x7ff3680c92f0 2023-05-11T07:36:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36815f340 con 0x7ff3680c92f0 2023-05-11T07:36:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358007440 con 0x7ff3680c92f0 2023-05-11T07:36:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.164+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36815f060 con 0x7ff3680c92f0 2023-05-11T07:36:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.165+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36806bbe0 con 0x7ff3680c92f0 2023-05-11T07:36:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.166+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3580075a0 con 0x7ff3680c92f0 2023-05-11T07:36:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.167+0000 7ff34ffff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.167+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff358088c80 con 0x7ff3680c92f0 2023-05-11T07:36:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.167+0000 7ff366ffd700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.168+0000 7ff366ffd700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 0x7ff35406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cfbe0 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.173 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.171+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff358053a30 con 0x7ff3680c92f0 2023-05-11T07:36:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.365+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3680b1f20 con 0x7ff3680c92f0 2023-05-11T07:36:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.365+0000 7ff34ffff700 1 -- 172.21.15.144:0/3388031374 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff358057050 con 0x7ff3680c92f0 2023-05-11T07:36:41.368 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.367+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 msgr2=0x7ff35406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.367+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 0x7ff35406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cfbe0 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2023-05-11T07:36:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.367+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 msgr2=0x7ff368151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.367+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c730 tx=0x7ff35800caf0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 shutdown_connections 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff35406ace0 0x7ff35406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff36815e530 0x7ff3680c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3680c92f0 0x7ff368151af0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 --2- 172.21.15.144:0/3388031374 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff36815aaf0 0x7ff3680b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 >> 172.21.15.144:0/3388031374 conn(0x7ff3680cb720 msgr2=0x7ff3680afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 shutdown_connections 2023-05-11T07:36:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.368+0000 7ff36dfff700 1 -- 172.21.15.144:0/3388031374 wait complete. 2023-05-11T07:36:41.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:41.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.575+0000 7ff021bff700 1 Processor -- start 2023-05-11T07:36:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.575+0000 7ff021bff700 1 -- start start 2023-05-11T07:36:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff021bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff01c1599e0 0x7ff01c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff021bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff01c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff021bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c0b10c0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff021bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c15e200 con 0x7ff01c1599e0 2023-05-11T07:36:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff021bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15a100 con 0x7ff01c0ca020 2023-05-11T07:36:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff01bfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff01c0b0c60 0x7ff01c06c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56136/0 (socket says 172.21.15.144:56136) 2023-05-11T07:36:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.576+0000 7ff01bfff700 1 -- 172.21.15.144:0/679254111 learned_addr learned my addr 172.21.15.144:0/679254111 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/679254111 >> v2:172.21.15.145:3300/0 conn(0x7ff01c1599e0 0x7ff01c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff01c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65950951 0 0) 0x7ff01c0b10c0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0040035b0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128154973 0 0) 0x7ff0040035b0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 msgr2=0x7ff01c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff01c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 >> v2:172.21.15.145:3300/0 conn(0x7ff01c1599e0 msgr2=0x7ff01c0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 --2- 172.21.15.144:0/679254111 >> v2:172.21.15.145:3300/0 conn(0x7ff01c1599e0 0x7ff01c0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c15a3e0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7ff0140019f0 con 0x7ff01c0b0c60 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff01c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/679254111 >> v2:172.21.15.145:3300/0 conn(0x7ff01c1599e0 0x7ff01c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 >> v1:172.21.15.144:6789/0 conn(0x7ff01c0b0c60 legacy=0x7ff01c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff004003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff004004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff004004d90 0x7ff004005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15e200 con 0x7ff004003f90 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c15a100 con 0x7ff004004d90 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400dc20 con 0x7ff01c0ca020 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff004004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.584 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.577+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff004003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01bfff700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff004004d90 0x7ff004005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 -- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 msgr2=0x7ff004003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c0ca020 0x7ff004003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 -- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff004004d90 msgr2=0x7ff004005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff004004d90 0x7ff004005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 -- 172.21.15.144:0/679254111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100094a0 con 0x7ff004003f90 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01affd700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff004004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d30 tx=0x7ff004005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183d8b24fffe8236 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010009e80 con 0x7ff004003f90 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000e9a0 con 0x7ff004003f90 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.578+0000 7ff01a7fc700 1 -- 172.21.15.144:0/679254111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000ed10 con 0x7ff004003f90 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 -- 172.21.15.144:0/679254111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 msgr2=0x7ff004004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 --2- 172.21.15.144:0/679254111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff004004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d30 tx=0x7ff004005880 comp rx=0 tx=0).stop 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff01bfff700 1 -- 172.21.15.144:0/679254111 reap_dead start 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 -- 172.21.15.144:0/679254111 shutdown_connections 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 -- 172.21.15.144:0/679254111 >> 172.21.15.144:0/679254111 conn(0x7ff01c0cb720 msgr2=0x7ff01c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:41.586 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 -- 172.21.15.144:0/679254111 shutdown_connections 2023-05-11T07:36:41.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.579+0000 7ff021bff700 1 -- 172.21.15.144:0/679254111 wait complete. 2023-05-11T07:36:41.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.581+0000 7ff021bff700 1 Processor -- start 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.582+0000 7ff021bff700 1 -- start start 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 0x7ff01c14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 0x7ff01c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c1e3dc0 con 0x7ff004003f90 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c14f430 con 0x7ff01c14ea80 2023-05-11T07:36:41.589 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff021bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c1e31b0 con 0x7ff01c154ad0 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47410/0 (socket says 172.21.15.144:47410) 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 -- 172.21.15.144:0/2277140191 learned_addr learned my addr 172.21.15.144:0/2277140191 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01bfff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 0x7ff01c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01affd700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 0x7ff01c14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 -- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 msgr2=0x7ff01c154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.590 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 0x7ff01c154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 -- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 msgr2=0x7ff01c14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 0x7ff01c14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01b7fe700 1 -- 172.21.15.144:0/2277140191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c15a9a0 con 0x7ff004003f90 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01bfff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 0x7ff01c154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.583+0000 7ff01affd700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 0x7ff01c14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff01b7fe700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011c20 tx=0x7ff00c00f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00fb80 con 0x7ff004003f90 2023-05-11T07:36:41.591 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00fce0 con 0x7ff004003f90 2023-05-11T07:36:41.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c004240 con 0x7ff004003f90 2023-05-11T07:36:41.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c15a6c0 con 0x7ff004003f90 2023-05-11T07:36:41.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.584+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c159db0 con 0x7ff004003f90 2023-05-11T07:36:41.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.585+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c1e40a0 con 0x7ff004003f90 2023-05-11T07:36:41.592 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.586+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff00c0043a0 con 0x7ff004003f90 2023-05-11T07:36:41.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.587+0000 7ff003fff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.587+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff00c089f70 con 0x7ff004003f90 2023-05-11T07:36:41.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.587+0000 7ff01affd700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.593 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.588+0000 7ff01affd700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 0x7ff00806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff01c06ca80 tx=0x7ff010008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:41.594 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.591+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff00c054c50 con 0x7ff004003f90 2023-05-11T07:36:41.789 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.787+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff01c0b1700 con 0x7ff004003f90 2023-05-11T07:36:41.790 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.788+0000 7ff003fff700 1 -- 172.21.15.144:0/2277140191 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff00c022020 con 0x7ff004003f90 2023-05-11T07:36:41.790 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:41.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 msgr2=0x7ff00806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 0x7ff00806d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff01c06ca80 tx=0x7ff010008030 comp rx=0 tx=0).stop 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 msgr2=0x7ff01c06c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011c20 tx=0x7ff00c00f240 comp rx=0 tx=0).stop 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 shutdown_connections 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff01c154ad0 0x7ff01c154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004003f90 0x7ff01c06c040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 --2- 172.21.15.144:0/2277140191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff01c14ea80 0x7ff01c14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:41.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 >> 172.21.15.144:0/2277140191 conn(0x7ff01c0cb720 msgr2=0x7ff01c15d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:41.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 shutdown_connections 2023-05-11T07:36:41.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.790+0000 7ff021bff700 1 -- 172.21.15.144:0/2277140191 wait complete. 2023-05-11T07:36:41.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:41.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.994+0000 7f46779ff700 1 Processor -- start 2023-05-11T07:36:41.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.994+0000 7f46779ff700 1 -- start start 2023-05-11T07:36:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.995+0000 7f46779ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f467015c930 0x7f467015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.995+0000 7f46779ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46700d14c0 0x7f46701604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.995+0000 7f46779ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467015de80 con 0x7f46700cfe00 2023-05-11T07:36:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.995+0000 7f46779ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46700cf640 con 0x7f46700d14c0 2023-05-11T07:36:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.995+0000 7f46779ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467015cd00 con 0x7f467015c930 2023-05-11T07:36:41.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4674f9a700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f46700cfe00 0x7f46700d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56138/0 (socket says 172.21.15.144:56138) 2023-05-11T07:36:41.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4674f9a700 1 -- 172.21.15.144:0/4155561581 learned_addr learned my addr 172.21.15.144:0/4155561581 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:41.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 --2- 172.21.15.144:0/4155561581 >> v2:172.21.15.144:3300/0 conn(0x7f46700d14c0 0x7f46701604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:41.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f467579b700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f467015c930 0x7f467015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4667fff700 1 -- 172.21.15.144:0/4155561581 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947910099 0 0) 0x7f467015de80 con 0x7f46700cfe00 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4667fff700 1 -- 172.21.15.144:0/4155561581 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f465c0035b0 con 0x7f46700cfe00 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 -- 172.21.15.144:0/4155561581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f467015c930 msgr2=0x7f467015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f467015c930 0x7f467015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 -- 172.21.15.144:0/4155561581 >> v1:172.21.15.144:6789/0 conn(0x7f46700cfe00 legacy=0x7f46700d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 -- 172.21.15.144:0/4155561581 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700cd940 con 0x7f46700d14c0 2023-05-11T07:36:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.996+0000 7f4675f9c700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46700d14c0 0x7f46701604b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4668009d90 tx=0x7f466800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c9e8a58a6a464a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f4667fff700 1 -- 172.21.15.144:0/4155561581 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800e070 con 0x7f46700d14c0 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f4667fff700 1 -- 172.21.15.144:0/4155561581 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466800bb20 con 0x7f46700d14c0 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f4667fff700 1 -- 172.21.15.144:0/4155561581 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668012430 con 0x7f46700d14c0 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 -- 172.21.15.144:0/4155561581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46700d14c0 msgr2=0x7f46701604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46700d14c0 0x7f46701604b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4668009d90 tx=0x7f466800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 -- 172.21.15.144:0/4155561581 shutdown_connections 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46700d14c0 0x7f46701604b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 --2- 172.21.15.144:0/4155561581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f467015c930 0x7f467015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 -- 172.21.15.144:0/4155561581 >> 172.21.15.144:0/4155561581 conn(0x7f4670072650 msgr2=0x7f467006acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:42.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 -- 172.21.15.144:0/4155561581 shutdown_connections 2023-05-11T07:36:42.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.997+0000 7f46779ff700 1 -- 172.21.15.144:0/4155561581 wait complete. 2023-05-11T07:36:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.999+0000 7f46779ff700 1 Processor -- start 2023-05-11T07:36:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:41.999+0000 7f46779ff700 1 -- start start 2023-05-11T07:36:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 0x7f467015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46701f2a10 0x7f4670157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4670157ad0 con 0x7f467015c930 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700cb300 con 0x7f46701f2a10 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.000+0000 7f46779ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467015a830 con 0x7f46700d14c0 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47430/0 (socket says 172.21.15.144:47430) 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 -- 172.21.15.144:0/2626633450 learned_addr learned my addr 172.21.15.144:0/2626633450 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f467579b700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 0x7f467015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4675f9c700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46701f2a10 0x7f4670157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 -- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 msgr2=0x7f467015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 0x7f467015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 -- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46701f2a10 msgr2=0x7f4670157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46701f2a10 0x7f4670157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 -- 172.21.15.144:0/2626633450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668009a70 con 0x7f467015c930 2023-05-11T07:36:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f467579b700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 0x7f467015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4674f9a700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f466000c700 tx=0x7f466000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660005d70 con 0x7f467015c930 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600070d0 con 0x7f467015c930 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700cf8e0 con 0x7f467015c930 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.001+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660007460 con 0x7f467015c930 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.002+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46700cdc20 con 0x7f467015c930 2023-05-11T07:36:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.003+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46700cdf00 con 0x7f467015c930 2023-05-11T07:36:42.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.004+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46600075c0 con 0x7f467015c930 2023-05-11T07:36:42.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.005+0000 7f4665ffb700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 0x7f465406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.005+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4660088e60 con 0x7f467015c930 2023-05-11T07:36:42.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.005+0000 7f467579b700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 0x7f465406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.006+0000 7f467579b700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 0x7f465406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46700b3500 tx=0x7f466c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.009+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4660053b50 con 0x7f467015c930 2023-05-11T07:36:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.200+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46700cb520 con 0x7f467015c930 2023-05-11T07:36:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.201+0000 7f4665ffb700 1 -- 172.21.15.144:0/2626633450 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46700cb520 con 0x7f467015c930 2023-05-11T07:36:42.204 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:42.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 msgr2=0x7f465406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 0x7f465406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46700b3500 tx=0x7f466c008040 comp rx=0 tx=0).stop 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 msgr2=0x7f4670157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f466000c700 tx=0x7f466000cac0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 shutdown_connections 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f465406ace0 0x7f465406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f46700d14c0 0x7f467015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f46701f2a10 0x7f4670157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 --2- 172.21.15.144:0/2626633450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467015c930 0x7f4670157590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 >> 172.21.15.144:0/2626633450 conn(0x7f46700cfe00 msgr2=0x7f46700d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 shutdown_connections 2023-05-11T07:36:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.203+0000 7f46779ff700 1 -- 172.21.15.144:0/2626633450 wait complete. 2023-05-11T07:36:42.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:42.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.405+0000 7f9ec29ff700 1 Processor -- start 2023-05-11T07:36:42.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.405+0000 7f9ec29ff700 1 -- start start 2023-05-11T07:36:42.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ec29ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ec29ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9ebc0d02c0 0x7f9ebc0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ec29ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc15cef0 con 0x7f9ebc0b87e0 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ec29ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc0b5a80 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ec29ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc0cdf70 con 0x7f9ebc0d02c0 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ebb7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ebb7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47442/0 (socket says 172.21.15.144:47442) 2023-05-11T07:36:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ebb7fe700 1 -- 172.21.15.144:0/4206547780 learned_addr learned my addr 172.21.15.144:0/4206547780 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.406+0000 7f9ebbfff700 1 --1- 172.21.15.144:0/4206547780 >> v1:172.21.15.144:6789/0 conn(0x7f9ebc0b87e0 0x7f9ebc0b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56146/0 (socket says 172.21.15.144:56146) 2023-05-11T07:36:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ec0f9c700 1 --2- 172.21.15.144:0/4206547780 >> v2:172.21.15.145:3300/0 conn(0x7f9ebc0d02c0 0x7f9ebc0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebb7fe700 1 -- 172.21.15.144:0/4206547780 >> v2:172.21.15.145:3300/0 conn(0x7f9ebc0d02c0 msgr2=0x7f9ebc0d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/4206547780 >> v2:172.21.15.145:3300/0 conn(0x7f9ebc0d02c0 0x7f9ebc0d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebb7fe700 1 -- 172.21.15.144:0/4206547780 >> v1:172.21.15.144:6789/0 conn(0x7f9ebc0b87e0 legacy=0x7f9ebc0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebb7fe700 1 -- 172.21.15.144:0/4206547780 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0cd760 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebaffd700 1 -- 172.21.15.144:0/4206547780 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887186002 0 0) 0x7f9eac001110 con 0x7f9ebc0b87e0 2023-05-11T07:36:42.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/4206547780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0d3010 tx=0x7f9eb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c916654698d114 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebaffd700 1 -- 172.21.15.144:0/4206547780 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000b870 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebaffd700 1 -- 172.21.15.144:0/4206547780 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb000b9d0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.407+0000 7f9ebaffd700 1 -- 172.21.15.144:0/4206547780 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000bd60 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 -- 172.21.15.144:0/4206547780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 msgr2=0x7f9ebc0d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/4206547780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0d3010 tx=0x7f9eb0009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 -- 172.21.15.144:0/4206547780 shutdown_connections 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/4206547780 >> v2:172.21.15.145:3300/0 conn(0x7f9ebc0d02c0 0x7f9ebc0d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/4206547780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc0d2090 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 -- 172.21.15.144:0/4206547780 >> 172.21.15.144:0/4206547780 conn(0x7f9ebc06acf0 msgr2=0x7f9ebc06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 -- 172.21.15.144:0/4206547780 shutdown_connections 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.408+0000 7f9ec29ff700 1 -- 172.21.15.144:0/4206547780 wait complete. 2023-05-11T07:36:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.410+0000 7f9ec29ff700 1 Processor -- start 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.410+0000 7f9ec29ff700 1 -- start start 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 0x7f9ebc0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ebc0d02c0 0x7f9ebc0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0ca1e0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1f2980 con 0x7f9ebc0b87e0 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec29ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0c87b0 con 0x7f9ebc0d02c0 2023-05-11T07:36:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ebbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ebbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47446/0 (socket says 172.21.15.144:47446) 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ebbfff700 1 -- 172.21.15.144:0/3320045364 learned_addr learned my addr 172.21.15.144:0/3320045364 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 0x7f9ebc0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.411+0000 7f9ec0f9c700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ebc0d02c0 0x7f9ebc0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 -- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ebc0d02c0 msgr2=0x7f9ebc0c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ebc0d02c0 0x7f9ebc0c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 -- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 msgr2=0x7f9ebc0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 0x7f9ebc0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 -- 172.21.15.144:0/3320045364 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009550 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 0x7f9ebc0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ebbfff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c750 tx=0x7f9eac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac005cb0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac005e10 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac007310 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc0cd9b0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.412+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc0d2d30 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.420 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.413+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc0cdc90 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.414+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9eac007470 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.415+0000 7f9eb8ff9700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 0x7f9ea806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.416+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9eac088be0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.416+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 0x7f9ea806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.416+0000 7f9ebb7fe700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 0x7f9ea806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0d3010 tx=0x7f9eb0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.420+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9eac053960 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.614+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ebc15cef0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.615+0000 7f9eb8ff9700 1 -- 172.21.15.144:0/3320045364 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f9ebc15cef0 con 0x7f9ebc0b52a0 2023-05-11T07:36:42.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:42.618 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.617+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 msgr2=0x7f9ea806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.617+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 0x7f9ea806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0d3010 tx=0x7f9eb0008030 comp rx=0 tx=0).stop 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.617+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 msgr2=0x7f9ebc1f2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.617+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c750 tx=0x7f9eac00cb10 comp rx=0 tx=0).stop 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 shutdown_connections 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ea806ace0 0x7f9ea806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9ebc0d02c0 0x7f9ebc0c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ebc0b52a0 0x7f9ebc1f2440 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 --2- 172.21.15.144:0/3320045364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ebc0b87e0 0x7f9ebc0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 >> 172.21.15.144:0/3320045364 conn(0x7f9ebc06acf0 msgr2=0x7f9ebc0b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:42.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 shutdown_connections 2023-05-11T07:36:42.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.618+0000 7f9ec29ff700 1 -- 172.21.15.144:0/3320045364 wait complete. 2023-05-11T07:36:42.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:42.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.826+0000 7fe7acbff700 1 Processor -- start 2023-05-11T07:36:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.826+0000 7fe7acbff700 1 -- start start 2023-05-11T07:36:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7acbff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe7a815c940 0x7fe7a8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7acbff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7a80b5fd0 0x7fe7a806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7acbff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80d0e80 con 0x7fe7a80b6420 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7acbff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a8161420 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7acbff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a80cdb00 con 0x7fe7a815c940 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe79ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7a80b5fd0 0x7fe7a806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7a6d9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe7a80b6420 0x7fe7a80d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56150/0 (socket says 172.21.15.144:56150) 2023-05-11T07:36:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.827+0000 7fe7a6d9d700 1 -- 172.21.15.144:0/1835763326 learned_addr learned my addr 172.21.15.144:0/1835763326 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe7a659c700 1 --2- 172.21.15.144:0/1835763326 >> v2:172.21.15.145:3300/0 conn(0x7fe7a815c940 0x7fe7a8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe79ffff700 1 -- 172.21.15.144:0/1835763326 >> v2:172.21.15.145:3300/0 conn(0x7fe7a815c940 msgr2=0x7fe7a8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe79ffff700 1 --2- 172.21.15.144:0/1835763326 >> v2:172.21.15.145:3300/0 conn(0x7fe7a815c940 0x7fe7a8160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe79ffff700 1 -- 172.21.15.144:0/1835763326 >> v1:172.21.15.144:6789/0 conn(0x7fe7a80b6420 legacy=0x7fe7a80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe79ffff700 1 -- 172.21.15.144:0/1835763326 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80cdde0 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe7a5d9b700 1 -- 172.21.15.144:0/1835763326 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602762560 0 0) 0x7fe7a80d0e80 con 0x7fe7a80b6420 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe79ffff700 1 --2- 172.21.15.144:0/1835763326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a806ac40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80d0e50 tx=0x7fe790009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e5a71ea4ea43bf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe7a5d9b700 1 -- 172.21.15.144:0/1835763326 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790011830 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe7a5d9b700 1 -- 172.21.15.144:0/1835763326 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790011990 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.828+0000 7fe7a5d9b700 1 -- 172.21.15.144:0/1835763326 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790011d20 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 -- 172.21.15.144:0/1835763326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a80b5fd0 msgr2=0x7fe7a806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 --2- 172.21.15.144:0/1835763326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a806ac40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80d0e50 tx=0x7fe790009b20 comp rx=0 tx=0).stop 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 -- 172.21.15.144:0/1835763326 shutdown_connections 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 --2- 172.21.15.144:0/1835763326 >> v2:172.21.15.145:3300/0 conn(0x7fe7a815c940 0x7fe7a8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 --2- 172.21.15.144:0/1835763326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a806ac40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 -- 172.21.15.144:0/1835763326 >> 172.21.15.144:0/1835763326 conn(0x7fe7a80d3180 msgr2=0x7fe7a80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 -- 172.21.15.144:0/1835763326 shutdown_connections 2023-05-11T07:36:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.829+0000 7fe7acbff700 1 -- 172.21.15.144:0/1835763326 wait complete. 2023-05-11T07:36:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.831+0000 7fe7acbff700 1 Processor -- start 2023-05-11T07:36:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.831+0000 7fe7acbff700 1 -- start start 2023-05-11T07:36:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a8150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7a80b6420 0x7fe7a815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815fec0 con 0x7fe7a815c940 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815ee20 con 0x7fe7a80b5fd0 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7acbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815f100 con 0x7fe7a80b6420 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a8150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47474/0 (socket says 172.21.15.144:47474) 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 -- 172.21.15.144:0/176042092 learned_addr learned my addr 172.21.15.144:0/176042092 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe79ffff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7a80b6420 0x7fe7a815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 -- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7a80b6420 msgr2=0x7fe7a815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7a80b6420 0x7fe7a815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 -- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7a80b5fd0 msgr2=0x7fe7a8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a8150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.832+0000 7fe7a6d9d700 1 -- 172.21.15.144:0/176042092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900094a0 con 0x7fe7a815c940 2023-05-11T07:36:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe7a6d9d700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0002230 tx=0x7fe7a000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000aac0 con 0x7fe7a815c940 2023-05-11T07:36:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000ac40 con 0x7fe7a815c940 2023-05-11T07:36:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a80d1400 con 0x7fe7a815c940 2023-05-11T07:36:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00070d0 con 0x7fe7a815c940 2023-05-11T07:36:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.833+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a80d1120 con 0x7fe7a815c940 2023-05-11T07:36:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.834+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a815cd10 con 0x7fe7a815c940 2023-05-11T07:36:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.835+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7a0007250 con 0x7fe7a815c940 2023-05-11T07:36:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.836+0000 7fe79effd700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 0x7fe78806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.836+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7a0089590 con 0x7fe7a815c940 2023-05-11T07:36:42.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.836+0000 7fe7a659c700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 0x7fe78806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:42.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.837+0000 7fe7a659c700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 0x7fe78806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe798006b20 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:42.843 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:42.841+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe7a0054310 con 0x7fe7a815c940 2023-05-11T07:36:43.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.033+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7a80744c0 con 0x7fe7a815c940 2023-05-11T07:36:43.036 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.033+0000 7fe79effd700 1 -- 172.21.15.144:0/176042092 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7a0057930 con 0x7fe7a815c940 2023-05-11T07:36:43.036 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 msgr2=0x7fe78806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 0x7fe78806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe798006b20 tx=0x7fe798008040 comp rx=0 tx=0).stop 2023-05-11T07:36:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 msgr2=0x7fe7a80b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0002230 tx=0x7fe7a000cf50 comp rx=0 tx=0).stop 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 shutdown_connections 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe78806ace0 0x7fe78806d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7a815c940 0x7fe7a80b7950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7a80b5fd0 0x7fe7a8150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 --2- 172.21.15.144:0/176042092 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe7a80b6420 0x7fe7a815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 >> 172.21.15.144:0/176042092 conn(0x7fe7a80d3180 msgr2=0x7fe7a80d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 shutdown_connections 2023-05-11T07:36:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.036+0000 7fe7acbff700 1 -- 172.21.15.144:0/176042092 wait complete. 2023-05-11T07:36:43.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:43.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.240+0000 7f5df53ff700 1 Processor -- start 2023-05-11T07:36:43.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.240+0000 7f5df53ff700 1 -- start start 2023-05-11T07:36:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.241+0000 7f5df53ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5df01657a0 0x7f5df0167b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5df53ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00b2940 con 0x7f5df00b24b0 2023-05-11T07:36:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5df53ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00cdae0 con 0x7f5df00b8970 2023-05-11T07:36:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5df53ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00b8d40 con 0x7f5df01657a0 2023-05-11T07:36:43.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5de67fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5df00b24b0 0x7f5df00b5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56160/0 (socket says 172.21.15.144:56160) 2023-05-11T07:36:43.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5de67fc700 1 -- 172.21.15.144:0/999562587 learned_addr learned my addr 172.21.15.144:0/999562587 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:43.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5def7fe700 1 --2- 172.21.15.144:0/999562587 >> v2:172.21.15.145:3300/0 conn(0x7f5df01657a0 0x7f5df0167b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156648156 0 0) 0x7f5dd8001110 con 0x7f5df00b24b0 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc0035b0 con 0x7f5df00b24b0 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831615315 0 0) 0x7f5df00cdae0 con 0x7f5df00b8970 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.242+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd8001110 con 0x7f5df00b8970 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592276703 0 0) 0x7f5ddc0035b0 con 0x7f5df00b24b0 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5def7fe700 1 -- 172.21.15.144:0/999562587 >> v1:172.21.15.145:6789/0 conn(0x7f5df00b8970 legacy=0x7f5df00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5def7fe700 1 -- 172.21.15.144:0/999562587 >> v1:172.21.15.144:6789/0 conn(0x7f5df00b24b0 legacy=0x7f5df00b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5def7fe700 1 -- 172.21.15.144:0/999562587 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b5920 con 0x7f5df01657a0 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5def7fe700 1 --2- 172.21.15.144:0/999562587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df01657a0 0x7f5df0167b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009d90 tx=0x7f5de800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea32b9d1a800b5c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800e070 con 0x7f5df01657a0 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8003a20 con 0x7f5df01657a0 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.243+0000 7f5dee7fc700 1 -- 172.21.15.144:0/999562587 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8001800 con 0x7f5df01657a0 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 -- 172.21.15.144:0/999562587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df01657a0 msgr2=0x7f5df0167b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 --2- 172.21.15.144:0/999562587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df01657a0 0x7f5df0167b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009d90 tx=0x7f5de800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 -- 172.21.15.144:0/999562587 shutdown_connections 2023-05-11T07:36:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 --2- 172.21.15.144:0/999562587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df01657a0 0x7f5df0167b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 -- 172.21.15.144:0/999562587 >> 172.21.15.144:0/999562587 conn(0x7f5df006abd0 msgr2=0x7f5df006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 -- 172.21.15.144:0/999562587 shutdown_connections 2023-05-11T07:36:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.244+0000 7f5df53ff700 1 -- 172.21.15.144:0/999562587 wait complete. 2023-05-11T07:36:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.245+0000 7f5df53ff700 1 Processor -- start 2023-05-11T07:36:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 -- start start 2023-05-11T07:36:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 0x7f5df00c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 0x7f5df00b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b40a0 con 0x7f5df01657a0 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b37d0 con 0x7f5df00b8970 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.246+0000 7f5df53ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00ccdd0 con 0x7f5df00b24b0 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47490/0 (socket says 172.21.15.144:47490) 2023-05-11T07:36:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 -- 172.21.15.144:0/66607601 learned_addr learned my addr 172.21.15.144:0/66607601 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5de67fc700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 0x7f5df00b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5deeffd700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 0x7f5df00c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 -- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 msgr2=0x7f5df00c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 0x7f5df00c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 -- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 msgr2=0x7f5df00b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 0x7f5df00b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 -- 172.21.15.144:0/66607601 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009a70 con 0x7f5df01657a0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5deeffd700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 0x7f5df00c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5de67fc700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 0x7f5df00b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.247+0000 7f5def7fe700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5de8015040 tx=0x7f5de8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.248+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8004600 con 0x7f5df01657a0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.248+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8004760 con 0x7f5df01657a0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.248+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df01612b0 con 0x7f5df01657a0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.248+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8012670 con 0x7f5df01657a0 2023-05-11T07:36:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.248+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0160fd0 con 0x7f5df01657a0 2023-05-11T07:36:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.249+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df00cd770 con 0x7f5df01657a0 2023-05-11T07:36:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.250+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5de80127d0 con 0x7f5df01657a0 2023-05-11T07:36:43.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.251+0000 7f5de7fff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 0x7f5dd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.251+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5de808ae50 con 0x7f5df01657a0 2023-05-11T07:36:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.251+0000 7f5deeffd700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 0x7f5dd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.251+0000 7f5deeffd700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 0x7f5dd006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b7cd0 tx=0x7f5de0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.255+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5de8059650 con 0x7f5df01657a0 2023-05-11T07:36:43.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.447+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5df00b41e0 con 0x7f5df01657a0 2023-05-11T07:36:43.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.447+0000 7f5de7fff700 1 -- 172.21.15.144:0/66607601 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5df00b41e0 con 0x7f5df01657a0 2023-05-11T07:36:43.450 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:43.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.449+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 msgr2=0x7f5dd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.449+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 0x7f5dd006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b7cd0 tx=0x7f5de0009040 comp rx=0 tx=0).stop 2023-05-11T07:36:43.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.449+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 msgr2=0x7f5df00b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.449+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5de8015040 tx=0x7f5de8004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 shutdown_connections 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5dd006ace0 0x7f5dd006d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5df00b24b0 0x7f5df00c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5df01657a0 0x7f5df00b72d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 --2- 172.21.15.144:0/66607601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df00b8970 0x7f5df00b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 >> 172.21.15.144:0/66607601 conn(0x7f5df006abd0 msgr2=0x7f5df00d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:43.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 shutdown_connections 2023-05-11T07:36:43.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.450+0000 7f5df53ff700 1 -- 172.21.15.144:0/66607601 wait complete. 2023-05-11T07:36:43.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:43.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.657+0000 7fe0c61ff700 1 Processor -- start 2023-05-11T07:36:43.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.657+0000 7fe0c61ff700 1 -- start start 2023-05-11T07:36:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0c61ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c0160ee0 0x7fe0c006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0c61ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe0c006b180 0x7fe0c00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0c61ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00d0e80 con 0x7fe0c015c940 2023-05-11T07:36:43.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0c61ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c006b600 con 0x7fe0c0160ee0 2023-05-11T07:36:43.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0c61ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00cdb00 con 0x7fe0c006b180 2023-05-11T07:36:43.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0beffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c0160ee0 0x7fe0c006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0beffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c0160ee0 0x7fe0c006ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47504/0 (socket says 172.21.15.144:47504) 2023-05-11T07:36:43.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0beffd700 1 -- 172.21.15.144:0/474780300 learned_addr learned my addr 172.21.15.144:0/474780300 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:43.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.658+0000 7fe0bffff700 1 --2- 172.21.15.144:0/474780300 >> v2:172.21.15.145:3300/0 conn(0x7fe0c006b180 0x7fe0c00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0beffd700 1 -- 172.21.15.144:0/474780300 >> v2:172.21.15.145:3300/0 conn(0x7fe0c006b180 msgr2=0x7fe0c00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0beffd700 1 --2- 172.21.15.144:0/474780300 >> v2:172.21.15.145:3300/0 conn(0x7fe0c006b180 0x7fe0c00d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0beffd700 1 -- 172.21.15.144:0/474780300 >> v1:172.21.15.145:6789/0 conn(0x7fe0c015c940 legacy=0x7fe0c00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0beffd700 1 -- 172.21.15.144:0/474780300 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00cdde0 con 0x7fe0c0160ee0 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0beffd700 1 --2- 172.21.15.144:0/474780300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c0160ee0 0x7fe0c006ac40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00d3100 tx=0x7fe0b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b522cf072c06cb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0be7fc700 1 -- 172.21.15.144:0/474780300 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4011830 con 0x7fe0c0160ee0 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0be7fc700 1 -- 172.21.15.144:0/474780300 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4011990 con 0x7fe0c0160ee0 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.659+0000 7fe0be7fc700 1 -- 172.21.15.144:0/474780300 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4011d20 con 0x7fe0c0160ee0 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 -- 172.21.15.144:0/474780300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c0160ee0 msgr2=0x7fe0c006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/474780300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c0160ee0 0x7fe0c006ac40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00d3100 tx=0x7fe0b4009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 -- 172.21.15.144:0/474780300 shutdown_connections 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/474780300 >> v2:172.21.15.145:3300/0 conn(0x7fe0c006b180 0x7fe0c00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/474780300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c0160ee0 0x7fe0c006ac40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 -- 172.21.15.144:0/474780300 >> 172.21.15.144:0/474780300 conn(0x7fe0c00d3180 msgr2=0x7fe0c00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:43.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 -- 172.21.15.144:0/474780300 shutdown_connections 2023-05-11T07:36:43.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.660+0000 7fe0c61ff700 1 -- 172.21.15.144:0/474780300 wait complete. 2023-05-11T07:36:43.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.661+0000 7fe0c61ff700 1 Processor -- start 2023-05-11T07:36:43.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 -- start start 2023-05-11T07:36:43.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0c006b180 0x7fe0c01523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe0c0160ee0 0x7fe0c00b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01f1fb0 con 0x7fe0c015c940 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01528e0 con 0x7fe0c006b180 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.662+0000 7fe0c61ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0150d30 con 0x7fe0c0160ee0 2023-05-11T07:36:43.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47518/0 (socket says 172.21.15.144:47518) 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 -- 172.21.15.144:0/90503320 learned_addr learned my addr 172.21.15.144:0/90503320 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0bf7fe700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0c006b180 0x7fe0c01523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0bffff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe0c0160ee0 0x7fe0c00b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 -- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe0c0160ee0 msgr2=0x7fe0c00b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe0c0160ee0 0x7fe0c00b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 -- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0c006b180 msgr2=0x7fe0c01523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0c006b180 0x7fe0c01523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 -- 172.21.15.144:0/90503320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4009550 con 0x7fe0c015c940 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.663+0000 7fe0beffd700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009c10 tx=0x7fe0b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.664+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4004380 con 0x7fe0c015c940 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.664+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b401f070 con 0x7fe0c015c940 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.664+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c00d1400 con 0x7fe0c015c940 2023-05-11T07:36:43.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.664+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40036a0 con 0x7fe0c015c940 2023-05-11T07:36:43.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.664+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c00d1120 con 0x7fe0c015c940 2023-05-11T07:36:43.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.665+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c00b66e0 con 0x7fe0c015c940 2023-05-11T07:36:43.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.666+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0b4021030 con 0x7fe0c015c940 2023-05-11T07:36:43.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.667+0000 7fe0a7fff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:43.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.667+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0b408ad30 con 0x7fe0c015c940 2023-05-11T07:36:43.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.667+0000 7fe0bf7fe700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:43.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.667+0000 7fe0bf7fe700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 0x7fe0ac06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:43.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.671+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe0b4055d10 con 0x7fe0c015c940 2023-05-11T07:36:43.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.867+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0c00744c0 con 0x7fe0c015c940 2023-05-11T07:36:43.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.868+0000 7fe0a7fff700 1 -- 172.21.15.144:0/90503320 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0b4015020 con 0x7fe0c015c940 2023-05-11T07:36:43.877 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 msgr2=0x7fe0ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 0x7fe0ac06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0b0009040 comp rx=0 tx=0).stop 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 msgr2=0x7fe0c014ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009c10 tx=0x7fe0b4004750 comp rx=0 tx=0).stop 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 shutdown_connections 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fe0ac06ace0 0x7fe0ac06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fe0c0160ee0 0x7fe0c00b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0c006b180 0x7fe0c01523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 --2- 172.21.15.144:0/90503320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c015c940 0x7fe0c014ccd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:43.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 >> 172.21.15.144:0/90503320 conn(0x7fe0c00d3180 msgr2=0x7fe0c00d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:43.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 shutdown_connections 2023-05-11T07:36:43.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:43.870+0000 7fe0c61ff700 1 -- 172.21.15.144:0/90503320 wait complete. 2023-05-11T07:36:43.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.078+0000 7f4a3a7ff700 1 Processor -- start 2023-05-11T07:36:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.079+0000 7f4a3a7ff700 1 -- start start 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a3a7ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a341599e0 0x7f4a340c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a3a7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 0x7f4a340b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a3a7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a340b1070 con 0x7f4a340b0c60 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a3a7ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3415e200 con 0x7f4a341599e0 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a3a7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3415a100 con 0x7f4a340ca020 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a33fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a341599e0 0x7f4a340c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a38d9c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a340b0c60 0x7f4a3406c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56162/0 (socket says 172.21.15.144:56162) 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a38d9c700 1 -- 172.21.15.144:0/3364490922 learned_addr learned my addr 172.21.15.144:0/3364490922 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a337fe700 1 --2- 172.21.15.144:0/3364490922 >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 0x7f4a340b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a33fff700 1 -- 172.21.15.144:0/3364490922 >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 msgr2=0x7f4a340b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a33fff700 1 --2- 172.21.15.144:0/3364490922 >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 0x7f4a340b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a33fff700 1 -- 172.21.15.144:0/3364490922 >> v1:172.21.15.144:6789/0 conn(0x7f4a340b0c60 legacy=0x7f4a3406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a33fff700 1 -- 172.21.15.144:0/3364490922 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3415a3e0 con 0x7f4a341599e0 2023-05-11T07:36:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a337fe700 1 --2- 172.21.15.144:0/3364490922 >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 0x7f4a340b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:44.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.080+0000 7f4a32ffd700 1 -- 172.21.15.144:0/3364490922 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297608062 0 0) 0x7f4a340b1070 con 0x7f4a340b0c60 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a33fff700 1 --2- 172.21.15.144:0/3364490922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a341599e0 0x7f4a340c9ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a3406d8a0 tx=0x7f4a24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa58fc89e702fb0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a32ffd700 1 -- 172.21.15.144:0/3364490922 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011830 con 0x7f4a341599e0 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a32ffd700 1 -- 172.21.15.144:0/3364490922 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24011990 con 0x7f4a341599e0 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a32ffd700 1 -- 172.21.15.144:0/3364490922 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011d20 con 0x7f4a341599e0 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/3364490922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a341599e0 msgr2=0x7f4a340c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/3364490922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a341599e0 0x7f4a340c9ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a3406d8a0 tx=0x7f4a24009b20 comp rx=0 tx=0).stop 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/3364490922 shutdown_connections 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/3364490922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a341599e0 0x7f4a340c9ae0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/3364490922 >> v2:172.21.15.145:3300/0 conn(0x7f4a340ca020 0x7f4a340b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.081+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/3364490922 >> 172.21.15.144:0/3364490922 conn(0x7f4a340cb720 msgr2=0x7f4a340cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.082+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/3364490922 shutdown_connections 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.082+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/3364490922 wait complete. 2023-05-11T07:36:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.083+0000 7f4a3a7ff700 1 Processor -- start 2023-05-11T07:36:44.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.083+0000 7f4a3a7ff700 1 -- start start 2023-05-11T07:36:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a340ca020 0x7f4a341575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a341599e0 0x7f4a34157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c37a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c3a80 con 0x7f4a340ca020 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a3a7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340c3d60 con 0x7f4a341599e0 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a33fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a33fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47538/0 (socket says 172.21.15.144:47538) 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.084+0000 7f4a33fff700 1 -- 172.21.15.144:0/1779009527 learned_addr learned my addr 172.21.15.144:0/1779009527 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a337fe700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a340ca020 0x7f4a341575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a38d9c700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a341599e0 0x7f4a34157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 -- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a341599e0 msgr2=0x7f4a34157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a341599e0 0x7f4a34157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 -- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a340ca020 msgr2=0x7f4a341575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a340ca020 0x7f4a341575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 -- 172.21.15.144:0/1779009527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240094a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a33fff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4a24014040 tx=0x7f4a24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.085+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240036a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.086+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2401e070 con 0x7f4a340b0c60 2023-05-11T07:36:44.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.086+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3415a9a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.086+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24003a20 con 0x7f4a340b0c60 2023-05-11T07:36:44.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.086+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3415a6c0 con 0x7f4a340b0c60 2023-05-11T07:36:44.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.087+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a34159db0 con 0x7f4a340b0c60 2023-05-11T07:36:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.087+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a24003b80 con 0x7f4a340b0c60 2023-05-11T07:36:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.089+0000 7f4a30ff9700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.089+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a2408a730 con 0x7f4a340b0c60 2023-05-11T07:36:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.089+0000 7f4a337fe700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.090+0000 7f4a337fe700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c90d0 tx=0x7f4a28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.093+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4a240554a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.283+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a340b1700 con 0x7f4a340b0c60 2023-05-11T07:36:44.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.284+0000 7f4a30ff9700 1 -- 172.21.15.144:0/1779009527 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a240200a0 con 0x7f4a340b0c60 2023-05-11T07:36:44.286 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:44.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 msgr2=0x7f4a2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c90d0 tx=0x7f4a28008040 comp rx=0 tx=0).stop 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 msgr2=0x7f4a341533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4a24014040 tx=0x7f4a24004750 comp rx=0 tx=0).stop 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 shutdown_connections 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a341599e0 0x7f4a34157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b0c60 0x7f4a341533a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 --2- 172.21.15.144:0/1779009527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a340ca020 0x7f4a341575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 >> 172.21.15.144:0/1779009527 conn(0x7f4a340cb720 msgr2=0x7f4a341550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 shutdown_connections 2023-05-11T07:36:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.286+0000 7f4a3a7ff700 1 -- 172.21.15.144:0/1779009527 wait complete. 2023-05-11T07:36:44.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:44.493 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.491+0000 7fd68c9ff700 1 Processor -- start 2023-05-11T07:36:44.494 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.491+0000 7fd68c9ff700 1 -- start start 2023-05-11T07:36:44.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68c9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6881599e0 0x7fd6880c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68c9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd6880b0e30 0x7fd6880ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68c9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68815e200 con 0x7fd6880ca020 2023-05-11T07:36:44.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68c9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68815a100 con 0x7fd6881599e0 2023-05-11T07:36:44.495 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68c9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68815a3e0 con 0x7fd6880b0e30 2023-05-11T07:36:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.492+0000 7fd68659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6881599e0 0x7fd6880c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6881599e0 0x7fd6880c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47540/0 (socket says 172.21.15.144:47540) 2023-05-11T07:36:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 -- 172.21.15.144:0/3947215058 learned_addr learned my addr 172.21.15.144:0/3947215058 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd686d9d700 1 --2- 172.21.15.144:0/3947215058 >> v2:172.21.15.145:3300/0 conn(0x7fd6880b0e30 0x7fd6880ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 -- 172.21.15.144:0/3947215058 >> v2:172.21.15.145:3300/0 conn(0x7fd6880b0e30 msgr2=0x7fd6880ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:44.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 --2- 172.21.15.144:0/3947215058 >> v2:172.21.15.145:3300/0 conn(0x7fd6880b0e30 0x7fd6880ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 -- 172.21.15.144:0/3947215058 >> v1:172.21.15.145:6789/0 conn(0x7fd6880ca020 legacy=0x7fd6880b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 -- 172.21.15.144:0/3947215058 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68815a6c0 con 0x7fd6881599e0 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68659c700 1 --2- 172.21.15.144:0/3947215058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6881599e0 0x7fd6880c9ae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c9270 tx=0x7fd678009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c6b418c7998f8f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.493+0000 7fd68559a700 1 -- 172.21.15.144:0/3947215058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011830 con 0x7fd6881599e0 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68559a700 1 -- 172.21.15.144:0/3947215058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678011990 con 0x7fd6881599e0 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68559a700 1 -- 172.21.15.144:0/3947215058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011d20 con 0x7fd6881599e0 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 -- 172.21.15.144:0/3947215058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6881599e0 msgr2=0x7fd6880c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/3947215058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6881599e0 0x7fd6880c9ae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c9270 tx=0x7fd678009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 -- 172.21.15.144:0/3947215058 shutdown_connections 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/3947215058 >> v2:172.21.15.145:3300/0 conn(0x7fd6880b0e30 0x7fd6880ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/3947215058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6881599e0 0x7fd6880c9ae0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 -- 172.21.15.144:0/3947215058 >> 172.21.15.144:0/3947215058 conn(0x7fd6880cb720 msgr2=0x7fd6880cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 -- 172.21.15.144:0/3947215058 shutdown_connections 2023-05-11T07:36:44.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.494+0000 7fd68c9ff700 1 -- 172.21.15.144:0/3947215058 wait complete. 2023-05-11T07:36:44.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.496+0000 7fd68c9ff700 1 Processor -- start 2023-05-11T07:36:44.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.496+0000 7fd68c9ff700 1 -- start start 2023-05-11T07:36:44.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6880b0e30 0x7fd688150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 0x7fd68814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688150690 con 0x7fd6880ca020 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688148c90 con 0x7fd6880b0e30 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68c9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68814eca0 con 0x7fd6881599e0 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47556/0 (socket says 172.21.15.144:47556) 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 -- 172.21.15.144:0/2971987485 learned_addr learned my addr 172.21.15.144:0/2971987485 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:44.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd686d9d700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 0x7fd68814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd68659c700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6880b0e30 0x7fd688150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 -- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 msgr2=0x7fd68814d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 0x7fd68814d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 -- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6880b0e30 msgr2=0x7fd688150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6880b0e30 0x7fd688150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.497+0000 7fd685d9b700 1 -- 172.21.15.144:0/2971987485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009550 con 0x7fd6880ca020 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd686d9d700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 0x7fd68814d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:44.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd685d9b700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c4e0 tx=0x7fd67c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0052d0 con 0x7fd6880ca020 2023-05-11T07:36:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c005430 con 0x7fd6880ca020 2023-05-11T07:36:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688159db0 con 0x7fd6880ca020 2023-05-11T07:36:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0038c0 con 0x7fd6880ca020 2023-05-11T07:36:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.498+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68815a9a0 con 0x7fd6880ca020 2023-05-11T07:36:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.499+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880cd420 con 0x7fd6880ca020 2023-05-11T07:36:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.500+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd67c003a20 con 0x7fd6880ca020 2023-05-11T07:36:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.501+0000 7fd676ffd700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.501+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd67c088c50 con 0x7fd6880ca020 2023-05-11T07:36:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.501+0000 7fd68659c700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.502+0000 7fd68659c700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 0x7fd66806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd678000c00 tx=0x7fd678008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.505+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd67c08e020 con 0x7fd6880ca020 2023-05-11T07:36:44.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.701+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd6880b1700 con 0x7fd6880ca020 2023-05-11T07:36:44.704 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.702+0000 7fd676ffd700 1 -- 172.21.15.144:0/2971987485 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd67c017020 con 0x7fd6880ca020 2023-05-11T07:36:44.705 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:44.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 msgr2=0x7fd66806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 0x7fd66806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd678000c00 tx=0x7fd678008030 comp rx=0 tx=0).stop 2023-05-11T07:36:44.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 msgr2=0x7fd68814cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c4e0 tx=0x7fd67c00c7f0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 shutdown_connections 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd6881599e0 0x7fd68814d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6880b0e30 0x7fd688150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 --2- 172.21.15.144:0/2971987485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6880ca020 0x7fd68814cfd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 >> 172.21.15.144:0/2971987485 conn(0x7fd6880cb720 msgr2=0x7fd688071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 shutdown_connections 2023-05-11T07:36:44.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.704+0000 7fd68c9ff700 1 -- 172.21.15.144:0/2971987485 wait complete. 2023-05-11T07:36:44.742 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-11T07:36:44.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-11T07:36:44.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.924+0000 7f9e6fdff700 1 Processor -- start 2023-05-11T07:36:44.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.925+0000 7f9e6fdff700 1 -- start start 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6fdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806a2d0 0x7f9e6806a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6fdff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9e6806b7a0 0x7f9e6806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6fdff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6806ac60 con 0x7f9e6815a750 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6fdff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6806cfe0 con 0x7f9e6806b7a0 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6fdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6815ab20 con 0x7f9e6806a2d0 2023-05-11T07:36:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9e6806b7a0 0x7f9e6806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6db9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9e6815a750 0x7f9e68071bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56178/0 (socket says 172.21.15.144:56178) 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9e6806b7a0 0x7f9e6806bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47558/0 (socket says 172.21.15.144:47558) 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6db9b700 1 -- 172.21.15.144:0/1191433500 learned_addr learned my addr 172.21.15.144:0/1191433500 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6d39a700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806a2d0 0x7f9e6806a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 -- 172.21.15.144:0/1191433500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806a2d0 msgr2=0x7f9e6806a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:44.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806a2d0 0x7f9e6806a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 -- 172.21.15.144:0/1191433500 >> v1:172.21.15.144:6789/0 conn(0x7f9e6815a750 legacy=0x7f9e68071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6e39c700 1 -- 172.21.15.144:0/1191433500 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68071740 con 0x7f9e6806b7a0 2023-05-11T07:36:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.926+0000 7f9e6cb99700 1 -- 172.21.15.144:0/1191433500 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173446883 0 0) 0x7f9e64001110 con 0x7f9e6815a750 2023-05-11T07:36:44.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6e39c700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6806b7a0 0x7f9e6806bc00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009d90 tx=0x7f9e6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc04e90b5caf0de0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6cb99700 1 -- 172.21.15.144:0/1191433500 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000e070 con 0x7f9e6806b7a0 2023-05-11T07:36:44.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6cb99700 1 -- 172.21.15.144:0/1191433500 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000bbd0 con 0x7f9e6806b7a0 2023-05-11T07:36:44.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6cb99700 1 -- 172.21.15.144:0/1191433500 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60012430 con 0x7f9e6806b7a0 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6fdff700 1 -- 172.21.15.144:0/1191433500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6806b7a0 msgr2=0x7f9e6806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.927+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6806b7a0 0x7f9e6806bc00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009d90 tx=0x7f9e6000b330 comp rx=0 tx=0).stop 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 -- 172.21.15.144:0/1191433500 shutdown_connections 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6806b7a0 0x7f9e6806bc00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/1191433500 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806a2d0 0x7f9e6806a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 -- 172.21.15.144:0/1191433500 >> 172.21.15.144:0/1191433500 conn(0x7f9e680cb7e0 msgr2=0x7f9e680cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:44.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 -- 172.21.15.144:0/1191433500 shutdown_connections 2023-05-11T07:36:44.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.928+0000 7f9e6fdff700 1 -- 172.21.15.144:0/1191433500 wait complete. 2023-05-11T07:36:44.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.929+0000 7f9e6fdff700 1 Processor -- start 2023-05-11T07:36:44.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.930+0000 7f9e6fdff700 1 -- start start 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.930+0000 7f9e6fdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e6806a2d0 0x7f9e68151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.930+0000 7f9e6fdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806b7a0 0x7f9e6814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.930+0000 7f9e6fdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6fdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6814dac0 con 0x7f9e6815a750 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6fdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680c3d10 con 0x7f9e6806a2d0 2023-05-11T07:36:44.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6fdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680c3ff0 con 0x7f9e6806b7a0 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47574/0 (socket says 172.21.15.144:47574) 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 -- 172.21.15.144:0/2282735627 learned_addr learned my addr 172.21.15.144:0/2282735627 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6db9b700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e6806a2d0 0x7f9e68151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6d39a700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806b7a0 0x7f9e6814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 -- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806b7a0 msgr2=0x7f9e6814cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806b7a0 0x7f9e6814cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 -- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e6806a2d0 msgr2=0x7f9e68151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e6806a2d0 0x7f9e68151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 -- 172.21.15.144:0/2282735627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60009a70 con 0x7f9e6815a750 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.931+0000 7f9e6e39c700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e68072680 tx=0x7f9e60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.932+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60012430 con 0x7f9e6815a750 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.932+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60020070 con 0x7f9e6815a750 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.932+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60004280 con 0x7f9e6815a750 2023-05-11T07:36:44.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.932+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6806c420 con 0x7f9e6815a750 2023-05-11T07:36:44.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.932+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e68071160 con 0x7f9e6815a750 2023-05-11T07:36:44.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.933+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e680713d0 con 0x7f9e6815a750 2023-05-11T07:36:44.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.934+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e600043e0 con 0x7f9e6815a750 2023-05-11T07:36:44.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.934+0000 7f9e5e7fc700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 0x7f9e4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:44.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.935+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9e60022070 con 0x7f9e6815a750 2023-05-11T07:36:44.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.935+0000 7f9e6db9b700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 0x7f9e4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:44.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.935+0000 7f9e6db9b700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 0x7f9e4c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000f60 tx=0x7f9e64007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:44.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:44.939+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9e600565e0 con 0x7f9e6815a750 2023-05-11T07:36:45.213 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.210+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9e680c39c0 con 0x7f9e6815a750 2023-05-11T07:36:45.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.557+0000 7f9e5e7fc700 1 -- 172.21.15.144:0/2282735627 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v84) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9e60059c00 con 0x7f9e6815a750 2023-05-11T07:36:45.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 msgr2=0x7f9e4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 0x7f9e4c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000f60 tx=0x7f9e64007e70 comp rx=0 tx=0).stop 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 msgr2=0x7f9e680b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e68072680 tx=0x7f9e60004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 shutdown_connections 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9e4c06ace0 0x7f9e4c06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6815a750 0x7f9e680b22f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e6806a2d0 0x7f9e68151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 --2- 172.21.15.144:0/2282735627 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9e6806b7a0 0x7f9e6814cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 >> 172.21.15.144:0/2282735627 conn(0x7f9e680cb7e0 msgr2=0x7f9e6815bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 shutdown_connections 2023-05-11T07:36:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.560+0000 7f9e6fdff700 1 -- 172.21.15.144:0/2282735627 wait complete. 2023-05-11T07:36:45.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-11T07:36:45.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.765+0000 7f86cadff700 1 Processor -- start 2023-05-11T07:36:45.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.766+0000 7f86cadff700 1 -- start start 2023-05-11T07:36:45.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 0x7f86c4160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86c40b5fd0 0x7f86c406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 0x7f86c406b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c4161420 con 0x7f86c40b5fd0 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40d0e80 con 0x7f86c415c940 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86cadff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40cdb00 con 0x7f86c40b6420 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86c40b5fd0 0x7f86c406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86c40b5fd0 0x7f86c406ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47576/0 (socket says 172.21.15.144:47576) 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 -- 172.21.15.144:0/143757482 learned_addr learned my addr 172.21.15.144:0/143757482 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c939c700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 0x7f86c406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c8b9b700 1 --2- 172.21.15.144:0/143757482 >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 0x7f86c4160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 -- 172.21.15.144:0/143757482 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 msgr2=0x7f86c406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 0x7f86c406b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 -- 172.21.15.144:0/143757482 >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 msgr2=0x7f86c4160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 --2- 172.21.15.144:0/143757482 >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 0x7f86c4160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c3fff700 1 -- 172.21.15.144:0/143757482 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40cdde0 con 0x7f86c40b5fd0 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c939c700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 0x7f86c406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:45.772 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.767+0000 7f86c8b9b700 1 --2- 172.21.15.144:0/143757482 >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 0x7f86c4160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86c3fff700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c40b5fd0 0x7f86c406ac40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86c40d0e50 tx=0x7f86b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ea711181a14fcd server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86c37fe700 1 -- 172.21.15.144:0/143757482 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000b870 con 0x7f86c40b5fd0 2023-05-11T07:36:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86c37fe700 1 -- 172.21.15.144:0/143757482 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000b9d0 con 0x7f86c40b5fd0 2023-05-11T07:36:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86c37fe700 1 -- 172.21.15.144:0/143757482 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000bd60 con 0x7f86c40b5fd0 2023-05-11T07:36:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86cadff700 1 -- 172.21.15.144:0/143757482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c40b5fd0 msgr2=0x7f86c406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86cadff700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c40b5fd0 0x7f86c406ac40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86c40d0e50 tx=0x7f86b0009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86cadff700 1 -- 172.21.15.144:0/143757482 shutdown_connections 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86cadff700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b6420 0x7f86c406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.768+0000 7f86cadff700 1 --2- 172.21.15.144:0/143757482 >> v2:172.21.15.145:3300/0 conn(0x7f86c415c940 0x7f86c4160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.769+0000 7f86cadff700 1 --2- 172.21.15.144:0/143757482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c40b5fd0 0x7f86c406ac40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.769+0000 7f86cadff700 1 -- 172.21.15.144:0/143757482 >> 172.21.15.144:0/143757482 conn(0x7f86c40d3180 msgr2=0x7f86c40d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.769+0000 7f86cadff700 1 -- 172.21.15.144:0/143757482 shutdown_connections 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.769+0000 7f86cadff700 1 -- 172.21.15.144:0/143757482 wait complete. 2023-05-11T07:36:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.770+0000 7f86cadff700 1 Processor -- start 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.770+0000 7f86cadff700 1 -- start start 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b5fd0 0x7f86c41f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86c40b6420 0x7f86c415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41f3120 con 0x7f86c415c940 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40b5b30 con 0x7f86c40b6420 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.771+0000 7f86cadff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41f2620 con 0x7f86c40b5fd0 2023-05-11T07:36:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47588/0 (socket says 172.21.15.144:47588) 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 -- 172.21.15.144:0/2133194398 learned_addr learned my addr 172.21.15.144:0/2133194398 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c8b9b700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b5fd0 0x7f86c41f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c3fff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86c40b6420 0x7f86c415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 -- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b5fd0 msgr2=0x7f86c41f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b5fd0 0x7f86c41f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 -- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86c40b6420 msgr2=0x7f86c415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86c40b6420 0x7f86c415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 -- 172.21.15.144:0/2133194398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009550 con 0x7f86c415c940 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.772+0000 7f86c939c700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00cef0 tx=0x7f86bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.773+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00add0 con 0x7f86c415c940 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.773+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc015440 con 0x7f86c415c940 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.773+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40d1400 con 0x7f86c415c940 2023-05-11T07:36:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.773+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0157f0 con 0x7f86c415c940 2023-05-11T07:36:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.773+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c40d1120 con 0x7f86c415c940 2023-05-11T07:36:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.774+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c415cd10 con 0x7f86c415c940 2023-05-11T07:36:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.775+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86bc00d430 con 0x7f86c415c940 2023-05-11T07:36:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.776+0000 7f86c17fa700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 0x7f86a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.776+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86bc089db0 con 0x7f86c415c940 2023-05-11T07:36:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.776+0000 7f86c8b9b700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 0x7f86a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.777+0000 7f86c8b9b700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 0x7f86a806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006fd0 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:45.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.780+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f86bc08e070 con 0x7f86c415c940 2023-05-11T07:36:45.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.976+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f86c4160920 con 0x7f86c415c940 2023-05-11T07:36:45.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.980+0000 7f86c17fa700 1 -- 172.21.15.144:0/2133194398 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86bc01a0c0 con 0x7f86c415c940 2023-05-11T07:36:45.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 msgr2=0x7f86a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 0x7f86a806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006fd0 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 msgr2=0x7f86c415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00cef0 tx=0x7f86bc00a340 comp rx=0 tx=0).stop 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 shutdown_connections 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f86a806ace0 0x7f86a806d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f86c40b5fd0 0x7f86c41f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c415c940 0x7f86c415ac40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 --2- 172.21.15.144:0/2133194398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86c40b6420 0x7f86c415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 >> 172.21.15.144:0/2133194398 conn(0x7f86c40d3180 msgr2=0x7f86c40d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 shutdown_connections 2023-05-11T07:36:45.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:45.983+0000 7f86cadff700 1 -- 172.21.15.144:0/2133194398 wait complete. 2023-05-11T07:36:46.002 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-11T07:36:46.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-11T07:36:46.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-11T07:36:46.189 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-11T07:36:46.190 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:46.190 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:46.232 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:46.233 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:46.313 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:46.314 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:46.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:46.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.618+0000 7f07565ff700 1 Processor -- start 2023-05-11T07:36:46.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.618+0000 7f07565ff700 1 -- start start 2023-05-11T07:36:46.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.619+0000 7f07565ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f075006af50 0x7f075006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.619+0000 7f07565ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 0x7f0750070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.619+0000 7f07565ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500cb2b0 con 0x7f0750158be0 2023-05-11T07:36:46.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.619+0000 7f07565ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500c9790 con 0x7f075006af50 2023-05-11T07:36:46.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.619+0000 7f07565ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075015d3c0 con 0x7f075006bce0 2023-05-11T07:36:46.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f074ffff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0750158be0 0x7f07500ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58736/0 (socket says 172.21.15.144:58736) 2023-05-11T07:36:46.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f074ffff700 1 -- 172.21.15.144:0/3013883898 learned_addr learned my addr 172.21.15.144:0/3013883898 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:46.623 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0747fff700 1 --2- 172.21.15.144:0/3013883898 >> v2:172.21.15.144:3300/0 conn(0x7f075006af50 0x7f075006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.624 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0754b9c700 1 --2- 172.21.15.144:0/3013883898 >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 0x7f0750070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f074f7fe700 1 -- 172.21.15.144:0/3013883898 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491986930 0 0) 0x7f07500cb2b0 con 0x7f0750158be0 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f074f7fe700 1 -- 172.21.15.144:0/3013883898 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f073c0035b0 con 0x7f0750158be0 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0747fff700 1 -- 172.21.15.144:0/3013883898 >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 msgr2=0x7f0750070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0747fff700 1 --2- 172.21.15.144:0/3013883898 >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 0x7f0750070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0747fff700 1 -- 172.21.15.144:0/3013883898 >> v1:172.21.15.144:6789/0 conn(0x7f0750158be0 legacy=0x7f07500ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0747fff700 1 -- 172.21.15.144:0/3013883898 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075015d6a0 con 0x7f075006af50 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.620+0000 7f0754b9c700 1 --2- 172.21.15.144:0/3013883898 >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 0x7f0750070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f0747fff700 1 --2- 172.21.15.144:0/3013883898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006af50 0x7f075006b7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07500c2830 tx=0x7f0738009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708895456bdf7244 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f074f7fe700 1 -- 172.21.15.144:0/3013883898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738011830 con 0x7f075006af50 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f074f7fe700 1 -- 172.21.15.144:0/3013883898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738011990 con 0x7f075006af50 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f074f7fe700 1 -- 172.21.15.144:0/3013883898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738011d20 con 0x7f075006af50 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 -- 172.21.15.144:0/3013883898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006af50 msgr2=0x7f075006b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 --2- 172.21.15.144:0/3013883898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006af50 0x7f075006b7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07500c2830 tx=0x7f0738009b20 comp rx=0 tx=0).stop 2023-05-11T07:36:46.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 -- 172.21.15.144:0/3013883898 shutdown_connections 2023-05-11T07:36:46.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 --2- 172.21.15.144:0/3013883898 >> v2:172.21.15.145:3300/0 conn(0x7f075006bce0 0x7f0750070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 --2- 172.21.15.144:0/3013883898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006af50 0x7f075006b7a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 -- 172.21.15.144:0/3013883898 >> 172.21.15.144:0/3013883898 conn(0x7f07500cb7e0 msgr2=0x7f07500cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:46.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.621+0000 7f07565ff700 1 -- 172.21.15.144:0/3013883898 shutdown_connections 2023-05-11T07:36:46.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.622+0000 7f07565ff700 1 -- 172.21.15.144:0/3013883898 wait complete. 2023-05-11T07:36:46.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.623+0000 7f07565ff700 1 Processor -- start 2023-05-11T07:36:46.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.623+0000 7f07565ff700 1 -- start start 2023-05-11T07:36:46.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 0x7f07501e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.629 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 0x7f07500c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b4ab0 con 0x7f075006bce0 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500c5740 con 0x7f0750158be0 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f07565ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500c4ea0 con 0x7f075006af50 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f0747fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f0747fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34774/0 (socket says 172.21.15.144:34774) 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.624+0000 7f0747fff700 1 -- 172.21.15.144:0/3783587192 learned_addr learned my addr 172.21.15.144:0/3783587192 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:46.630 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f074ffff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 0x7f07501e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0754b9c700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 0x7f07500c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 -- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 msgr2=0x7f07501e2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 0x7f07501e2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 -- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 msgr2=0x7f07500c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 0x7f07500c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 -- 172.21.15.144:0/3783587192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380094a0 con 0x7f075006bce0 2023-05-11T07:36:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0754b9c700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 0x7f07500c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f074ffff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 0x7f07501e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f0747fff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07380090b0 tx=0x7f0738004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380036a0 con 0x7f075006bce0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073801e070 con 0x7f075006bce0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07500caea0 con 0x7f075006bce0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738003a60 con 0x7f075006bce0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.625+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07500c93b0 con 0x7f075006bce0 2023-05-11T07:36:46.632 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.626+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07500cb030 con 0x7f075006bce0 2023-05-11T07:36:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.627+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0738003bc0 con 0x7f075006bce0 2023-05-11T07:36:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.628+0000 7f074d7fa700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 0x7f073006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.628+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f073808a840 con 0x7f075006bce0 2023-05-11T07:36:46.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.629+0000 7f074ffff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 0x7f073006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:46.634 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.629+0000 7f074ffff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 0x7f073006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07400011e0 tx=0x7f0740009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:46.635 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.633+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f07380555b0 con 0x7f075006bce0 2023-05-11T07:36:46.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.826+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0750074530 con 0x7f075006bce0 2023-05-11T07:36:46.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.828+0000 7f074d7fa700 1 -- 172.21.15.144:0/3783587192 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f0738058bd0 con 0x7f075006bce0 2023-05-11T07:36:46.831 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:46.831 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 msgr2=0x7f073006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 0x7f073006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07400011e0 tx=0x7f0740009040 comp rx=0 tx=0).stop 2023-05-11T07:36:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 msgr2=0x7f07500c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07380090b0 tx=0x7f0738004750 comp rx=0 tx=0).stop 2023-05-11T07:36:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 shutdown_connections 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f073006ace0 0x7f073006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f075006af50 0x7f07501e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0750158be0 0x7f07500c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 --2- 172.21.15.144:0/3783587192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f075006bce0 0x7f07500c2f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 >> 172.21.15.144:0/3783587192 conn(0x7f07500cb7e0 msgr2=0x7f07500ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 shutdown_connections 2023-05-11T07:36:46.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:46.830+0000 7f07565ff700 1 -- 172.21.15.144:0/3783587192 wait complete. 2023-05-11T07:36:46.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:46.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.040+0000 7fd74bbff700 1 Processor -- start 2023-05-11T07:36:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.040+0000 7fd74bbff700 1 -- start start 2023-05-11T07:36:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74bbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd7440b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74bbff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 0x7fd7440cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74bbff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7440b21e0 con 0x7fd74406b3e0 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74bbff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7440b24c0 con 0x7fd7440cf560 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74bbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440cea80 con 0x7fd7440b16e0 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74999b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd74406b3e0 0x7fd74406b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58752/0 (socket says 172.21.15.144:58752) 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74999b700 1 -- 172.21.15.144:0/862753391 learned_addr learned my addr 172.21.15.144:0/862753391 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74919a700 1 --2- 172.21.15.144:0/862753391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd7440b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd74a19c700 1 --2- 172.21.15.144:0/862753391 >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 0x7fd7440cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd748999700 1 -- 172.21.15.144:0/862753391 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8835862 0 0) 0x7fd7440b21e0 con 0x7fd74406b3e0 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.042+0000 7fd748999700 1 -- 172.21.15.144:0/862753391 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7300035b0 con 0x7fd74406b3e0 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74919a700 1 -- 172.21.15.144:0/862753391 >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 msgr2=0x7fd7440cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74919a700 1 --2- 172.21.15.144:0/862753391 >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 0x7fd7440cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74919a700 1 -- 172.21.15.144:0/862753391 >> v1:172.21.15.144:6789/0 conn(0x7fd74406b3e0 legacy=0x7fd74406b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74919a700 1 -- 172.21.15.144:0/862753391 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440ced60 con 0x7fd7440b16e0 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74a19c700 1 --2- 172.21.15.144:0/862753391 >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 0x7fd7440cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd74919a700 1 --2- 172.21.15.144:0/862753391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd7440b1b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd734009840 tx=0x7fd734009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fea82333a6c6cf7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd748999700 1 -- 172.21.15.144:0/862753391 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011830 con 0x7fd7440b16e0 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd748999700 1 -- 172.21.15.144:0/862753391 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734011990 con 0x7fd7440b16e0 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.043+0000 7fd748999700 1 -- 172.21.15.144:0/862753391 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011d20 con 0x7fd7440b16e0 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 -- 172.21.15.144:0/862753391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 msgr2=0x7fd7440b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 --2- 172.21.15.144:0/862753391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd7440b1b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd734009840 tx=0x7fd734009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:47.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 -- 172.21.15.144:0/862753391 shutdown_connections 2023-05-11T07:36:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 --2- 172.21.15.144:0/862753391 >> v2:172.21.15.145:3300/0 conn(0x7fd7440cf560 0x7fd7440cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 --2- 172.21.15.144:0/862753391 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd7440b1b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 -- 172.21.15.144:0/862753391 >> 172.21.15.144:0/862753391 conn(0x7fd74409a230 msgr2=0x7fd7440d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 -- 172.21.15.144:0/862753391 shutdown_connections 2023-05-11T07:36:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.044+0000 7fd74bbff700 1 -- 172.21.15.144:0/862753391 wait complete. 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.045+0000 7fd74bbff700 1 Processor -- start 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.046+0000 7fd74bbff700 1 -- start start 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd74406b3e0 0x7fd74414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd744159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74415ac60 con 0x7fd7440cf560 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74415a6a0 con 0x7fd74406b3e0 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74bbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7441e4250 con 0x7fd7440b16e0 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34790/0 (socket says 172.21.15.144:34790) 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 -- 172.21.15.144:0/388618491 learned_addr learned my addr 172.21.15.144:0/388618491 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74999b700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd74406b3e0 0x7fd74414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74919a700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd744159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 -- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 msgr2=0x7fd744159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd744159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 -- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd74406b3e0 msgr2=0x7fd74414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd74406b3e0 0x7fd74414bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 -- 172.21.15.144:0/388618491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c009a70 con 0x7fd7440cf560 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.047+0000 7fd74a19c700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00efc0 tx=0x7fd73c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.048+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00ca90 con 0x7fd7440cf560 2023-05-11T07:36:47.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.048+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c00f040 con 0x7fd7440cf560 2023-05-11T07:36:47.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.048+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7340094a0 con 0x7fd7440cf560 2023-05-11T07:36:47.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.048+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00ce10 con 0x7fd7440cf560 2023-05-11T07:36:47.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.048+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7440b0a00 con 0x7fd7440cf560 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.049+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7440cf040 con 0x7fd7440cf560 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.050+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd73c014480 con 0x7fd7440cf560 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.051+0000 7fd73a7fc700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 0x7fd72806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.051+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd73c089e00 con 0x7fd7440cf560 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.051+0000 7fd74999b700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 0x7fd72806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.052+0000 7fd74999b700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 0x7fd72806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7400010e0 tx=0x7fd740007c70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.055+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd73c058600 con 0x7fd7440cf560 2023-05-11T07:36:47.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.247+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7440b2790 con 0x7fd7440cf560 2023-05-11T07:36:47.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.247+0000 7fd73a7fc700 1 -- 172.21.15.144:0/388618491 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd73c009d70 con 0x7fd7440cf560 2023-05-11T07:36:47.250 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:47.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 msgr2=0x7fd72806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 0x7fd72806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7400010e0 tx=0x7fd740007c70 comp rx=0 tx=0).stop 2023-05-11T07:36:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 msgr2=0x7fd74415a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00efc0 tx=0x7fd73c00c3a0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 shutdown_connections 2023-05-11T07:36:47.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd72806ace0 0x7fd72806d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7440cf560 0x7fd74415a160 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd74406b3e0 0x7fd74414bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 --2- 172.21.15.144:0/388618491 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd7440b16e0 0x7fd744159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 >> 172.21.15.144:0/388618491 conn(0x7fd74409a230 msgr2=0x7fd74406f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:47.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 shutdown_connections 2023-05-11T07:36:47.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.250+0000 7fd74bbff700 1 -- 172.21.15.144:0/388618491 wait complete. 2023-05-11T07:36:47.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:47.456 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.453+0000 7fa0dd1ff700 1 Processor -- start 2023-05-11T07:36:47.456 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.454+0000 7fa0dd1ff700 1 -- start start 2023-05-11T07:36:47.457 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0dd1ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0d815e530 0x7fa0d80b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.457 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0dd1ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d806b750 con 0x7fa0d80c92f0 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0dd1ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d815eaa0 con 0x7fa0d815aaf0 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0dd1ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d815aec0 con 0x7fa0d815e530 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0d815e530 0x7fa0d80b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d759e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa0d80c92f0 0x7fa0d806bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58766/0 (socket says 172.21.15.144:58766) 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0d815e530 0x7fa0d80b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34796/0 (socket says 172.21.15.144:34796) 2023-05-11T07:36:47.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d759e700 1 -- 172.21.15.144:0/653034470 learned_addr learned my addr 172.21.15.144:0/653034470 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:47.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d659c700 1 -- 172.21.15.144:0/653034470 >> v1:172.21.15.145:6789/0 conn(0x7fa0d815aaf0 legacy=0x7fa0d80b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d659c700 1 -- 172.21.15.144:0/653034470 >> v1:172.21.15.144:6789/0 conn(0x7fa0d80c92f0 legacy=0x7fa0d806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.455+0000 7fa0d659c700 1 -- 172.21.15.144:0/653034470 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d815ed80 con 0x7fa0d815e530 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0d659c700 1 --2- 172.21.15.144:0/653034470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80b42c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009870 tx=0x7fa0cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a653c82f73aae408 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0d5d9b700 1 -- 172.21.15.144:0/653034470 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011830 con 0x7fa0d815e530 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0d5d9b700 1 -- 172.21.15.144:0/653034470 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc011990 con 0x7fa0d815e530 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0d5d9b700 1 -- 172.21.15.144:0/653034470 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011d20 con 0x7fa0d815e530 2023-05-11T07:36:47.460 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/653034470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 msgr2=0x7fa0d80b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.456+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/653034470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80b42c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009870 tx=0x7fa0cc009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.457+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/653034470 shutdown_connections 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.457+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/653034470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80b42c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.457+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/653034470 >> 172.21.15.144:0/653034470 conn(0x7fa0d80cb720 msgr2=0x7fa0d80cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.457+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/653034470 shutdown_connections 2023-05-11T07:36:47.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.457+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/653034470 wait complete. 2023-05-11T07:36:47.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.458+0000 7fa0dd1ff700 1 Processor -- start 2023-05-11T07:36:47.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.458+0000 7fa0dd1ff700 1 -- start start 2023-05-11T07:36:47.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0d80c92f0 0x7fa0d8159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0d815aaf0 0x7fa0d81f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815a3a0 con 0x7fa0d815e530 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d81f3c50 con 0x7fa0d80c92f0 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0dd1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d81f3620 con 0x7fa0d815aaf0 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.459+0000 7fa0d759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34812/0 (socket says 172.21.15.144:34812) 2023-05-11T07:36:47.464 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 -- 172.21.15.144:0/3955657999 learned_addr learned my addr 172.21.15.144:0/3955657999 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d659c700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0d815aaf0 0x7fa0d81f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d6d9d700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0d80c92f0 0x7fa0d8159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 -- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0d815aaf0 msgr2=0x7fa0d81f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0d815aaf0 0x7fa0d81f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 -- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0d80c92f0 msgr2=0x7fa0d8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0d80c92f0 0x7fa0d8159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 -- 172.21.15.144:0/3955657999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0094a0 con 0x7fa0d815e530 2023-05-11T07:36:47.465 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0d759e700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000cbc0 tx=0x7fa0d000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000ab50 con 0x7fa0d815e530 2023-05-11T07:36:47.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d000acb0 con 0x7fa0d815e530 2023-05-11T07:36:47.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0012600 con 0x7fa0d815e530 2023-05-11T07:36:47.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.460+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d815f340 con 0x7fa0d815e530 2023-05-11T07:36:47.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.461+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d815f060 con 0x7fa0d815e530 2023-05-11T07:36:47.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.462+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d80b4800 con 0x7fa0d815e530 2023-05-11T07:36:47.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.462+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0d001b3b0 con 0x7fa0d815e530 2023-05-11T07:36:47.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.463+0000 7fa0bf7fe700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 0x7fa0c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.463+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0d0089390 con 0x7fa0d815e530 2023-05-11T07:36:47.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.463+0000 7fa0d6d9d700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 0x7fa0c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.464+0000 7fa0d6d9d700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 0x7fa0c406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80c6390 tx=0x7fa0c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.467+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa0d0054250 con 0x7fa0d815e530 2023-05-11T07:36:47.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.660+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0d81f3dc0 con 0x7fa0d815e530 2023-05-11T07:36:47.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.661+0000 7fa0bf7fe700 1 -- 172.21.15.144:0/3955657999 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0d0057870 con 0x7fa0d815e530 2023-05-11T07:36:47.664 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 msgr2=0x7fa0c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 0x7fa0c406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80c6390 tx=0x7fa0c8009040 comp rx=0 tx=0).stop 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 msgr2=0x7fa0d80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000cbc0 tx=0x7fa0d000cf80 comp rx=0 tx=0).stop 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 shutdown_connections 2023-05-11T07:36:47.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa0c406ace0 0x7fa0c406d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d815e530 0x7fa0d80cec20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0d80c92f0 0x7fa0d8159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 --2- 172.21.15.144:0/3955657999 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0d815aaf0 0x7fa0d81f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 >> 172.21.15.144:0/3955657999 conn(0x7fa0d80cb720 msgr2=0x7fa0d80b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 shutdown_connections 2023-05-11T07:36:47.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.663+0000 7fa0dd1ff700 1 -- 172.21.15.144:0/3955657999 wait complete. 2023-05-11T07:36:47.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.868+0000 7f53569ff700 1 Processor -- start 2023-05-11T07:36:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.868+0000 7f53569ff700 1 -- start start 2023-05-11T07:36:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f53569ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 0x7f53500ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f53569ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f535006ce70 0x7f535015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f53569ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535006b6c0 con 0x7f535006fe10 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f53569ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535006b9a0 con 0x7f535006ce70 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f53569ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535006bc80 con 0x7f5350158f40 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f534f7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f535006fe10 0x7f535006c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58776/0 (socket says 172.21.15.144:58776) 2023-05-11T07:36:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.869+0000 7f534f7fe700 1 -- 172.21.15.144:0/3656405622 learned_addr learned my addr 172.21.15.144:0/3656405622 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 --2- 172.21.15.144:0/3656405622 >> v2:172.21.15.145:3300/0 conn(0x7f535006ce70 0x7f535015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f534ffff700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 0x7f53500ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f534effd700 1 -- 172.21.15.144:0/3656405622 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334481143 0 0) 0x7f535006b6c0 con 0x7f535006fe10 2023-05-11T07:36:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f534effd700 1 -- 172.21.15.144:0/3656405622 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53380035b0 con 0x7f535006fe10 2023-05-11T07:36:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 -- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 msgr2=0x7f53500ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 0x7f53500ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 -- 172.21.15.144:0/3656405622 >> v1:172.21.15.144:6789/0 conn(0x7f535006fe10 legacy=0x7f535006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 -- 172.21.15.144:0/3656405622 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535006bf60 con 0x7f535006ce70 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f534ffff700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 0x7f53500ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.870+0000 7f5354f9c700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f535015cb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5348009d90 tx=0x7f534800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f0e2ae31a2e434 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f534effd700 1 -- 172.21.15.144:0/3656405622 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800e070 con 0x7f535006ce70 2023-05-11T07:36:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f534effd700 1 -- 172.21.15.144:0/3656405622 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800bb20 con 0x7f535006ce70 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f534effd700 1 -- 172.21.15.144:0/3656405622 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012430 con 0x7f535006ce70 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 -- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 msgr2=0x7f535015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f535015cb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5348009d90 tx=0x7f534800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 -- 172.21.15.144:0/3656405622 shutdown_connections 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f535015cb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 --2- 172.21.15.144:0/3656405622 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5350158f40 0x7f53500ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 -- 172.21.15.144:0/3656405622 >> 172.21.15.144:0/3656405622 conn(0x7f53500cb720 msgr2=0x7f53500cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 -- 172.21.15.144:0/3656405622 shutdown_connections 2023-05-11T07:36:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.871+0000 7f53569ff700 1 -- 172.21.15.144:0/3656405622 wait complete. 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.873+0000 7f53569ff700 1 Processor -- start 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.873+0000 7f53569ff700 1 -- start start 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f53500c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f535006fe10 0x7f53500c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350159c20 con 0x7f5350158f40 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c4860 con 0x7f535006ce70 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f53569ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c4b40 con 0x7f535006fe10 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f5354f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f5354f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34822/0 (socket says 172.21.15.144:34822) 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f5354f9c700 1 -- 172.21.15.144:0/138769512 learned_addr learned my addr 172.21.15.144:0/138769512 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f534ffff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f53500c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.874+0000 7f534f7fe700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f535006fe10 0x7f53500c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 -- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f535006fe10 msgr2=0x7f53500c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f535006fe10 0x7f53500c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 -- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 msgr2=0x7f53500c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f53500c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 -- 172.21.15.144:0/138769512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400094a0 con 0x7f5350158f40 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f534ffff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f53500c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f5354f9c700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5348014040 tx=0x7f5348004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480129f0 con 0x7f5350158f40 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5348020070 con 0x7f5350158f40 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348009a70 con 0x7f5350158f40 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012db0 con 0x7f5350158f40 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.875+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53500cdb10 con 0x7f5350158f40 2023-05-11T07:36:47.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.876+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535006c240 con 0x7f5350158f40 2023-05-11T07:36:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.877+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5348004040 con 0x7f5350158f40 2023-05-11T07:36:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.878+0000 7f534cff9700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 0x7f533c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.878+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5348022070 con 0x7f5350158f40 2023-05-11T07:36:47.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.878+0000 7f534ffff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 0x7f533c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:47.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.879+0000 7f534ffff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 0x7f533c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5340009d20 tx=0x7f5340008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:47.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:47.883+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5348059cb0 con 0x7f5350158f40 2023-05-11T07:36:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.082+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5350159310 con 0x7f5350158f40 2023-05-11T07:36:48.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.082+0000 7f534cff9700 1 -- 172.21.15.144:0/138769512 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5348059840 con 0x7f5350158f40 2023-05-11T07:36:48.085 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 msgr2=0x7f533c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 0x7f533c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5340009d20 tx=0x7f5340008040 comp rx=0 tx=0).stop 2023-05-11T07:36:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 msgr2=0x7f53500c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5348014040 tx=0x7f5348004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 shutdown_connections 2023-05-11T07:36:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f533c06ace0 0x7f533c06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5350158f40 0x7f53500c3ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f535006ce70 0x7f53500c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 --2- 172.21.15.144:0/138769512 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f535006fe10 0x7f53500c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 >> 172.21.15.144:0/138769512 conn(0x7f53500cb720 msgr2=0x7f5350158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 shutdown_connections 2023-05-11T07:36:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.085+0000 7f53569ff700 1 -- 172.21.15.144:0/138769512 wait complete. 2023-05-11T07:36:48.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.289+0000 7f3f587ff700 1 Processor -- start 2023-05-11T07:36:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.289+0000 7f3f587ff700 1 -- start start 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f50160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3f500b5fd0 0x7f3f5006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3f500b6420 0x7f3f5006b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f50161420 con 0x7f3f500b6420 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500d0e80 con 0x7f3f500b5fd0 2023-05-11T07:36:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.290+0000 7f3f587ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cdb00 con 0x7f3f5015c940 2023-05-11T07:36:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3f500b6420 0x7f3f5006b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3f500b6420 0x7f3f5006b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34834/0 (socket says 172.21.15.144:34834) 2023-05-11T07:36:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 -- 172.21.15.144:0/542779745 learned_addr learned my addr 172.21.15.144:0/542779745 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f55d9a700 1 --2- 172.21.15.144:0/542779745 >> v2:172.21.15.145:3300/0 conn(0x7f3f500b5fd0 0x7f3f5006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f5659b700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f50160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 -- 172.21.15.144:0/542779745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 msgr2=0x7f3f50160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f50160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 -- 172.21.15.144:0/542779745 >> v2:172.21.15.145:3300/0 conn(0x7f3f500b5fd0 msgr2=0x7f3f5006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 --2- 172.21.15.144:0/542779745 >> v2:172.21.15.145:3300/0 conn(0x7f3f500b5fd0 0x7f3f5006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.291+0000 7f3f56d9c700 1 -- 172.21.15.144:0/542779745 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500cdde0 con 0x7f3f500b6420 2023-05-11T07:36:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f56d9c700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b6420 0x7f3f5006b180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f500d3d70 tx=0x7f3f4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e58d3ce7a11af09 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f55599700 1 -- 172.21.15.144:0/542779745 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800e070 con 0x7f3f500b6420 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f55599700 1 -- 172.21.15.144:0/542779745 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800b910 con 0x7f3f500b6420 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f55599700 1 -- 172.21.15.144:0/542779745 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800bcc0 con 0x7f3f500b6420 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 -- 172.21.15.144:0/542779745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b6420 msgr2=0x7f3f5006b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b6420 0x7f3f5006b180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f500d3d70 tx=0x7f3f4800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 -- 172.21.15.144:0/542779745 shutdown_connections 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b6420 0x7f3f5006b180 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 --2- 172.21.15.144:0/542779745 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f50160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 --2- 172.21.15.144:0/542779745 >> v2:172.21.15.145:3300/0 conn(0x7f3f500b5fd0 0x7f3f5006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.292+0000 7f3f587ff700 1 -- 172.21.15.144:0/542779745 >> 172.21.15.144:0/542779745 conn(0x7f3f500d3180 msgr2=0x7f3f500d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:48.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.293+0000 7f3f587ff700 1 -- 172.21.15.144:0/542779745 shutdown_connections 2023-05-11T07:36:48.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.293+0000 7f3f587ff700 1 -- 172.21.15.144:0/542779745 wait complete. 2023-05-11T07:36:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.294+0000 7f3f587ff700 1 Processor -- start 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.294+0000 7f3f587ff700 1 -- start start 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f500b6420 0x7f3f50158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f501f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500b2a40 con 0x7f3f500b5fd0 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501f3460 con 0x7f3f500b6420 2023-05-11T07:36:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.295+0000 7f3f587ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501f3740 con 0x7f3f5015c940 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34838/0 (socket says 172.21.15.144:34838) 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 -- 172.21.15.144:0/646854455 learned_addr learned my addr 172.21.15.144:0/646854455 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f56d9c700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f501f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f55d9a700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f500b6420 0x7f3f50158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 -- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 msgr2=0x7f3f501f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f501f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 -- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f500b6420 msgr2=0x7f3f50158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f500b6420 0x7f3f50158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 -- 172.21.15.144:0/646854455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48009b30 con 0x7f3f500b5fd0 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f5659b700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e870 tx=0x7f3f4c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c009590 con 0x7f3f500b5fd0 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00ee70 con 0x7f3f500b5fd0 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00ca50 con 0x7f3f500b5fd0 2023-05-11T07:36:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.296+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500d1400 con 0x7f3f500b5fd0 2023-05-11T07:36:48.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.297+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500d1120 con 0x7f3f500b5fd0 2023-05-11T07:36:48.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.298+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5015cd10 con 0x7f3f500b5fd0 2023-05-11T07:36:48.303 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.298+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f4c00cbb0 con 0x7f3f500b5fd0 2023-05-11T07:36:48.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.299+0000 7f3f46ffd700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.299+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f4c089860 con 0x7f3f500b5fd0 2023-05-11T07:36:48.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.300+0000 7f3f55d9a700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.304 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.300+0000 7f3f55d9a700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 0x7f3f3406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f500d23e0 tx=0x7f3f40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.304+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f4c057fd0 con 0x7f3f500b5fd0 2023-05-11T07:36:48.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.498+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f501f4070 con 0x7f3f500b5fd0 2023-05-11T07:36:48.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.498+0000 7f3f46ffd700 1 -- 172.21.15.144:0/646854455 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f4c00ce60 con 0x7f3f500b5fd0 2023-05-11T07:36:48.501 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:48.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 msgr2=0x7f3f3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 0x7f3f3406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f500d23e0 tx=0x7f3f40008040 comp rx=0 tx=0).stop 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 msgr2=0x7f3f501583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e870 tx=0x7f3f4c00ec30 comp rx=0 tx=0).stop 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 shutdown_connections 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3f3406ace0 0x7f3f3406d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3f5015c940 0x7f3f501f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f500b5fd0 0x7f3f501583f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 --2- 172.21.15.144:0/646854455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3f500b6420 0x7f3f50158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 >> 172.21.15.144:0/646854455 conn(0x7f3f500d3180 msgr2=0x7f3f500c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 shutdown_connections 2023-05-11T07:36:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.501+0000 7f3f587ff700 1 -- 172.21.15.144:0/646854455 wait complete. 2023-05-11T07:36:48.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:48.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.708+0000 7fbf4d5ff700 1 Processor -- start 2023-05-11T07:36:48.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.708+0000 7fbf4d5ff700 1 -- start start 2023-05-11T07:36:48.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.709+0000 7fbf4d5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf4815c940 0x7fbf48160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.709+0000 7fbf4d5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbf480b5fd0 0x7fbf4806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.709+0000 7fbf4d5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480d0e80 con 0x7fbf480b6420 2023-05-11T07:36:48.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.709+0000 7fbf4d5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf48161420 con 0x7fbf4815c940 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf4d5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cdb00 con 0x7fbf480b5fd0 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf4815c940 0x7fbf48160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbf4815c940 0x7fbf48160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34848/0 (socket says 172.21.15.144:34848) 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 -- 172.21.15.144:0/1428105240 learned_addr learned my addr 172.21.15.144:0/1428105240 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf3ffff700 1 --2- 172.21.15.144:0/1428105240 >> v2:172.21.15.145:3300/0 conn(0x7fbf480b5fd0 0x7fbf4806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 -- 172.21.15.144:0/1428105240 >> v2:172.21.15.145:3300/0 conn(0x7fbf480b5fd0 msgr2=0x7fbf4806ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:48.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 --2- 172.21.15.144:0/1428105240 >> v2:172.21.15.145:3300/0 conn(0x7fbf480b5fd0 0x7fbf4806ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 -- 172.21.15.144:0/1428105240 >> v1:172.21.15.145:6789/0 conn(0x7fbf480b6420 legacy=0x7fbf480d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 -- 172.21.15.144:0/1428105240 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480cdde0 con 0x7fbf4815c940 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.710+0000 7fbf46ffd700 1 --2- 172.21.15.144:0/1428105240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf4815c940 0x7fbf48160ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf480d3e60 tx=0x7fbf38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93afc3eaa2120451 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf467fc700 1 -- 172.21.15.144:0/1428105240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004230 con 0x7fbf4815c940 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf467fc700 1 -- 172.21.15.144:0/1428105240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38004390 con 0x7fbf4815c940 2023-05-11T07:36:48.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf467fc700 1 -- 172.21.15.144:0/1428105240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380036a0 con 0x7fbf4815c940 2023-05-11T07:36:48.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/1428105240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf4815c940 msgr2=0x7fbf48160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/1428105240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf4815c940 0x7fbf48160ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf480d3e60 tx=0x7fbf38009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/1428105240 shutdown_connections 2023-05-11T07:36:48.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/1428105240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf4815c940 0x7fbf48160ee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/1428105240 >> v2:172.21.15.145:3300/0 conn(0x7fbf480b5fd0 0x7fbf4806ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/1428105240 >> 172.21.15.144:0/1428105240 conn(0x7fbf480d3180 msgr2=0x7fbf480d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:48.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/1428105240 shutdown_connections 2023-05-11T07:36:48.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.711+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/1428105240 wait complete. 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.713+0000 7fbf4d5ff700 1 Processor -- start 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.713+0000 7fbf4d5ff700 1 -- start start 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480b6420 0x7fbf4814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf4815c940 0x7fbf4814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814fd80 con 0x7fbf480b5fd0 2023-05-11T07:36:48.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814dfa0 con 0x7fbf480b6420 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf4d5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814ffb0 con 0x7fbf4815c940 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf46ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf46ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34862/0 (socket says 172.21.15.144:34862) 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.714+0000 7fbf46ffd700 1 -- 172.21.15.144:0/3049729033 learned_addr learned my addr 172.21.15.144:0/3049729033 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf3ffff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480b6420 0x7fbf4814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf477fe700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf4815c940 0x7fbf4814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 -- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf4815c940 msgr2=0x7fbf4814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf4815c940 0x7fbf4814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 -- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480b6420 msgr2=0x7fbf4814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480b6420 0x7fbf4814f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 -- 172.21.15.144:0/3049729033 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009550 con 0x7fbf480b5fd0 2023-05-11T07:36:48.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf46ffd700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009130 tx=0x7fbf38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38003d40 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3801f070 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480d1400 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38011870 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.715+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf480d1120 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.716+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4815cd10 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.717+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf38021030 con 0x7fbf480b5fd0 2023-05-11T07:36:48.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.718+0000 7fbf3f7fe700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 0x7fbf2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.718+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbf3808adf0 con 0x7fbf480b5fd0 2023-05-11T07:36:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.719+0000 7fbf3ffff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 0x7fbf2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.719+0000 7fbf3ffff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 0x7fbf2806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b5bf0 tx=0x7fbf30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:48.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.723+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbf38055b60 con 0x7fbf480b5fd0 2023-05-11T07:36:48.917 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.915+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbf480744c0 con 0x7fbf480b5fd0 2023-05-11T07:36:48.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.915+0000 7fbf3f7fe700 1 -- 172.21.15.144:0/3049729033 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbf38029020 con 0x7fbf480b5fd0 2023-05-11T07:36:48.918 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:48.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 msgr2=0x7fbf2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 0x7fbf2806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b5bf0 tx=0x7fbf30008040 comp rx=0 tx=0).stop 2023-05-11T07:36:48.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 msgr2=0x7fbf4815bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009130 tx=0x7fbf38004750 comp rx=0 tx=0).stop 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 shutdown_connections 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbf2806ace0 0x7fbf2806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbf4815c940 0x7fbf4814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf480b5fd0 0x7fbf4815bdb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 --2- 172.21.15.144:0/3049729033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf480b6420 0x7fbf4814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:48.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 >> 172.21.15.144:0/3049729033 conn(0x7fbf480d3180 msgr2=0x7fbf480b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:48.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 shutdown_connections 2023-05-11T07:36:48.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:48.918+0000 7fbf4d5ff700 1 -- 172.21.15.144:0/3049729033 wait complete. 2023-05-11T07:36:48.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:36:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.120+0000 7f79251ff700 1 Processor -- start 2023-05-11T07:36:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.120+0000 7f79251ff700 1 -- start start 2023-05-11T07:36:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f79251ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 0x7f79200c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f79251ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792015e200 con 0x7f79200ca020 2023-05-11T07:36:49.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f79251ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792015a100 con 0x7f79200b0e30 2023-05-11T07:36:49.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f79251ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792015a3e0 con 0x7f79201599e0 2023-05-11T07:36:49.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f7917fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f79200ca020 0x7f79200b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58784/0 (socket says 172.21.15.144:58784) 2023-05-11T07:36:49.124 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.121+0000 7f7917fff700 1 -- 172.21.15.144:0/1789200789 learned_addr learned my addr 172.21.15.144:0/1789200789 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:49.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791ed9d700 1 --2- 172.21.15.144:0/1789200789 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 0x7f79200c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105224515 0 0) 0x7f792015e200 con 0x7f79200ca020 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c0035b0 con 0x7f79200ca020 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244437285 0 0) 0x7f792015a100 con 0x7f79200b0e30 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792015e200 con 0x7f79200b0e30 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791ed9d700 1 -- 172.21.15.144:0/1789200789 >> v1:172.21.15.145:6789/0 conn(0x7f79200b0e30 legacy=0x7f79200ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 869961218 0 0) 0x7f790c0035b0 con 0x7f79200ca020 2023-05-11T07:36:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791ed9d700 1 -- 172.21.15.144:0/1789200789 >> v1:172.21.15.144:6789/0 conn(0x7f79200ca020 legacy=0x7f79200b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791ed9d700 1 -- 172.21.15.144:0/1789200789 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792015a6c0 con 0x7f79201599e0 2023-05-11T07:36:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.122+0000 7f791ed9d700 1 --2- 172.21.15.144:0/1789200789 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 0x7f79200c9ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7910009870 tx=0x7f7910009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a668febbd4bcb5d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908001670 con 0x7f79201599e0 2023-05-11T07:36:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910004030 con 0x7f79201599e0 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f791e59c700 1 -- 172.21.15.144:0/1789200789 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100043c0 con 0x7f79201599e0 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 -- 172.21.15.144:0/1789200789 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 msgr2=0x7f79200c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 --2- 172.21.15.144:0/1789200789 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 0x7f79200c9ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7910009870 tx=0x7f7910009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 -- 172.21.15.144:0/1789200789 shutdown_connections 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 --2- 172.21.15.144:0/1789200789 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79201599e0 0x7f79200c9ae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 -- 172.21.15.144:0/1789200789 >> 172.21.15.144:0/1789200789 conn(0x7f79200cb720 msgr2=0x7f79200cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 -- 172.21.15.144:0/1789200789 shutdown_connections 2023-05-11T07:36:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.123+0000 7f79251ff700 1 -- 172.21.15.144:0/1789200789 wait complete. 2023-05-11T07:36:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.126+0000 7f79251ff700 1 Processor -- start 2023-05-11T07:36:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.126+0000 7f79251ff700 1 -- start start 2023-05-11T07:36:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79200b0e30 0x7f79201f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 0x7f7920147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79201f4ee0 con 0x7f79200ca020 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7920155500 con 0x7f79201599e0 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f79251ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200c8450 con 0x7f79200b0e30 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f7917fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f7917fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34872/0 (socket says 172.21.15.144:34872) 2023-05-11T07:36:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f7917fff700 1 -- 172.21.15.144:0/2432544966 learned_addr learned my addr 172.21.15.144:0/2432544966 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.127+0000 7f791f59e700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 0x7f7920147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f791ed9d700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79200b0e30 0x7f79201f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 -- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79200b0e30 msgr2=0x7f79201f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79200b0e30 0x7f79201f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 -- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 msgr2=0x7f7920147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 0x7f7920147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 -- 172.21.15.144:0/2432544966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100094a0 con 0x7f79200ca020 2023-05-11T07:36:49.133 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f791f59e700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 0x7f7920147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f7917fff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f790800c750 tx=0x7f790800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908004c80 con 0x7f79200ca020 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908004de0 con 0x7f79200ca020 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7920159db0 con 0x7f79200ca020 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007310 con 0x7f79200ca020 2023-05-11T07:36:49.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.128+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792015a9a0 con 0x7f79200ca020 2023-05-11T07:36:49.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.130+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200cd5f0 con 0x7f79200ca020 2023-05-11T07:36:49.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.130+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7908007470 con 0x7f79200ca020 2023-05-11T07:36:49.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.131+0000 7f79177fe700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 0x7f790006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.131+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7908089540 con 0x7f79200ca020 2023-05-11T07:36:49.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.131+0000 7f791ed9d700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 0x7f790006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.132+0000 7f791ed9d700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 0x7f790006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79100097c0 tx=0x7f7910008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.136+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7908054350 con 0x7f79200ca020 2023-05-11T07:36:49.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.345+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79200b1700 con 0x7f79200ca020 2023-05-11T07:36:49.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.345+0000 7f79177fe700 1 -- 172.21.15.144:0/2432544966 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7908057970 con 0x7f79200ca020 2023-05-11T07:36:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 msgr2=0x7f790006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 0x7f790006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79100097c0 tx=0x7f7910008030 comp rx=0 tx=0).stop 2023-05-11T07:36:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 msgr2=0x7f7920157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f790800c750 tx=0x7f790800ca60 comp rx=0 tx=0).stop 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 shutdown_connections 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f790006ace0 0x7f790006d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f79200b0e30 0x7f79201f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79201599e0 0x7f7920147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 --2- 172.21.15.144:0/2432544966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79200ca020 0x7f7920157570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 >> 172.21.15.144:0/2432544966 conn(0x7f79200cb720 msgr2=0x7f7920158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:49.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 shutdown_connections 2023-05-11T07:36:49.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.348+0000 7f79251ff700 1 -- 172.21.15.144:0/2432544966 wait complete. 2023-05-11T07:36:49.352 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:36:49.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-11T07:36:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:49.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-05-11T07:36:49.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:36:49.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:49.453 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-11T07:36:49.495 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:49.495 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:49.542 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:49.542 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:49.628 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:49.629 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:49.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:49.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.894+0000 7f1bbcfff700 1 Processor -- start 2023-05-11T07:36:49.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.895+0000 7f1bbcfff700 1 -- start start 2023-05-11T07:36:49.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bbcfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb8071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bbcfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1bb806a2d0 0x7f1bb806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bbcfff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb8071740 con 0x7f1bb806b7a0 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bbcfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb806cfe0 con 0x7f1bb806a2d0 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bbcfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb815ab20 con 0x7f1bb815a750 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1baffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1bb806a2d0 0x7f1bb806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1baffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1bb806a2d0 0x7f1bb806a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34886/0 (socket says 172.21.15.144:34886) 2023-05-11T07:36:49.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1baffff700 1 -- 172.21.15.144:0/3270411509 learned_addr learned my addr 172.21.15.144:0/3270411509 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:49.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.896+0000 7f1bb659c700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb8071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1baffff700 1 -- 172.21.15.144:0/3270411509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 msgr2=0x7f1bb8071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:49.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1baffff700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb8071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.901 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1baffff700 1 -- 172.21.15.144:0/3270411509 >> v1:172.21.15.145:6789/0 conn(0x7f1bb806b7a0 legacy=0x7f1bb806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1baffff700 1 -- 172.21.15.144:0/3270411509 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8071160 con 0x7f1bb806a2d0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1bb5d9b700 1 -- 172.21.15.144:0/3270411509 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447083673 0 0) 0x7f1bb8071740 con 0x7f1bb806b7a0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1baffff700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806a2d0 0x7f1bb806a740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00098f0 tx=0x7f1ba0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed523293a9dfc7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1bb5d9b700 1 -- 172.21.15.144:0/3270411509 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011830 con 0x7f1bb806a2d0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1bb5d9b700 1 -- 172.21.15.144:0/3270411509 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba0011990 con 0x7f1bb806a2d0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.897+0000 7f1bb5d9b700 1 -- 172.21.15.144:0/3270411509 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011d20 con 0x7f1bb806a2d0 2023-05-11T07:36:49.902 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 -- 172.21.15.144:0/3270411509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806a2d0 msgr2=0x7f1bb806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806a2d0 0x7f1bb806a740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00098f0 tx=0x7f1ba0009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 -- 172.21.15.144:0/3270411509 shutdown_connections 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb8071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/3270411509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806a2d0 0x7f1bb806a740 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 -- 172.21.15.144:0/3270411509 >> 172.21.15.144:0/3270411509 conn(0x7f1bb80cb7e0 msgr2=0x7f1bb80cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 -- 172.21.15.144:0/3270411509 shutdown_connections 2023-05-11T07:36:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.898+0000 7f1bbcfff700 1 -- 172.21.15.144:0/3270411509 wait complete. 2023-05-11T07:36:49.905 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.899+0000 7f1bbcfff700 1 Processor -- start 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.900+0000 7f1bbcfff700 1 -- start start 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.900+0000 7f1bbcfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 0x7f1bb8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bbcfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bbcfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bbcfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb81f3bb0 con 0x7f1bb806b7a0 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bbcfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb81f2fa0 con 0x7f1bb806a2d0 2023-05-11T07:36:49.906 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bbcfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb81f3280 con 0x7f1bb815a750 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34900/0 (socket says 172.21.15.144:34900) 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 -- 172.21.15.144:0/1184615511 learned_addr learned my addr 172.21.15.144:0/1184615511 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bb659c700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 0x7f1bb8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bb6d9d700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.907 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 -- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 msgr2=0x7f1bb80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 -- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 msgr2=0x7f1bb8156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 0x7f1bb8156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 -- 172.21.15.144:0/1184615511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009550 con 0x7f1bb806b7a0 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1bb659c700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 0x7f1bb8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.901+0000 7f1baffff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009c40 tx=0x7f1ba0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.908 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.902+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0004480 con 0x7f1bb806b7a0 2023-05-11T07:36:49.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.902+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba001f070 con 0x7f1bb806b7a0 2023-05-11T07:36:49.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.902+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb80713d0 con 0x7f1bb806b7a0 2023-05-11T07:36:49.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.902+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00038c0 con 0x7f1bb806b7a0 2023-05-11T07:36:49.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.902+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb806c420 con 0x7f1bb806b7a0 2023-05-11T07:36:49.909 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.903+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb806c700 con 0x7f1bb806b7a0 2023-05-11T07:36:49.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.904+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ba0021030 con 0x7f1bb806b7a0 2023-05-11T07:36:49.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.905+0000 7f1baeffd700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:49.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.905+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ba008ace0 con 0x7f1bb806b7a0 2023-05-11T07:36:49.910 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.905+0000 7f1bb659c700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:49.911 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.906+0000 7f1bb659c700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 0x7f1b9806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80ad950 tx=0x7f1ba8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:49.912 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:49.910+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1ba0091080 con 0x7f1bb806b7a0 2023-05-11T07:36:50.106 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.104+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bb806af00 con 0x7f1bb806b7a0 2023-05-11T07:36:50.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.105+0000 7f1baeffd700 1 -- 172.21.15.144:0/1184615511 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f1ba0015090 con 0x7f1bb806b7a0 2023-05-11T07:36:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:50.108 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:50.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.107+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 msgr2=0x7f1b9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.107+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 0x7f1b9806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80ad950 tx=0x7f1ba8008040 comp rx=0 tx=0).stop 2023-05-11T07:36:50.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.107+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 msgr2=0x7f1bb80adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.107+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009c40 tx=0x7f1ba0004750 comp rx=0 tx=0).stop 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.107+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 shutdown_connections 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1b9806ace0 0x7f1b9806d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1bb815a750 0x7f1bb80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb806a2d0 0x7f1bb8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 --2- 172.21.15.144:0/1184615511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb806b7a0 0x7f1bb80adc30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 >> 172.21.15.144:0/1184615511 conn(0x7f1bb80cb7e0 msgr2=0x7f1bb8157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:50.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 shutdown_connections 2023-05-11T07:36:50.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.108+0000 7f1bbcfff700 1 -- 172.21.15.144:0/1184615511 wait complete. 2023-05-11T07:36:50.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:50.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:50.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.313+0000 7f381ffff700 1 Processor -- start 2023-05-11T07:36:50.316 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.313+0000 7f381ffff700 1 -- start start 2023-05-11T07:36:50.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.314+0000 7f381ffff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f381815c930 0x7f381815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.314+0000 7f381ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38180cfe00 0x7f38180d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.314+0000 7f381ffff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381815de80 con 0x7f38180d02a0 2023-05-11T07:36:50.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.314+0000 7f381ffff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180cf640 con 0x7f38180cfe00 2023-05-11T07:36:50.317 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.314+0000 7f381ffff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381815cd00 con 0x7f381815c930 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38180cfe00 0x7f38180d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38180cfe00 0x7f38180d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34902/0 (socket says 172.21.15.144:34902) 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 -- 172.21.15.144:0/2939668180 learned_addr learned my addr 172.21.15.144:0/2939668180 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 -- 172.21.15.144:0/2939668180 >> v2:172.21.15.145:3300/0 conn(0x7f381815c930 msgr2=0x7f381815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 --2- 172.21.15.144:0/2939668180 >> v2:172.21.15.145:3300/0 conn(0x7f381815c930 0x7f381815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 -- 172.21.15.144:0/2939668180 >> v1:172.21.15.144:6789/0 conn(0x7f38180d02a0 legacy=0x7f38180b4c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.315+0000 7f381d59a700 1 -- 172.21.15.144:0/2939668180 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180cd940 con 0x7f38180cfe00 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381d59a700 1 --2- 172.21.15.144:0/2939668180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38180cfe00 0x7f38180d0db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f38080098f0 tx=0x7f3808009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a017b500687c0367 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381cd99700 1 -- 172.21.15.144:0/2939668180 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808004230 con 0x7f38180cfe00 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381cd99700 1 -- 172.21.15.144:0/2939668180 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808004390 con 0x7f38180cfe00 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381cd99700 1 -- 172.21.15.144:0/2939668180 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080036a0 con 0x7f38180cfe00 2023-05-11T07:36:50.320 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 -- 172.21.15.144:0/2939668180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38180cfe00 msgr2=0x7f38180d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 --2- 172.21.15.144:0/2939668180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38180cfe00 0x7f38180d0db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f38080098f0 tx=0x7f3808009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 -- 172.21.15.144:0/2939668180 shutdown_connections 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 --2- 172.21.15.144:0/2939668180 >> v2:172.21.15.145:3300/0 conn(0x7f381815c930 0x7f381815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 --2- 172.21.15.144:0/2939668180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38180cfe00 0x7f38180d0db0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 -- 172.21.15.144:0/2939668180 >> 172.21.15.144:0/2939668180 conn(0x7f3818072650 msgr2=0x7f381806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.316+0000 7f381ffff700 1 -- 172.21.15.144:0/2939668180 shutdown_connections 2023-05-11T07:36:50.321 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.317+0000 7f381ffff700 1 -- 172.21.15.144:0/2939668180 wait complete. 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.318+0000 7f381ffff700 1 Processor -- start 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.318+0000 7f381ffff700 1 -- start start 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38180d02a0 0x7f38181586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38180cc540 0x7f38181455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cb4a0 con 0x7f381815c930 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cb780 con 0x7f38180d02a0 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381ffff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cba60 con 0x7f38180cc540 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381d59a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381d59a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34918/0 (socket says 172.21.15.144:34918) 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.319+0000 7f381d59a700 1 -- 172.21.15.144:0/2365506775 learned_addr learned my addr 172.21.15.144:0/2365506775 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381e59c700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38180cc540 0x7f38181455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381dd9b700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38180d02a0 0x7f38181586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 -- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38180cc540 msgr2=0x7f38181455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38180cc540 0x7f38181455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 -- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38180d02a0 msgr2=0x7f38181586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38180d02a0 0x7f38181586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 -- 172.21.15.144:0/2365506775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808009550 con 0x7f381815c930 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381d59a700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3808000c00 tx=0x7f3808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808011630 con 0x7f381815c930 2023-05-11T07:36:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380801f070 con 0x7f381815c930 2023-05-11T07:36:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180cf8e0 con 0x7f381815c930 2023-05-11T07:36:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080119d0 con 0x7f381815c930 2023-05-11T07:36:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.320+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180cdc20 con 0x7f381815c930 2023-05-11T07:36:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.321+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38180cdf00 con 0x7f381815c930 2023-05-11T07:36:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.322+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3808021030 con 0x7f381815c930 2023-05-11T07:36:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.323+0000 7f380e7fc700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 0x7f37fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.323+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f380808afe0 con 0x7f381815c930 2023-05-11T07:36:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.324+0000 7f381dd9b700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 0x7f37fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.324+0000 7f381dd9b700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 0x7f37fc06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3814006fd0 tx=0x7f3814008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.328+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3808055d50 con 0x7f381815c930 2023-05-11T07:36:50.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.522+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38180cdf00 con 0x7f381815c930 2023-05-11T07:36:50.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.523+0000 7f380e7fc700 1 -- 172.21.15.144:0/2365506775 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3808059370 con 0x7f381815c930 2023-05-11T07:36:50.526 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 msgr2=0x7f37fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 0x7f37fc06d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3814006fd0 tx=0x7f3814008040 comp rx=0 tx=0).stop 2023-05-11T07:36:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 msgr2=0x7f38180b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3808000c00 tx=0x7f3808004750 comp rx=0 tx=0).stop 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 shutdown_connections 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f37fc06ace0 0x7f37fc06d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f38180cc540 0x7f38181455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f38180d02a0 0x7f38181586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 --2- 172.21.15.144:0/2365506775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381815c930 0x7f38180b2e20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 >> 172.21.15.144:0/2365506775 conn(0x7f38180cfe00 msgr2=0x7f3818159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:50.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 shutdown_connections 2023-05-11T07:36:50.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.525+0000 7f381ffff700 1 -- 172.21.15.144:0/2365506775 wait complete. 2023-05-11T07:36:50.545 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:50.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.730+0000 7f17433ff700 1 Processor -- start 2023-05-11T07:36:50.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.730+0000 7f17433ff700 1 -- start start 2023-05-11T07:36:50.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f173c15c940 0x7f173c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f173c0b5fd0 0x7f173c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c06b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c161420 con 0x7f173c0b5fd0 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c0d0e80 con 0x7f173c15c940 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f17433ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0cdb00 con 0x7f173c0b6420 2023-05-11T07:36:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f174099a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f173c0b5fd0 0x7f173c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f174099a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f173c0b5fd0 0x7f173c06ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34932/0 (socket says 172.21.15.144:34932) 2023-05-11T07:36:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f174099a700 1 -- 172.21.15.144:0/2723954864 learned_addr learned my addr 172.21.15.144:0/2723954864 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f174199c700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c06b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.731+0000 7f174119b700 1 --2- 172.21.15.144:0/2723954864 >> v2:172.21.15.145:3300/0 conn(0x7f173c15c940 0x7f173c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 -- 172.21.15.144:0/2723954864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 msgr2=0x7f173c06b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c06b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 -- 172.21.15.144:0/2723954864 >> v2:172.21.15.145:3300/0 conn(0x7f173c15c940 msgr2=0x7f173c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 --2- 172.21.15.144:0/2723954864 >> v2:172.21.15.145:3300/0 conn(0x7f173c15c940 0x7f173c160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 -- 172.21.15.144:0/2723954864 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0cdde0 con 0x7f173c0b5fd0 2023-05-11T07:36:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f174099a700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c06ac40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f173c0d0e50 tx=0x7f172c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c48953bf176c40 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f1733fff700 1 -- 172.21.15.144:0/2723954864 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011830 con 0x7f173c0b5fd0 2023-05-11T07:36:50.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f1733fff700 1 -- 172.21.15.144:0/2723954864 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c011990 con 0x7f173c0b5fd0 2023-05-11T07:36:50.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.732+0000 7f1733fff700 1 -- 172.21.15.144:0/2723954864 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011d20 con 0x7f173c0b5fd0 2023-05-11T07:36:50.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 -- 172.21.15.144:0/2723954864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 msgr2=0x7f173c06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c06ac40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f173c0d0e50 tx=0x7f172c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 -- 172.21.15.144:0/2723954864 shutdown_connections 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c06b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 --2- 172.21.15.144:0/2723954864 >> v2:172.21.15.145:3300/0 conn(0x7f173c15c940 0x7f173c160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 --2- 172.21.15.144:0/2723954864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c06ac40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 -- 172.21.15.144:0/2723954864 >> 172.21.15.144:0/2723954864 conn(0x7f173c0d3180 msgr2=0x7f173c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 -- 172.21.15.144:0/2723954864 shutdown_connections 2023-05-11T07:36:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.733+0000 7f17433ff700 1 -- 172.21.15.144:0/2723954864 wait complete. 2023-05-11T07:36:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.734+0000 7f17433ff700 1 Processor -- start 2023-05-11T07:36:50.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.734+0000 7f17433ff700 1 -- start start 2023-05-11T07:36:50.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f173c15c940 0x7f173c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0cae70 con 0x7f173c0b5fd0 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1e7260 con 0x7f173c15c940 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.735+0000 7f17433ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1e7540 con 0x7f173c0b6420 2023-05-11T07:36:50.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34936/0 (socket says 172.21.15.144:34936) 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 -- 172.21.15.144:0/2427557206 learned_addr learned my addr 172.21.15.144:0/2427557206 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174099a700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174199c700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f173c15c940 0x7f173c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 -- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 msgr2=0x7f173c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 -- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f173c15c940 msgr2=0x7f173c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f173c15c940 0x7f173c15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 -- 172.21.15.144:0/2427557206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c009550 con 0x7f173c0b5fd0 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174099a700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f174119b700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f173800e870 tx=0x7f173800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738009590 con 0x7f173c0b5fd0 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.736+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738013680 con 0x7f173c0b5fd0 2023-05-11T07:36:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.737+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380139f0 con 0x7f173c0b5fd0 2023-05-11T07:36:50.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.737+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c0d1400 con 0x7f173c0b5fd0 2023-05-11T07:36:50.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.737+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c0d1120 con 0x7f173c0b5fd0 2023-05-11T07:36:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.738+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c15cd10 con 0x7f173c0b5fd0 2023-05-11T07:36:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.739+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1738013b50 con 0x7f173c0b5fd0 2023-05-11T07:36:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.739+0000 7f1731ffb700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 0x7f172006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.740+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1738089630 con 0x7f173c0b5fd0 2023-05-11T07:36:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.740+0000 7f174099a700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 0x7f172006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.740+0000 7f174099a700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 0x7f172006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f172c009c10 tx=0x7f172c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.744+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1738057e30 con 0x7f173c0b5fd0 2023-05-11T07:36:50.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.939+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f173c0cb170 con 0x7f173c0b5fd0 2023-05-11T07:36:50.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.939+0000 7f1731ffb700 1 -- 172.21.15.144:0/2427557206 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f17380579c0 con 0x7f173c0b5fd0 2023-05-11T07:36:50.943 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:50.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 msgr2=0x7f172006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 0x7f172006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f172c009c10 tx=0x7f172c008030 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 msgr2=0x7f173c1e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f173800e870 tx=0x7f173800eb80 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 shutdown_connections 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f172006ace0 0x7f172006d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f173c15c940 0x7f173c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f173c0b5fd0 0x7f173c1e6c80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 --2- 172.21.15.144:0/2427557206 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f173c0b6420 0x7f173c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:50.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 >> 172.21.15.144:0/2427557206 conn(0x7f173c0d3180 msgr2=0x7f173c0d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 shutdown_connections 2023-05-11T07:36:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:50.942+0000 7f17433ff700 1 -- 172.21.15.144:0/2427557206 wait complete. 2023-05-11T07:36:50.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:51.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.146+0000 7fc93e9ff700 1 Processor -- start 2023-05-11T07:36:51.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.146+0000 7fc93e9ff700 1 -- start start 2023-05-11T07:36:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93e9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc938160ee0 0x7fc93806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93e9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 0x7fc9380d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93e9ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9380d0e80 con 0x7fc93815c940 2023-05-11T07:36:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93e9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93806b600 con 0x7fc938160ee0 2023-05-11T07:36:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93e9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380cdb00 con 0x7fc93806b180 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc9377fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc938160ee0 0x7fc93806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc937fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc93815c940 0x7fc9380b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58796/0 (socket says 172.21.15.144:58796) 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc937fff700 1 -- 172.21.15.144:0/1121627369 learned_addr learned my addr 172.21.15.144:0/1121627369 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc93cf9c700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 0x7fc9380d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.147+0000 7fc9377fe700 1 -- 172.21.15.144:0/1121627369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 msgr2=0x7fc9380d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc9377fe700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 0x7fc9380d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc936ffd700 1 -- 172.21.15.144:0/1121627369 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828923251 0 0) 0x7fc9380d0e80 con 0x7fc93815c940 2023-05-11T07:36:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc9377fe700 1 -- 172.21.15.144:0/1121627369 >> v1:172.21.15.144:6789/0 conn(0x7fc93815c940 legacy=0x7fc9380b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc9377fe700 1 -- 172.21.15.144:0/1121627369 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380cdde0 con 0x7fc938160ee0 2023-05-11T07:36:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc93cf9c700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 0x7fc9380d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc9377fe700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc938160ee0 0x7fc93806ac40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009840 tx=0x7fc92c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f02fdd01eea135 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc936ffd700 1 -- 172.21.15.144:0/1121627369 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011830 con 0x7fc938160ee0 2023-05-11T07:36:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc936ffd700 1 -- 172.21.15.144:0/1121627369 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c011990 con 0x7fc938160ee0 2023-05-11T07:36:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.148+0000 7fc936ffd700 1 -- 172.21.15.144:0/1121627369 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011d20 con 0x7fc938160ee0 2023-05-11T07:36:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 -- 172.21.15.144:0/1121627369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc938160ee0 msgr2=0x7fc93806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc938160ee0 0x7fc93806ac40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009840 tx=0x7fc92c009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 -- 172.21.15.144:0/1121627369 shutdown_connections 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc93806b180 0x7fc9380d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/1121627369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc938160ee0 0x7fc93806ac40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 -- 172.21.15.144:0/1121627369 >> 172.21.15.144:0/1121627369 conn(0x7fc9380d3180 msgr2=0x7fc9380d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 -- 172.21.15.144:0/1121627369 shutdown_connections 2023-05-11T07:36:51.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.149+0000 7fc93e9ff700 1 -- 172.21.15.144:0/1121627369 wait complete. 2023-05-11T07:36:51.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.151+0000 7fc93e9ff700 1 Processor -- start 2023-05-11T07:36:51.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.151+0000 7fc93e9ff700 1 -- start start 2023-05-11T07:36:51.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc93815c940 0x7fc938157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc938160ee0 0x7fc9380abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380ab780 con 0x7fc93806b180 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938157fc0 con 0x7fc93815c940 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.152+0000 7fc93e9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380ac0e0 con 0x7fc938160ee0 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34954/0 (socket says 172.21.15.144:34954) 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 -- 172.21.15.144:0/4251930014 learned_addr learned my addr 172.21.15.144:0/4251930014 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc93cf9c700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc938160ee0 0x7fc9380abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc9377fe700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc93815c940 0x7fc938157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 -- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc938160ee0 msgr2=0x7fc9380abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc938160ee0 0x7fc9380abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 -- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc93815c940 msgr2=0x7fc938157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc93815c940 0x7fc938157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 -- 172.21.15.144:0/4251930014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0094a0 con 0x7fc93806b180 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.153+0000 7fc937fff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9280011e0 tx=0x7fc92800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.154+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928004c80 con 0x7fc93806b180 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.154+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928004e00 con 0x7fc93806b180 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.154+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9380d1400 con 0x7fc93806b180 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.154+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928007310 con 0x7fc93806b180 2023-05-11T07:36:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.154+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9380d1120 con 0x7fc93806b180 2023-05-11T07:36:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.155+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9380b66e0 con 0x7fc93806b180 2023-05-11T07:36:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.156+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc928007470 con 0x7fc93806b180 2023-05-11T07:36:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.157+0000 7fc934ff9700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.157+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc928089470 con 0x7fc93806b180 2023-05-11T07:36:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.157+0000 7fc9377fe700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.158+0000 7fc9377fe700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 0x7fc92406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0090b0 tx=0x7fc92c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.164 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.162+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc9280541e0 con 0x7fc93806b180 2023-05-11T07:36:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.354+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9380ab9f0 con 0x7fc93806b180 2023-05-11T07:36:51.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.355+0000 7fc934ff9700 1 -- 172.21.15.144:0/4251930014 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc928057800 con 0x7fc93806b180 2023-05-11T07:36:51.357 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 msgr2=0x7fc92406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 0x7fc92406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0090b0 tx=0x7fc92c008030 comp rx=0 tx=0).stop 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 msgr2=0x7fc9380aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9280011e0 tx=0x7fc92800ca30 comp rx=0 tx=0).stop 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 shutdown_connections 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc938160ee0 0x7fc9380abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc93806b180 0x7fc9380aa490 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 --2- 172.21.15.144:0/4251930014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc93815c940 0x7fc938157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 >> 172.21.15.144:0/4251930014 conn(0x7fc9380d3180 msgr2=0x7fc9380d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 shutdown_connections 2023-05-11T07:36:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.357+0000 7fc93e9ff700 1 -- 172.21.15.144:0/4251930014 wait complete. 2023-05-11T07:36:51.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:51.565 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.563+0000 7f6d55b9d700 1 Processor -- start 2023-05-11T07:36:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.563+0000 7f6d55b9d700 1 -- start start 2023-05-11T07:36:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d55b9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d501594f0 0x7f6d5006b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d55b9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d5006ccc0 0x7f6d500c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d55b9d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5006bc20 con 0x7f6d500ccbf0 2023-05-11T07:36:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d55b9d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5006bf00 con 0x7f6d501594f0 2023-05-11T07:36:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d55b9d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5006c1e0 con 0x7f6d5006ccc0 2023-05-11T07:36:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d54b9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d501594f0 0x7f6d5006b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d5539c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6d500ccbf0 0x7f6d5015d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58806/0 (socket says 172.21.15.144:58806) 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.564+0000 7f6d5539c700 1 -- 172.21.15.144:0/1862603953 learned_addr learned my addr 172.21.15.144:0/1862603953 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d4ffff700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d5006ccc0 0x7f6d500c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d54b9b700 1 -- 172.21.15.144:0/1862603953 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d5006ccc0 msgr2=0x7f6d500c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d54b9b700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d5006ccc0 0x7f6d500c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d54b9b700 1 -- 172.21.15.144:0/1862603953 >> v1:172.21.15.144:6789/0 conn(0x7f6d500ccbf0 legacy=0x7f6d5015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d54b9b700 1 -- 172.21.15.144:0/1862603953 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5006c4c0 con 0x7f6d501594f0 2023-05-11T07:36:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d54b9b700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5006b590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009840 tx=0x7f6d44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb958909de5d1c35 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d4f7fe700 1 -- 172.21.15.144:0/1862603953 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44004230 con 0x7f6d501594f0 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d4f7fe700 1 -- 172.21.15.144:0/1862603953 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d44004390 con 0x7f6d501594f0 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.565+0000 7f6d4f7fe700 1 -- 172.21.15.144:0/1862603953 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440036a0 con 0x7f6d501594f0 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 -- 172.21.15.144:0/1862603953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 msgr2=0x7f6d5006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5006b590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009840 tx=0x7f6d44009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 -- 172.21.15.144:0/1862603953 shutdown_connections 2023-05-11T07:36:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5006b590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/1862603953 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d5006ccc0 0x7f6d500c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 -- 172.21.15.144:0/1862603953 >> 172.21.15.144:0/1862603953 conn(0x7f6d5006af50 msgr2=0x7f6d500cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 -- 172.21.15.144:0/1862603953 shutdown_connections 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.566+0000 7f6d55b9d700 1 -- 172.21.15.144:0/1862603953 wait complete. 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.568+0000 7f6d55b9d700 1 Processor -- start 2023-05-11T07:36:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.568+0000 7f6d55b9d700 1 -- start start 2023-05-11T07:36:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d5006ccc0 0x7f6d50149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d500ccbf0 0x7f6d5015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501eea00 con 0x7f6d501594f0 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501edb40 con 0x7f6d5006ccc0 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d55b9d700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5015a930 con 0x7f6d500ccbf0 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34978/0 (socket says 172.21.15.144:34978) 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 -- 172.21.15.144:0/3782774320 learned_addr learned my addr 172.21.15.144:0/3782774320 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d4ffff700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d500ccbf0 0x7f6d5015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d54b9b700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d5006ccc0 0x7f6d50149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 -- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d500ccbf0 msgr2=0x7f6d5015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d500ccbf0 0x7f6d5015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 -- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d5006ccc0 msgr2=0x7f6d50149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d5006ccc0 0x7f6d50149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.569+0000 7f6d5539c700 1 -- 172.21.15.144:0/3782774320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440094a0 con 0x7f6d501594f0 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d5539c700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6d48002000 tx=0x7f6d4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800ad40 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d480070d0 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5006d490 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800aea0 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.570+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5006c7a0 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.571+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d501598c0 con 0x7f6d501594f0 2023-05-11T07:36:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.572+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d48007480 con 0x7f6d501594f0 2023-05-11T07:36:51.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.574+0000 7f6d4d7fa700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 0x7f6d3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.574+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d48089700 con 0x7f6d501594f0 2023-05-11T07:36:51.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.574+0000 7f6d54b9b700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 0x7f6d3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.579 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.574+0000 7f6d54b9b700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 0x7f6d3406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d44013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.580 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.578+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6d48054530 con 0x7f6d501594f0 2023-05-11T07:36:51.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.771+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d50061ff0 con 0x7f6d501594f0 2023-05-11T07:36:51.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.771+0000 7f6d4d7fa700 1 -- 172.21.15.144:0/3782774320 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d48057b50 con 0x7f6d501594f0 2023-05-11T07:36:51.774 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:51.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 msgr2=0x7f6d3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 0x7f6d3406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d44013040 comp rx=0 tx=0).stop 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 msgr2=0x7f6d5015c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6d48002000 tx=0x7f6d4800a340 comp rx=0 tx=0).stop 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 shutdown_connections 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6d3406ace0 0x7f6d3406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d501594f0 0x7f6d5015c760 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d5006ccc0 0x7f6d50149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 --2- 172.21.15.144:0/3782774320 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6d500ccbf0 0x7f6d5015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 >> 172.21.15.144:0/3782774320 conn(0x7f6d5006af50 msgr2=0x7f6d500b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:51.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 shutdown_connections 2023-05-11T07:36:51.778 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.774+0000 7f6d55b9d700 1 -- 172.21.15.144:0/3782774320 wait complete. 2023-05-11T07:36:51.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.978+0000 7fca2adff700 1 Processor -- start 2023-05-11T07:36:51.981 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.978+0000 7fca2adff700 1 -- start start 2023-05-11T07:36:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.979+0000 7fca2adff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 0x7fca2406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.979+0000 7fca2adff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca2406b180 0x7fca240d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.982 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.979+0000 7fca2adff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca240d0e80 con 0x7fca2415c940 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.979+0000 7fca2adff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2406b600 con 0x7fca2406b180 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.979+0000 7fca2adff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240cdb00 con 0x7fca24160ee0 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca28b9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fca2415c940 0x7fca240b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58814/0 (socket says 172.21.15.144:58814) 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca28b9b700 1 -- 172.21.15.144:0/4251306045 learned_addr learned my addr 172.21.15.144:0/4251306045 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca2939c700 1 --2- 172.21.15.144:0/4251306045 >> v2:172.21.15.144:3300/0 conn(0x7fca2406b180 0x7fca240d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca23fff700 1 --2- 172.21.15.144:0/4251306045 >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 0x7fca2406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca237fe700 1 -- 172.21.15.144:0/4251306045 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236997933 0 0) 0x7fca240d0e80 con 0x7fca2415c940 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca237fe700 1 -- 172.21.15.144:0/4251306045 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca140035b0 con 0x7fca2415c940 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca2939c700 1 -- 172.21.15.144:0/4251306045 >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 msgr2=0x7fca2406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca2939c700 1 --2- 172.21.15.144:0/4251306045 >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 0x7fca2406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca2939c700 1 -- 172.21.15.144:0/4251306045 >> v1:172.21.15.144:6789/0 conn(0x7fca2415c940 legacy=0x7fca240b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca2939c700 1 -- 172.21.15.144:0/4251306045 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240cdde0 con 0x7fca2406b180 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.980+0000 7fca23fff700 1 --2- 172.21.15.144:0/4251306045 >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 0x7fca2406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2939c700 1 --2- 172.21.15.144:0/4251306045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca240d1920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca240d3e60 tx=0x7fca1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3dc2e9a49b35fc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca237fe700 1 -- 172.21.15.144:0/4251306045 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00e070 con 0x7fca2406b180 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca237fe700 1 -- 172.21.15.144:0/4251306045 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c00bb20 con 0x7fca2406b180 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca237fe700 1 -- 172.21.15.144:0/4251306045 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c012430 con 0x7fca2406b180 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 -- 172.21.15.144:0/4251306045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 msgr2=0x7fca240d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 --2- 172.21.15.144:0/4251306045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca240d1920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fca240d3e60 tx=0x7fca1c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 -- 172.21.15.144:0/4251306045 shutdown_connections 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 --2- 172.21.15.144:0/4251306045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca240d1920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 --2- 172.21.15.144:0/4251306045 >> v2:172.21.15.145:3300/0 conn(0x7fca24160ee0 0x7fca2406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 -- 172.21.15.144:0/4251306045 >> 172.21.15.144:0/4251306045 conn(0x7fca240d3180 msgr2=0x7fca240d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 -- 172.21.15.144:0/4251306045 shutdown_connections 2023-05-11T07:36:51.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.981+0000 7fca2adff700 1 -- 172.21.15.144:0/4251306045 wait complete. 2023-05-11T07:36:51.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.983+0000 7fca2adff700 1 Processor -- start 2023-05-11T07:36:51.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.983+0000 7fca2adff700 1 -- start start 2023-05-11T07:36:51.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 0x7fca241f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca24160ee0 0x7fca24157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca24159ca0 con 0x7fca2406b180 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca241f3130 con 0x7fca24160ee0 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2adff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240aa830 con 0x7fca2415c940 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca28b9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca28b9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34992/0 (socket says 172.21.15.144:34992) 2023-05-11T07:36:51.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca28b9b700 1 -- 172.21.15.144:0/3706915980 learned_addr learned my addr 172.21.15.144:0/3706915980 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.984+0000 7fca2939c700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca24160ee0 0x7fca24157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca23fff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 0x7fca241f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 -- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 msgr2=0x7fca241f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 0x7fca241f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 -- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca24160ee0 msgr2=0x7fca24157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca24160ee0 0x7fca24157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:51.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 -- 172.21.15.144:0/3706915980 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c009a70 con 0x7fca2406b180 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca23fff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 0x7fca241f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca28b9b700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c730 tx=0x7fca1800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18005d70 con 0x7fca2406b180 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca180070d0 con 0x7fca2406b180 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca240d1400 con 0x7fca2406b180 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18007460 con 0x7fca2406b180 2023-05-11T07:36:51.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.985+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca240d1120 con 0x7fca2406b180 2023-05-11T07:36:51.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.986+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca240b66e0 con 0x7fca2406b180 2023-05-11T07:36:51.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.987+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca180075c0 con 0x7fca2406b180 2023-05-11T07:36:51.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.988+0000 7fca217fa700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 0x7fca0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.988+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca18088de0 con 0x7fca2406b180 2023-05-11T07:36:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.988+0000 7fca23fff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 0x7fca0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.989+0000 7fca23fff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 0x7fca0806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca240aa1f0 tx=0x7fca10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:51.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:51.992+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fca18053ac0 con 0x7fca2406b180 2023-05-11T07:36:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.191+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fca240744c0 con 0x7fca2406b180 2023-05-11T07:36:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.191+0000 7fca217fa700 1 -- 172.21.15.144:0/3706915980 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca180570e0 con 0x7fca2406b180 2023-05-11T07:36:52.194 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.193+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 msgr2=0x7fca0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.193+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 0x7fca0806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca240aa1f0 tx=0x7fca10008040 comp rx=0 tx=0).stop 2023-05-11T07:36:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.193+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 msgr2=0x7fca241566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.193+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c730 tx=0x7fca1800ca40 comp rx=0 tx=0).stop 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 shutdown_connections 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca0806ace0 0x7fca0806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca24160ee0 0x7fca24157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca2406b180 0x7fca241566e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 --2- 172.21.15.144:0/3706915980 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca2415c940 0x7fca241f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 >> 172.21.15.144:0/3706915980 conn(0x7fca240d3180 msgr2=0x7fca240b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 shutdown_connections 2023-05-11T07:36:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.194+0000 7fca2adff700 1 -- 172.21.15.144:0/3706915980 wait complete. 2023-05-11T07:36:52.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:36:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.395+0000 7fb33b9ff700 1 Processor -- start 2023-05-11T07:36:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.396+0000 7fb33b9ff700 1 -- start start 2023-05-11T07:36:52.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3341599e0 0x7fb3340c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb3340b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 0x7fb33406c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340b10c0 con 0x7fb3341599e0 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33415e200 con 0x7fb3340b0c60 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33b9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33415a100 con 0x7fb3340ca020 2023-05-11T07:36:52.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3341599e0 0x7fb3340c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3341599e0 0x7fb3340c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35006/0 (socket says 172.21.15.144:35006) 2023-05-11T07:36:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 -- 172.21.15.144:0/3641379860 learned_addr learned my addr 172.21.15.144:0/3641379860 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb338f9a700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb3340b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb339f9c700 1 --2- 172.21.15.144:0/3641379860 >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 0x7fb33406c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 -- 172.21.15.144:0/3641379860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 msgr2=0x7fb3340b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb3340b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 -- 172.21.15.144:0/3641379860 >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 msgr2=0x7fb33406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.397+0000 7fb33979b700 1 --2- 172.21.15.144:0/3641379860 >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 0x7fb33406c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb33979b700 1 -- 172.21.15.144:0/3641379860 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33415a3e0 con 0x7fb3341599e0 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb339f9c700 1 --2- 172.21.15.144:0/3641379860 >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 0x7fb33406c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb33979b700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3341599e0 0x7fb3340c9ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb33415d2f0 tx=0x7fb330009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38192dcd19b7e119 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb32bfff700 1 -- 172.21.15.144:0/3641379860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330011830 con 0x7fb3341599e0 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb32bfff700 1 -- 172.21.15.144:0/3641379860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330011990 con 0x7fb3341599e0 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb32bfff700 1 -- 172.21.15.144:0/3641379860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330011d20 con 0x7fb3341599e0 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb33b9ff700 1 -- 172.21.15.144:0/3641379860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3341599e0 msgr2=0x7fb3340c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.398+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3341599e0 0x7fb3340c9ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb33415d2f0 tx=0x7fb330009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 -- 172.21.15.144:0/3641379860 shutdown_connections 2023-05-11T07:36:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/3641379860 >> v2:172.21.15.145:3300/0 conn(0x7fb3340b0c60 0x7fb33406c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3341599e0 0x7fb3340c9ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/3641379860 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb3340b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 -- 172.21.15.144:0/3641379860 >> 172.21.15.144:0/3641379860 conn(0x7fb3340cb720 msgr2=0x7fb3340cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 -- 172.21.15.144:0/3641379860 shutdown_connections 2023-05-11T07:36:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.399+0000 7fb33b9ff700 1 -- 172.21.15.144:0/3641379860 wait complete. 2023-05-11T07:36:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.400+0000 7fb33b9ff700 1 Processor -- start 2023-05-11T07:36:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.401+0000 7fb33b9ff700 1 -- start start 2023-05-11T07:36:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.401+0000 7fb33b9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.401+0000 7fb33b9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb334152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.401+0000 7fb33b9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 0x7fb3340711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33b9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33415d150 con 0x7fb3340b0c60 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33b9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33414b8f0 con 0x7fb3341599e0 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33b9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33415c0b0 con 0x7fb3340ca020 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35016/0 (socket says 172.21.15.144:35016) 2023-05-11T07:36:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 -- 172.21.15.144:0/2802385434 learned_addr learned my addr 172.21.15.144:0/2802385434 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb338f9a700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb334152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb339f9c700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 0x7fb3340711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 -- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 msgr2=0x7fb334152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb334152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 -- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 msgr2=0x7fb3340711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 0x7fb3340711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 -- 172.21.15.144:0/2802385434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330009550 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb339f9c700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 0x7fb3340711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.402+0000 7fb33979b700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb330009c10 tx=0x7fb330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.403+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300036a0 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.403+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33001e070 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.403+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33415a9a0 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.403+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330003a60 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.403+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33415a6c0 con 0x7fb3340b0c60 2023-05-11T07:36:52.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.404+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb334159db0 con 0x7fb3340b0c60 2023-05-11T07:36:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.404+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb330003bc0 con 0x7fb3340b0c60 2023-05-11T07:36:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.405+0000 7fb329ffb700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 0x7fb31806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:52.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.406+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb33008a6d0 con 0x7fb3340b0c60 2023-05-11T07:36:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.406+0000 7fb338f9a700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 0x7fb31806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.406+0000 7fb338f9a700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 0x7fb31806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb33415e000 tx=0x7fb324008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:52.412 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.410+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb3300554e0 con 0x7fb3340b0c60 2023-05-11T07:36:52.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.619+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb3340b1700 con 0x7fb3340b0c60 2023-05-11T07:36:52.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.619+0000 7fb329ffb700 1 -- 172.21.15.144:0/2802385434 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb33002c3b0 con 0x7fb3340b0c60 2023-05-11T07:36:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 msgr2=0x7fb31806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 0x7fb31806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb33415e000 tx=0x7fb324008040 comp rx=0 tx=0).stop 2023-05-11T07:36:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 msgr2=0x7fb33414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb330009c10 tx=0x7fb330004750 comp rx=0 tx=0).stop 2023-05-11T07:36:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 shutdown_connections 2023-05-11T07:36:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb31806ace0 0x7fb31806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3341599e0 0x7fb3340711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3340b0c60 0x7fb33414b3b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 --2- 172.21.15.144:0/2802385434 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3340ca020 0x7fb334152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 >> 172.21.15.144:0/2802385434 conn(0x7fb3340cb720 msgr2=0x7fb3341552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 shutdown_connections 2023-05-11T07:36:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:52.622+0000 7fb33b9ff700 1 -- 172.21.15.144:0/2802385434 wait complete. 2023-05-11T07:36:52.628 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:36:52.642 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-05-11T07:36:52.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:52.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-05-11T07:36:52.760 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:36:52.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:52.761 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-11T07:36:52.820 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:52.821 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:52.863 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:52.863 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:52.945 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:36:52.946 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:53.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:53.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.247+0000 7fd5fa7ff700 1 Processor -- start 2023-05-11T07:36:53.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.248+0000 7fd5fa7ff700 1 -- start start 2023-05-11T07:36:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5fa7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5f40d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5fa7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f415cef0 con 0x7fd5f40d02c0 2023-05-11T07:36:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5fa7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f40cd760 con 0x7fd5f40b87e0 2023-05-11T07:36:53.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5fa7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40b5a80 con 0x7fd5f40b52a0 2023-05-11T07:36:53.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5f8d9c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd5f40d02c0 0x7fd5f40d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58816/0 (socket says 172.21.15.144:58816) 2023-05-11T07:36:53.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/2845068419 learned_addr learned my addr 172.21.15.144:0/2845068419 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5f40d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044564720 0 0) 0x7fd5ec001490 con 0x7fd5f40d02c0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.249+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e00035b0 con 0x7fd5f40d02c0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008015929 0 0) 0x7fd5f40cd760 con 0x7fd5f40b87e0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ec001490 con 0x7fd5f40b87e0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223251297 0 0) 0x7fd5e00035b0 con 0x7fd5f40d02c0 2023-05-11T07:36:53.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 msgr2=0x7fd5f40d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5f40d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 >> v1:172.21.15.145:6789/0 conn(0x7fd5f40b87e0 legacy=0x7fd5f40b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40d2d30 con 0x7fd5f40d02c0 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fd5ec001b80 con 0x7fd5f40d02c0 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 >> v1:172.21.15.144:6789/0 conn(0x7fd5f40d02c0 legacy=0x7fd5f40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5e0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0004120 0x7fd5e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5e0004d90 0x7fd5e0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000bba0 con 0x7fd5e0004120 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000bce0 con 0x7fd5e0004d90 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e000be70 con 0x7fd5f40b52a0 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0004120 0x7fd5e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f8d9c700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5e0004d90 0x7fd5e0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.250+0000 7fd5f3fff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5e0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 -- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 msgr2=0x7fd5e0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5f40b52a0 0x7fd5e0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 -- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5e0004d90 msgr2=0x7fd5e0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5e0004d90 0x7fd5e0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 -- 172.21.15.144:0/2845068419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00035b0 con 0x7fd5e0004120 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0004120 0x7fd5e0004850 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40b5690 tx=0x7fd5e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f104e52b2e4d15 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00e6c0 con 0x7fd5e0004120 2023-05-11T07:36:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00e820 con 0x7fd5e0004120 2023-05-11T07:36:53.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.251+0000 7fd5f37fe700 1 -- 172.21.15.144:0/2845068419 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00ebb0 con 0x7fd5e0004120 2023-05-11T07:36:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/2845068419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0004120 msgr2=0x7fd5e0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/2845068419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e0004120 0x7fd5e0004850 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40b5690 tx=0x7fd5e0005880 comp rx=0 tx=0).stop 2023-05-11T07:36:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/2845068419 reap_dead start 2023-05-11T07:36:53.261 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/2845068419 shutdown_connections 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/2845068419 >> 172.21.15.144:0/2845068419 conn(0x7fd5f406acf0 msgr2=0x7fd5f406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/2845068419 shutdown_connections 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.252+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/2845068419 wait complete. 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.253+0000 7fd5fa7ff700 1 Processor -- start 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 -- start start 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 0x7fd5f41efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.262 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 0x7fd5f41f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f41585a0 con 0x7fd5f4157be0 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4155780 con 0x7fd5f40c7e40 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.254+0000 7fd5fa7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c9010 con 0x7fd5e0004120 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35036/0 (socket says 172.21.15.144:35036) 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/297625834 learned_addr learned my addr 172.21.15.144:0/297625834 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:53.263 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 0x7fd5f41f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f3fff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 0x7fd5f41efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 msgr2=0x7fd5f41efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 0x7fd5f41efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 msgr2=0x7fd5f41f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 0x7fd5f41f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 -- 172.21.15.144:0/297625834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40cdc90 con 0x7fd5f4157be0 2023-05-11T07:36:53.264 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5ebfff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 0x7fd5f41f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f3fff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 0x7fd5f41efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.255+0000 7fd5f8d9c700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40d3010 tx=0x7fd5ec007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.256+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec007b10 con 0x7fd5f4157be0 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.256+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0133f0 con 0x7fd5f4157be0 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.256+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40cd9b0 con 0x7fd5f4157be0 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.256+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0137a0 con 0x7fd5f4157be0 2023-05-11T07:36:53.265 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.256+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40b8bb0 con 0x7fd5f4157be0 2023-05-11T07:36:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.257+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f408b830 con 0x7fd5f4157be0 2023-05-11T07:36:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.258+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5ec013900 con 0x7fd5f4157be0 2023-05-11T07:36:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.258+0000 7fd5f17fa700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 0x7fd5d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.266 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.259+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5ec08a0b0 con 0x7fd5f4157be0 2023-05-11T07:36:53.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.259+0000 7fd5f3fff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 0x7fd5d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.259+0000 7fd5f3fff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 0x7fd5d406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.267 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.263+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd5ec058820 con 0x7fd5f4157be0 2023-05-11T07:36:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.455+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5f415cef0 con 0x7fd5f4157be0 2023-05-11T07:36:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.457+0000 7fd5f17fa700 1 -- 172.21.15.144:0/297625834 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fd5f415cef0 con 0x7fd5f4157be0 2023-05-11T07:36:53.459 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:53.460 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:53.461 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 msgr2=0x7fd5d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 0x7fd5d406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007fd0 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 msgr2=0x7fd5f4158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40d3010 tx=0x7fd5ec007340 comp rx=0 tx=0).stop 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 shutdown_connections 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd5d406ace0 0x7fd5d406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd5e0004120 0x7fd5f41efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f4157be0 0x7fd5f4158060 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 --2- 172.21.15.144:0/297625834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40c7e40 0x7fd5f41f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 >> 172.21.15.144:0/297625834 conn(0x7fd5f406acf0 msgr2=0x7fd5f40d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:53.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 shutdown_connections 2023-05-11T07:36:53.463 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.459+0000 7fd5fa7ff700 1 -- 172.21.15.144:0/297625834 wait complete. 2023-05-11T07:36:53.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:53.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.667+0000 7fcce53ff700 1 Processor -- start 2023-05-11T07:36:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.667+0000 7fcce53ff700 1 -- start start 2023-05-11T07:36:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.668+0000 7fcce53ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcce015c940 0x7fcce0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.668+0000 7fcce53ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce00b5fd0 0x7fcce006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.668+0000 7fcce53ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00d0e80 con 0x7fcce00b6420 2023-05-11T07:36:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.668+0000 7fcce53ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce0161420 con 0x7fcce015c940 2023-05-11T07:36:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.668+0000 7fcce53ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00cdb00 con 0x7fcce00b5fd0 2023-05-11T07:36:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcce015c940 0x7fcce0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcce015c940 0x7fcce0160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35052/0 (socket says 172.21.15.144:35052) 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 -- 172.21.15.144:0/1293446448 learned_addr learned my addr 172.21.15.144:0/1293446448 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccd7fff700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce00b5fd0 0x7fcce006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 -- 172.21.15.144:0/1293446448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce00b5fd0 msgr2=0x7fcce006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce00b5fd0 0x7fcce006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 -- 172.21.15.144:0/1293446448 >> v1:172.21.15.145:6789/0 conn(0x7fcce00b6420 legacy=0x7fcce00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 -- 172.21.15.144:0/1293446448 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00cdde0 con 0x7fcce015c940 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.669+0000 7fccdeffd700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce015c940 0x7fcce0160ee0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccd00098f0 tx=0x7fccd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b56ccefb1fbbd5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fccde7fc700 1 -- 172.21.15.144:0/1293446448 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000b8a0 con 0x7fcce015c940 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fccde7fc700 1 -- 172.21.15.144:0/1293446448 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd000ba00 con 0x7fcce015c940 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fccde7fc700 1 -- 172.21.15.144:0/1293446448 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000bd90 con 0x7fcce015c940 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 -- 172.21.15.144:0/1293446448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce015c940 msgr2=0x7fcce0160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce015c940 0x7fcce0160ee0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccd00098f0 tx=0x7fccd0009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 -- 172.21.15.144:0/1293446448 shutdown_connections 2023-05-11T07:36:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce015c940 0x7fcce0160ee0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 --2- 172.21.15.144:0/1293446448 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce00b5fd0 0x7fcce006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 -- 172.21.15.144:0/1293446448 >> 172.21.15.144:0/1293446448 conn(0x7fcce00d3180 msgr2=0x7fcce00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 -- 172.21.15.144:0/1293446448 shutdown_connections 2023-05-11T07:36:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.670+0000 7fcce53ff700 1 -- 172.21.15.144:0/1293446448 wait complete. 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.672+0000 7fcce53ff700 1 Processor -- start 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.672+0000 7fcce53ff700 1 -- start start 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcce00b5fd0 0x7fcce00c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce015c940 0x7fcce01f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00cbc70 con 0x7fcce00b6420 2023-05-11T07:36:53.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00cb8b0 con 0x7fcce00b5fd0 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fcce53ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce01f2f90 con 0x7fcce015c940 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35060/0 (socket says 172.21.15.144:35060) 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.673+0000 7fccd7fff700 1 -- 172.21.15.144:0/3327374219 learned_addr learned my addr 172.21.15.144:0/3327374219 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccdf7fe700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce015c940 0x7fcce01f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccdeffd700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcce00b5fd0 0x7fcce00c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 -- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce015c940 msgr2=0x7fcce01f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce015c940 0x7fcce01f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 -- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcce00b5fd0 msgr2=0x7fcce00c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcce00b5fd0 0x7fcce00c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 -- 172.21.15.144:0/3327374219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009550 con 0x7fcce00b6420 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd7fff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fccc800e810 tx=0x7fccc800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800c070 con 0x7fcce00b6420 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8013610 con 0x7fcce00b6420 2023-05-11T07:36:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce00d1400 con 0x7fcce00b6420 2023-05-11T07:36:53.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.674+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80139c0 con 0x7fcce00b6420 2023-05-11T07:36:53.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.675+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce00d1120 con 0x7fcce00b6420 2023-05-11T07:36:53.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.676+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce015cd10 con 0x7fcce00b6420 2023-05-11T07:36:53.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.677+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccc8013b20 con 0x7fcce00b6420 2023-05-11T07:36:53.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.679+0000 7fccd77fe700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 0x7fccc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:53.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.679+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fccc80894f0 con 0x7fcce00b6420 2023-05-11T07:36:53.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.679+0000 7fccdeffd700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 0x7fccc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:53.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.679+0000 7fccdeffd700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 0x7fccc006d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fccd0014040 tx=0x7fccd0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:53.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.683+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fccc8054280 con 0x7fcce00b6420 2023-05-11T07:36:53.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.878+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcce01f34b0 con 0x7fcce00b6420 2023-05-11T07:36:53.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.879+0000 7fccd77fe700 1 -- 172.21.15.144:0/3327374219 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccc80578a0 con 0x7fcce00b6420 2023-05-11T07:36:53.882 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:53.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 msgr2=0x7fccc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 0x7fccc006d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fccd0014040 tx=0x7fccd0008030 comp rx=0 tx=0).stop 2023-05-11T07:36:53.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 msgr2=0x7fcce01f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fccc800e810 tx=0x7fccc800eb20 comp rx=0 tx=0).stop 2023-05-11T07:36:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 shutdown_connections 2023-05-11T07:36:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fccc006ace0 0x7fccc006d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fcce015c940 0x7fcce01f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcce00b5fd0 0x7fcce00c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 --2- 172.21.15.144:0/3327374219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcce00b6420 0x7fcce01f2450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 >> 172.21.15.144:0/3327374219 conn(0x7fcce00d3180 msgr2=0x7fcce00cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 shutdown_connections 2023-05-11T07:36:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:53.881+0000 7fcce53ff700 1 -- 172.21.15.144:0/3327374219 wait complete. 2023-05-11T07:36:53.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.087+0000 7f4cc65ff700 1 Processor -- start 2023-05-11T07:36:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.087+0000 7f4cc65ff700 1 -- start start 2023-05-11T07:36:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.088+0000 7f4cc65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cc65ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc015e200 con 0x7f4cc00ccee0 2023-05-11T07:36:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cc65ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc015a100 con 0x7f4cc01599e0 2023-05-11T07:36:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cc65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc00b10d0 con 0x7f4cc00b0720 2023-05-11T07:36:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cc4b9c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4cc00ccee0 0x7f4cc00cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58828/0 (socket says 172.21.15.144:58828) 2023-05-11T07:36:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cc4b9c700 1 -- 172.21.15.144:0/1546568143 learned_addr learned my addr 172.21.15.144:0/1546568143 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cb7fff700 1 --2- 172.21.15.144:0/1546568143 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086603066 0 0) 0x7f4cc015e200 con 0x7f4cc00ccee0 2023-05-11T07:36:54.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cac0057c0 con 0x7f4cc00ccee0 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638032037 0 0) 0x7f4cc015a100 con 0x7f4cc01599e0 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc015e200 con 0x7f4cc01599e0 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cb7fff700 1 -- 172.21.15.144:0/1546568143 >> v1:172.21.15.145:6789/0 conn(0x7f4cc01599e0 legacy=0x7f4cc00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cb7fff700 1 -- 172.21.15.144:0/1546568143 >> v1:172.21.15.144:6789/0 conn(0x7f4cc00ccee0 legacy=0x7f4cc00cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.089+0000 7f4cb7fff700 1 -- 172.21.15.144:0/1546568143 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc015a3e0 con 0x7f4cc00b0720 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cb7fff700 1 --2- 172.21.15.144:0/1546568143 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc00b0b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009870 tx=0x7f4ca8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f0ca50f724ba55 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011830 con 0x7f4cc00b0720 2023-05-11T07:36:54.094 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8011990 con 0x7f4cc00b0720 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cbf7fe700 1 -- 172.21.15.144:0/1546568143 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011d20 con 0x7f4cc00b0720 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cc65ff700 1 -- 172.21.15.144:0/1546568143 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 msgr2=0x7f4cc00b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.090+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/1546568143 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc00b0b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009870 tx=0x7f4ca8009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.091+0000 7f4cc65ff700 1 -- 172.21.15.144:0/1546568143 shutdown_connections 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.091+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/1546568143 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc00b0b90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.091+0000 7f4cc65ff700 1 -- 172.21.15.144:0/1546568143 >> 172.21.15.144:0/1546568143 conn(0x7f4cc00cb720 msgr2=0x7f4cc00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:54.095 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.091+0000 7f4cc65ff700 1 -- 172.21.15.144:0/1546568143 shutdown_connections 2023-05-11T07:36:54.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.091+0000 7f4cc65ff700 1 -- 172.21.15.144:0/1546568143 wait complete. 2023-05-11T07:36:54.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.092+0000 7f4cc65ff700 1 Processor -- start 2023-05-11T07:36:54.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 -- start start 2023-05-11T07:36:54.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 0x7f4cc0154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc00c8c40 con 0x7f4cc01599e0 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc015cdc0 con 0x7f4cc00ccee0 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.093+0000 7f4cc65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc015c830 con 0x7f4cc00b0720 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.098 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35064/0 (socket says 172.21.15.144:35064) 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 -- 172.21.15.144:0/2903274393 learned_addr learned my addr 172.21.15.144:0/2903274393 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cb7fff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 0x7f4cc0154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 -- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 msgr2=0x7f4cc015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cbffff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc015c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 -- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 msgr2=0x7f4cc0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 0x7f4cc0154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.099 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 -- 172.21.15.144:0/2903274393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80094a0 con 0x7f4cc01599e0 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cbffff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cb7fff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 0x7f4cc0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.094+0000 7f4cc4b9c700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800cbc0 tx=0x7f4cb800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.095+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800ab50 con 0x7f4cc01599e0 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.095+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800acb0 con 0x7f4cc01599e0 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.095+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc015a9a0 con 0x7f4cc01599e0 2023-05-11T07:36:54.100 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.095+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8012600 con 0x7f4cc01599e0 2023-05-11T07:36:54.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.095+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc015a6c0 con 0x7f4cc01599e0 2023-05-11T07:36:54.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.096+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc0159db0 con 0x7f4cc01599e0 2023-05-11T07:36:54.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.097+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cb801b3b0 con 0x7f4cc01599e0 2023-05-11T07:36:54.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.098+0000 7f4cbd7fa700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 0x7f4ca006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.098+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4cb80893f0 con 0x7f4cc01599e0 2023-05-11T07:36:54.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.098+0000 7f4cbffff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 0x7f4ca006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.098+0000 7f4cbffff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 0x7f4ca006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00011e0 tx=0x7f4cb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.102+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4cb80542b0 con 0x7f4cc01599e0 2023-05-11T07:36:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.293+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4cc00b1700 con 0x7f4cc01599e0 2023-05-11T07:36:54.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.293+0000 7f4cbd7fa700 1 -- 172.21.15.144:0/2903274393 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4cb80578d0 con 0x7f4cc01599e0 2023-05-11T07:36:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.295+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 msgr2=0x7f4ca006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.295+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 0x7f4ca006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00011e0 tx=0x7f4cb0009040 comp rx=0 tx=0).stop 2023-05-11T07:36:54.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.295+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 msgr2=0x7f4cc0146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.295+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800cbc0 tx=0x7f4cb800cf80 comp rx=0 tx=0).stop 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 shutdown_connections 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ca006ace0 0x7f4ca006d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4cc00b0720 0x7f4cc015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cc01599e0 0x7f4cc0146a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 --2- 172.21.15.144:0/2903274393 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4cc00ccee0 0x7f4cc0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 >> 172.21.15.144:0/2903274393 conn(0x7f4cc00cb720 msgr2=0x7f4cc0152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:54.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 shutdown_connections 2023-05-11T07:36:54.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.296+0000 7f4cc65ff700 1 -- 172.21.15.144:0/2903274393 wait complete. 2023-05-11T07:36:54.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:54.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.499+0000 7f880d5ff700 1 Processor -- start 2023-05-11T07:36:54.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.500+0000 7f880d5ff700 1 -- start start 2023-05-11T07:36:54.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f880d5ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f880815cd60 0x7f88080cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f880d5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f88080d0660 0x7f88080b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f880d5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080b1c00 con 0x7f88080b25d0 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f880d5ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080b1340 con 0x7f880815cd60 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f880d5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080b15b0 con 0x7f88080d0660 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f8806ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f880815cd60 0x7f88080cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f8806ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f880815cd60 0x7f88080cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35078/0 (socket says 172.21.15.144:35078) 2023-05-11T07:36:54.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f8806ffd700 1 -- 172.21.15.144:0/3079396837 learned_addr learned my addr 172.21.15.144:0/3079396837 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.501+0000 7f87fffff700 1 --2- 172.21.15.144:0/3079396837 >> v2:172.21.15.145:3300/0 conn(0x7f88080d0660 0x7f88080b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f8806ffd700 1 -- 172.21.15.144:0/3079396837 >> v2:172.21.15.145:3300/0 conn(0x7f88080d0660 msgr2=0x7f88080b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3079396837 >> v2:172.21.15.145:3300/0 conn(0x7f88080d0660 0x7f88080b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f8806ffd700 1 -- 172.21.15.144:0/3079396837 >> v1:172.21.15.145:6789/0 conn(0x7f88080b25d0 legacy=0x7f880806b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f8806ffd700 1 -- 172.21.15.144:0/3079396837 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080b1890 con 0x7f880815cd60 2023-05-11T07:36:54.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3079396837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880815cd60 0x7f88080cfe40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88080b6fc0 tx=0x7f87f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40826a9de242b2cb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f88067fc700 1 -- 172.21.15.144:0/3079396837 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8005e30 con 0x7f880815cd60 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f88067fc700 1 -- 172.21.15.144:0/3079396837 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8004030 con 0x7f880815cd60 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.502+0000 7f88067fc700 1 -- 172.21.15.144:0/3079396837 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80043e0 con 0x7f880815cd60 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 -- 172.21.15.144:0/3079396837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880815cd60 msgr2=0x7f88080cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3079396837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880815cd60 0x7f88080cfe40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88080b6fc0 tx=0x7f87f8009bd0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 -- 172.21.15.144:0/3079396837 shutdown_connections 2023-05-11T07:36:54.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3079396837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880815cd60 0x7f88080cfe40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3079396837 >> v2:172.21.15.145:3300/0 conn(0x7f88080d0660 0x7f88080b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 -- 172.21.15.144:0/3079396837 >> 172.21.15.144:0/3079396837 conn(0x7f880809a2c0 msgr2=0x7f88080d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 -- 172.21.15.144:0/3079396837 shutdown_connections 2023-05-11T07:36:54.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.503+0000 7f880d5ff700 1 -- 172.21.15.144:0/3079396837 wait complete. 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.505+0000 7f880d5ff700 1 Processor -- start 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.505+0000 7f880d5ff700 1 -- start start 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 0x7f88080c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 0x7f88081522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081589c0 con 0x7f88080d0660 2023-05-11T07:36:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c5160 con 0x7f880815cd60 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f880d5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080cb690 con 0x7f88080b25d0 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35086/0 (socket says 172.21.15.144:35086) 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 -- 172.21.15.144:0/3552194119 learned_addr learned my addr 172.21.15.144:0/3552194119 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 0x7f88080c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 -- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 msgr2=0x7f88080c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 0x7f88080c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f88077fe700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 0x7f88081522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.506+0000 7f87fffff700 1 -- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 msgr2=0x7f88081522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87fffff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 0x7f88081522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87fffff700 1 -- 172.21.15.144:0/3552194119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009500 con 0x7f88080d0660 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 0x7f88080c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f88077fe700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 0x7f88081522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87fffff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e840 tx=0x7f87f000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0013610 con 0x7f88080d0660 2023-05-11T07:36:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0013770 con 0x7f88080d0660 2023-05-11T07:36:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080cfb10 con 0x7f88080d0660 2023-05-11T07:36:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0013b20 con 0x7f88080d0660 2023-05-11T07:36:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.507+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080d0380 con 0x7f88080d0660 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.508+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880806baf0 con 0x7f88080d0660 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.509+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87f0013c80 con 0x7f88080d0660 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.510+0000 7f87ff7fe700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.510+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87f0089560 con 0x7f88080d0660 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.510+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.511+0000 7f8806ffd700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 0x7f87e806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f88080b6fc0 tx=0x7f87f8008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.514+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f87f0057cd0 con 0x7f88080d0660 2023-05-11T07:36:54.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.710+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88080744c0 con 0x7f88080d0660 2023-05-11T07:36:54.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.710+0000 7f87ff7fe700 1 -- 172.21.15.144:0/3552194119 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87f0057860 con 0x7f88080d0660 2023-05-11T07:36:54.713 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 msgr2=0x7f87e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 0x7f87e806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f88080b6fc0 tx=0x7f87f8008070 comp rx=0 tx=0).stop 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 msgr2=0x7f88080c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f87f000e840 tx=0x7f87f000ec00 comp rx=0 tx=0).stop 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 shutdown_connections 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f87e806ace0 0x7f87e806d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88080b25d0 0x7f88080c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f880815cd60 0x7f88081522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 --2- 172.21.15.144:0/3552194119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88080d0660 0x7f88080c4a60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 >> 172.21.15.144:0/3552194119 conn(0x7f880809a2c0 msgr2=0x7f880815a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 shutdown_connections 2023-05-11T07:36:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.713+0000 7f880d5ff700 1 -- 172.21.15.144:0/3552194119 wait complete. 2023-05-11T07:36:54.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.916+0000 7f7de6fff700 1 Processor -- start 2023-05-11T07:36:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.916+0000 7f7de6fff700 1 -- start start 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de6fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de01599e0 0x7f7de00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de6fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7de00b0e30 0x7f7de00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de6fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de015e200 con 0x7f7de00ca020 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de6fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de015a100 con 0x7f7de00b0e30 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de6fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015a3e0 con 0x7f7de01599e0 2023-05-11T07:36:54.920 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de559c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7de00b0e30 0x7f7de00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de559c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7de00b0e30 0x7f7de00ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35098/0 (socket says 172.21.15.144:35098) 2023-05-11T07:36:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de559c700 1 -- 172.21.15.144:0/2912380465 learned_addr learned my addr 172.21.15.144:0/2912380465 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:54.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.917+0000 7f7de4d9b700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de01599e0 0x7f7de00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7de559c700 1 -- 172.21.15.144:0/2912380465 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de01599e0 msgr2=0x7f7de00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7de559c700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de01599e0 0x7f7de00c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7de559c700 1 -- 172.21.15.144:0/2912380465 >> v1:172.21.15.145:6789/0 conn(0x7f7de00ca020 legacy=0x7f7de00b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7de559c700 1 -- 172.21.15.144:0/2912380465 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de015a6c0 con 0x7f7de00b0e30 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7de559c700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de00ccee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009e50 tx=0x7f7dd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe592bf8274ab65e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7ddf7fe700 1 -- 172.21.15.144:0/2912380465 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800e070 con 0x7f7de00b0e30 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7ddf7fe700 1 -- 172.21.15.144:0/2912380465 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd800b910 con 0x7f7de00b0e30 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.918+0000 7f7ddf7fe700 1 -- 172.21.15.144:0/2912380465 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800bcc0 con 0x7f7de00b0e30 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 -- 172.21.15.144:0/2912380465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 msgr2=0x7f7de00ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de00ccee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009e50 tx=0x7f7dd800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 -- 172.21.15.144:0/2912380465 shutdown_connections 2023-05-11T07:36:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de00ccee0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2912380465 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de01599e0 0x7f7de00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 -- 172.21.15.144:0/2912380465 >> 172.21.15.144:0/2912380465 conn(0x7f7de00cb720 msgr2=0x7f7de00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 -- 172.21.15.144:0/2912380465 shutdown_connections 2023-05-11T07:36:54.924 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.919+0000 7f7de6fff700 1 -- 172.21.15.144:0/2912380465 wait complete. 2023-05-11T07:36:54.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.921+0000 7f7de6fff700 1 Processor -- start 2023-05-11T07:36:54.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.921+0000 7f7de6fff700 1 -- start start 2023-05-11T07:36:54.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 0x7f7de0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7de01599e0 0x7f7de00c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00c6c60 con 0x7f7de00b0e30 2023-05-11T07:36:54.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de006c2c0 con 0x7f7de01599e0 2023-05-11T07:36:54.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de6fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00c5d70 con 0x7f7de00ca020 2023-05-11T07:36:54.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35110/0 (socket says 172.21.15.144:35110) 2023-05-11T07:36:54.927 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 -- 172.21.15.144:0/2789983159 learned_addr learned my addr 172.21.15.144:0/2789983159 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:54.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7ddffff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 0x7f7de0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 -- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 msgr2=0x7f7de0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 0x7f7de0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 -- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7de01599e0 msgr2=0x7f7de00c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7de01599e0 0x7f7de00c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 -- 172.21.15.144:0/2789983159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8009b30 con 0x7f7de00b0e30 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7ddffff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 0x7f7de0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.923+0000 7f7de4d9b700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e870 tx=0x7f7dd400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.924+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4009590 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.924+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400ee70 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.924+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de0159db0 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.924+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400ca50 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.924+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de015a9a0 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.925+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de00cd420 con 0x7f7de00b0e30 2023-05-11T07:36:54.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.926+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7dd400cbb0 con 0x7f7de00b0e30 2023-05-11T07:36:54.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.928+0000 7f7ddd7fa700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 0x7f7dc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:54.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.928+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7dd4089710 con 0x7f7de00b0e30 2023-05-11T07:36:54.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.928+0000 7f7ddffff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 0x7f7dc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:54.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.928+0000 7f7ddffff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 0x7f7dc406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f4610 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:54.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:54.932+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7dd4057f20 con 0x7f7de00b0e30 2023-05-11T07:36:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.123+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7de00b1700 con 0x7f7de00b0e30 2023-05-11T07:36:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.124+0000 7f7ddd7fa700 1 -- 172.21.15.144:0/2789983159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dd400ce60 con 0x7f7de00b0e30 2023-05-11T07:36:55.127 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 msgr2=0x7f7dc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 0x7f7dc406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7de01f4610 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 msgr2=0x7f7de006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e870 tx=0x7f7dd400ec30 comp rx=0 tx=0).stop 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 shutdown_connections 2023-05-11T07:36:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7dc406ace0 0x7f7dc406d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7de01599e0 0x7f7de00c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7de00b0e30 0x7f7de006bd80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 --2- 172.21.15.144:0/2789983159 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7de00ca020 0x7f7de0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.126+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 >> 172.21.15.144:0/2789983159 conn(0x7f7de00cb720 msgr2=0x7f7de015cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.127+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 shutdown_connections 2023-05-11T07:36:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.127+0000 7f7de6fff700 1 -- 172.21.15.144:0/2789983159 wait complete. 2023-05-11T07:36:55.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.331+0000 7f26843ff700 1 Processor -- start 2023-05-11T07:36:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.331+0000 7f26843ff700 1 -- start start 2023-05-11T07:36:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f26843ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f267c0cfe00 0x7f267c0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f26843ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c0cf640 con 0x7f267c15c930 2023-05-11T07:36:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f26843ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c15cd00 con 0x7f267c0d02a0 2023-05-11T07:36:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f26843ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0cd940 con 0x7f267c0cfe00 2023-05-11T07:36:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268219b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f267c15c930 0x7f267c15d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58834/0 (socket says 172.21.15.144:58834) 2023-05-11T07:36:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268199a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f267c0cfe00 0x7f267c0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268219b700 1 -- 172.21.15.144:0/1550532340 learned_addr learned my addr 172.21.15.144:0/1550532340 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268199a700 1 -- 172.21.15.144:0/1550532340 >> v1:172.21.15.145:6789/0 conn(0x7f267c0d02a0 legacy=0x7f267c1604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268199a700 1 -- 172.21.15.144:0/1550532340 >> v1:172.21.15.144:6789/0 conn(0x7f267c15c930 legacy=0x7f267c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f268199a700 1 -- 172.21.15.144:0/1550532340 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0cdc20 con 0x7f267c0cfe00 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.333+0000 7f2681199700 1 -- 172.21.15.144:0/1550532340 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070131687 0 0) 0x7f267c0cf640 con 0x7f267c15c930 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f268199a700 1 --2- 172.21.15.144:0/1550532340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c0cfe00 0x7f267c0d0db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f266c009870 tx=0x7f266c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fb22fa737f9944 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f2681199700 1 -- 172.21.15.144:0/1550532340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011830 con 0x7f267c0cfe00 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f2681199700 1 -- 172.21.15.144:0/1550532340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c011990 con 0x7f267c0cfe00 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f2681199700 1 -- 172.21.15.144:0/1550532340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011d20 con 0x7f267c0cfe00 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f26843ff700 1 -- 172.21.15.144:0/1550532340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c0cfe00 msgr2=0x7f267c0d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f26843ff700 1 --2- 172.21.15.144:0/1550532340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c0cfe00 0x7f267c0d0db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f266c009870 tx=0x7f266c009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f26843ff700 1 -- 172.21.15.144:0/1550532340 shutdown_connections 2023-05-11T07:36:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f26843ff700 1 --2- 172.21.15.144:0/1550532340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c0cfe00 0x7f267c0d0db0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.334+0000 7f26843ff700 1 -- 172.21.15.144:0/1550532340 >> 172.21.15.144:0/1550532340 conn(0x7f267c072650 msgr2=0x7f267c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.335+0000 7f26843ff700 1 -- 172.21.15.144:0/1550532340 shutdown_connections 2023-05-11T07:36:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.335+0000 7f26843ff700 1 -- 172.21.15.144:0/1550532340 wait complete. 2023-05-11T07:36:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.337+0000 7f26843ff700 1 Processor -- start 2023-05-11T07:36:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.337+0000 7f26843ff700 1 -- start start 2023-05-11T07:36:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f267c0d02a0 0x7f267c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f267c15c930 0x7f267c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cce10 con 0x7f267c14ebf0 2023-05-11T07:36:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cc570 con 0x7f267c0d02a0 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f26843ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cc850 con 0x7f267c15c930 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.338+0000 7f268299c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35122/0 (socket says 172.21.15.144:35122) 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 -- 172.21.15.144:0/2255462470 learned_addr learned my addr 172.21.15.144:0/2255462470 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268199a700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f267c15c930 0x7f267c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268219b700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f267c0d02a0 0x7f267c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 -- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f267c15c930 msgr2=0x7f267c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f267c15c930 0x7f267c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 -- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f267c0d02a0 msgr2=0x7f267c0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f267c0d02a0 0x7f267c0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 -- 172.21.15.144:0/2255462470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0094a0 con 0x7f267c14ebf0 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f268299c700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f267400cc50 tx=0x7f267400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674003c00 con 0x7f267c14ebf0 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674003d60 con 0x7f267c14ebf0 2023-05-11T07:36:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.339+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400aab0 con 0x7f267c14ebf0 2023-05-11T07:36:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.340+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c0cdf00 con 0x7f267c14ebf0 2023-05-11T07:36:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.340+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c0cf8e0 con 0x7f267c14ebf0 2023-05-11T07:36:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.341+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c0cc6b0 con 0x7f267c14ebf0 2023-05-11T07:36:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.342+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f267400ac10 con 0x7f267c14ebf0 2023-05-11T07:36:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.343+0000 7f2672ffd700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 0x7f266006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.343+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f26740896b0 con 0x7f267c14ebf0 2023-05-11T07:36:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.343+0000 7f268219b700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 0x7f266006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.343+0000 7f268219b700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 0x7f266006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678004a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.347+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f267c0cc6b0 con 0x7f267c14ebf0 2023-05-11T07:36:55.541 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.539+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f267c0cc6b0 con 0x7f267c14ebf0 2023-05-11T07:36:55.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.539+0000 7f2672ffd700 1 -- 172.21.15.144:0/2255462470 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f267c0cc6b0 con 0x7f267c14ebf0 2023-05-11T07:36:55.542 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:55.544 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 msgr2=0x7f266006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.544 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 0x7f266006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678004a50 comp rx=0 tx=0).stop 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 msgr2=0x7f267c0b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f267400cc50 tx=0x7f267400cf60 comp rx=0 tx=0).stop 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 shutdown_connections 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f266006ace0 0x7f266006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f267c14ebf0 0x7f267c0b5160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.545 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f267c0d02a0 0x7f267c0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 --2- 172.21.15.144:0/2255462470 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f267c15c930 0x7f267c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 >> 172.21.15.144:0/2255462470 conn(0x7f267c0cfe00 msgr2=0x7f267c0b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:55.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 shutdown_connections 2023-05-11T07:36:55.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.542+0000 7f26843ff700 1 -- 172.21.15.144:0/2255462470 wait complete. 2023-05-11T07:36:55.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:36:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.748+0000 7f7a453ff700 1 Processor -- start 2023-05-11T07:36:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.748+0000 7f7a453ff700 1 -- start start 2023-05-11T07:36:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a453ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a400b49d0 0x7f7a4006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a453ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4006b750 con 0x7f7a4015aaf0 2023-05-11T07:36:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a453ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4015eaa0 con 0x7f7a4015e530 2023-05-11T07:36:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a453ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4015aec0 con 0x7f7a400b49d0 2023-05-11T07:36:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a3effd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7a4015aaf0 0x7f7a400b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58848/0 (socket says 172.21.15.144:58848) 2023-05-11T07:36:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.749+0000 7f7a3effd700 1 -- 172.21.15.144:0/4272946636 learned_addr learned my addr 172.21.15.144:0/4272946636 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3f7fe700 1 --2- 172.21.15.144:0/4272946636 >> v2:172.21.15.144:3300/0 conn(0x7f7a400b49d0 0x7f7a4006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3f7fe700 1 -- 172.21.15.144:0/4272946636 >> v1:172.21.15.145:6789/0 conn(0x7f7a4015e530 legacy=0x7f7a400b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3dffb700 1 -- 172.21.15.144:0/4272946636 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320526609 0 0) 0x7f7a4015eaa0 con 0x7f7a4015e530 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3f7fe700 1 -- 172.21.15.144:0/4272946636 >> v1:172.21.15.144:6789/0 conn(0x7f7a4015aaf0 legacy=0x7f7a400b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3f7fe700 1 -- 172.21.15.144:0/4272946636 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4015ed80 con 0x7f7a400b49d0 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3f7fe700 1 --2- 172.21.15.144:0/4272946636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a400b49d0 0x7f7a4006bbe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009dc0 tx=0x7f7a3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9322bf7753cfaf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3dffb700 1 -- 172.21.15.144:0/4272946636 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800e070 con 0x7f7a400b49d0 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.750+0000 7f7a3dffb700 1 -- 172.21.15.144:0/4272946636 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800bb90 con 0x7f7a400b49d0 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a3dffb700 1 -- 172.21.15.144:0/4272946636 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38012430 con 0x7f7a400b49d0 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 -- 172.21.15.144:0/4272946636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a400b49d0 msgr2=0x7f7a4006bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 --2- 172.21.15.144:0/4272946636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a400b49d0 0x7f7a4006bbe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009dc0 tx=0x7f7a3800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 -- 172.21.15.144:0/4272946636 shutdown_connections 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 --2- 172.21.15.144:0/4272946636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a400b49d0 0x7f7a4006bbe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 -- 172.21.15.144:0/4272946636 >> 172.21.15.144:0/4272946636 conn(0x7f7a400cb720 msgr2=0x7f7a400cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 -- 172.21.15.144:0/4272946636 shutdown_connections 2023-05-11T07:36:55.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.751+0000 7f7a453ff700 1 -- 172.21.15.144:0/4272946636 wait complete. 2023-05-11T07:36:55.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.753+0000 7f7a453ff700 1 Processor -- start 2023-05-11T07:36:55.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.753+0000 7f7a453ff700 1 -- start start 2023-05-11T07:36:55.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a400b49d0 0x7f7a400c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4015e530 0x7f7a401458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015c520 con 0x7f7a4015aaf0 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015c800 con 0x7f7a4015e530 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a453ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015cae0 con 0x7f7a400b49d0 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a3e7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a3e7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35134/0 (socket says 172.21.15.144:35134) 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a3e7fc700 1 -- 172.21.15.144:0/655637119 learned_addr learned my addr 172.21.15.144:0/655637119 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:55.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a3effd700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a400b49d0 0x7f7a400c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.754+0000 7f7a3f7fe700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4015e530 0x7f7a401458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 -- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a400b49d0 msgr2=0x7f7a400c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a400b49d0 0x7f7a400c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 -- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4015e530 msgr2=0x7f7a401458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4015e530 0x7f7a401458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 -- 172.21.15.144:0/655637119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a38009a70 con 0x7f7a4015aaf0 2023-05-11T07:36:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a3e7fc700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c450 tx=0x7f7a3400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340054e0 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34003680 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4015f340 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34003a10 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.755+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4015f060 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.756+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a400c92f0 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.757+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a34003b70 con 0x7f7a4015aaf0 2023-05-11T07:36:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.758+0000 7f7a277fe700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 0x7f7a2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.758+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a34088d10 con 0x7f7a4015aaf0 2023-05-11T07:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.758+0000 7f7a3effd700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 0x7f7a2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.759+0000 7f7a3effd700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 0x7f7a2c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000f60 tx=0x7f7a30007f10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.762+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a3408e020 con 0x7f7a4015aaf0 2023-05-11T07:36:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.969+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a4015eaa0 con 0x7f7a4015aaf0 2023-05-11T07:36:55.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.969+0000 7f7a277fe700 1 -- 172.21.15.144:0/655637119 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7a34017070 con 0x7f7a4015aaf0 2023-05-11T07:36:55.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.971+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 msgr2=0x7f7a2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.971+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 0x7f7a2c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000f60 tx=0x7f7a30007f10 comp rx=0 tx=0).stop 2023-05-11T07:36:55.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.971+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 msgr2=0x7f7a400c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:55.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.971+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c450 tx=0x7f7a3400c760 comp rx=0 tx=0).stop 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.971+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 shutdown_connections 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a2c06ace0 0x7f7a2c06d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a400b49d0 0x7f7a400c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a4015e530 0x7f7a401458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 --2- 172.21.15.144:0/655637119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4015aaf0 0x7f7a400c6c20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 >> 172.21.15.144:0/655637119 conn(0x7f7a400cb720 msgr2=0x7f7a400b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 shutdown_connections 2023-05-11T07:36:55.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:55.972+0000 7f7a453ff700 1 -- 172.21.15.144:0/655637119 wait complete. 2023-05-11T07:36:55.976 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:36:55.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-05-11T07:36:55.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:55.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-05-11T07:36:56.073 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-05-11T07:36:56.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:56.074 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-11T07:36:56.115 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:56.116 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:56.161 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:56.162 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:56.245 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2023-05-11T07:36:56.246 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:36:56.328 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:36:56.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.510+0000 7f76b9dff700 1 Processor -- start 2023-05-11T07:36:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.510+0000 7f76b9dff700 1 -- start start 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b406df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f76b406dac0 0x7f76b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76b4161040 0x7f76b4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406eac0 con 0x7f76b4161040 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406e7e0 con 0x7f76b406dac0 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b9dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b406cfe0 con 0x7f76b415c960 2023-05-11T07:36:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76b4161040 0x7f76b4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76b4161040 0x7f76b4071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46392/0 (socket says 172.21.15.144:46392) 2023-05-11T07:36:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b3fff700 1 -- 172.21.15.144:0/2223353517 learned_addr learned my addr 172.21.15.144:0/2223353517 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b37fe700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.511+0000 7f76b2ffd700 1 --2- 172.21.15.144:0/2223353517 >> v2:172.21.15.145:3300/0 conn(0x7f76b406dac0 0x7f76b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 -- 172.21.15.144:0/2223353517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 msgr2=0x7f76b406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b406df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 -- 172.21.15.144:0/2223353517 >> v2:172.21.15.145:3300/0 conn(0x7f76b406dac0 msgr2=0x7f76b40710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 --2- 172.21.15.144:0/2223353517 >> v2:172.21.15.145:3300/0 conn(0x7f76b406dac0 0x7f76b40710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 -- 172.21.15.144:0/2223353517 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b406d2c0 con 0x7f76b4161040 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b37fe700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b406df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b3fff700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4071600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76b4070c20 tx=0x7f76ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8196d88aa66bc801 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b27fc700 1 -- 172.21.15.144:0/2223353517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00e070 con 0x7f76b4161040 2023-05-11T07:36:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b27fc700 1 -- 172.21.15.144:0/2223353517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00b910 con 0x7f76b4161040 2023-05-11T07:36:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.512+0000 7f76b27fc700 1 -- 172.21.15.144:0/2223353517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00bcc0 con 0x7f76b4161040 2023-05-11T07:36:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 -- 172.21.15.144:0/2223353517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 msgr2=0x7f76b4071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4071600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76b4070c20 tx=0x7f76ac00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 -- 172.21.15.144:0/2223353517 shutdown_connections 2023-05-11T07:36:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4071600 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2223353517 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b406df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2223353517 >> v2:172.21.15.145:3300/0 conn(0x7f76b406dac0 0x7f76b40710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 -- 172.21.15.144:0/2223353517 >> 172.21.15.144:0/2223353517 conn(0x7f76b40b26a0 msgr2=0x7f76b40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 -- 172.21.15.144:0/2223353517 shutdown_connections 2023-05-11T07:36:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.513+0000 7f76b9dff700 1 -- 172.21.15.144:0/2223353517 wait complete. 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.515+0000 7f76b9dff700 1 Processor -- start 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.515+0000 7f76b9dff700 1 -- start start 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40b5150 con 0x7f76b4161040 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4156ea0 con 0x7f76b406dac0 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b9dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415b5a0 con 0x7f76b415c960 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b2ffd700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:36468/0 (socket says 172.21.15.144:36468) 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 -- 172.21.15.144:0/2217520290 learned_addr learned my addr 172.21.15.144:0/2217520290 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 -- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 msgr2=0x7f76b40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b40b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 -- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 msgr2=0x7f76b4155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b37fe700 1 -- 172.21.15.144:0/2217520290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac009b30 con 0x7f76b406dac0 2023-05-11T07:36:56.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.516+0000 7f76b2ffd700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b40b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f76b37fe700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e810 tx=0x7f76a400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4013610 con 0x7f76b406dac0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4013770 con 0x7f76b406dac0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b406e460 con 0x7f76b406dac0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4013b20 con 0x7f76b406dac0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.517+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b406d5a0 con 0x7f76b406dac0 2023-05-11T07:36:56.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.518+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b40ce9a0 con 0x7f76b406dac0 2023-05-11T07:36:56.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.519+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76a4013c80 con 0x7f76b406dac0 2023-05-11T07:36:56.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.520+0000 7f769bfff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.520+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76a40892f0 con 0x7f76b406dac0 2023-05-11T07:36:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.520+0000 7f76b2ffd700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.520+0000 7f76b2ffd700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 0x7f76a006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76b406bc10 tx=0x7f76a8009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:56.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.524+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f76a4057af0 con 0x7f76b406dac0 2023-05-11T07:36:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.719+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76b40b56a0 con 0x7f76b406dac0 2023-05-11T07:36:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.720+0000 7f769bfff700 1 -- 172.21.15.144:0/2217520290 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7f76a4057680 con 0x7f76b406dac0 2023-05-11T07:36:56.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:56.799 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:36:56.800 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 msgr2=0x7f76a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 0x7f76a006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76b406bc10 tx=0x7f76a8009210 comp rx=0 tx=0).stop 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 msgr2=0x7f76b40b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76a400e810 tx=0x7f76a400eb20 comp rx=0 tx=0).stop 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 shutdown_connections 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f76a006ace0 0x7f76a006d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76b4161040 0x7f76b4155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76b406dac0 0x7f76b40b5850 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 --2- 172.21.15.144:0/2217520290 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f76b415c960 0x7f76b40b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 >> 172.21.15.144:0/2217520290 conn(0x7f76b40b26a0 msgr2=0x7f76b406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 shutdown_connections 2023-05-11T07:36:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.723+0000 7f76b9dff700 1 -- 172.21.15.144:0/2217520290 wait complete. 2023-05-11T07:36:56.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:36:56.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:36:56.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.988+0000 7f6b449ff700 1 Processor -- start 2023-05-11T07:36:56.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.988+0000 7f6b449ff700 1 -- start start 2023-05-11T07:36:56.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b449ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b400ce680 0x7f6b4006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b449ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4006d0a0 con 0x7f6b4006cca0 2023-05-11T07:36:56.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b449ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4006b6c0 con 0x7f6b40158f40 2023-05-11T07:36:56.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b449ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4006b9a0 con 0x7f6b400ce680 2023-05-11T07:36:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b3ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b4006cca0 0x7f6b4015cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48998/0 (socket says 172.21.15.144:48998) 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b3ed9d700 1 -- 172.21.15.144:0/1516580693 learned_addr learned my addr 172.21.15.144:0/1516580693 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b37fff700 1 --2- 172.21.15.144:0/1516580693 >> v2:172.21.15.145:3300/0 conn(0x7f6b400ce680 0x7f6b4006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165610379 0 0) 0x7f6b4006d0a0 con 0x7f6b4006cca0 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.990+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b2c0034d0 con 0x7f6b4006cca0 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b37fff700 1 -- 172.21.15.144:0/1516580693 >> v1:172.21.15.145:6789/0 conn(0x7f6b40158f40 legacy=0x7f6b4006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183292341 0 0) 0x7f6b4006b6c0 con 0x7f6b40158f40 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b37fff700 1 -- 172.21.15.144:0/1516580693 >> v1:172.21.15.144:6789/0 conn(0x7f6b4006cca0 legacy=0x7f6b4015cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b37fff700 1 -- 172.21.15.144:0/1516580693 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4006bc80 con 0x7f6b400ce680 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b37fff700 1 --2- 172.21.15.144:0/1516580693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b4006c760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009840 tx=0x7f6b28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c6a0c10dadf853 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28011830 con 0x7f6b400ce680 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b28011990 con 0x7f6b400ce680 2023-05-11T07:36:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.991+0000 7f6b3dd9b700 1 -- 172.21.15.144:0/1516580693 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28011d20 con 0x7f6b400ce680 2023-05-11T07:36:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 -- 172.21.15.144:0/1516580693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 msgr2=0x7f6b4006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1516580693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b4006c760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009840 tx=0x7f6b28009b50 comp rx=0 tx=0).stop 2023-05-11T07:36:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 -- 172.21.15.144:0/1516580693 shutdown_connections 2023-05-11T07:36:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1516580693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b4006c760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 -- 172.21.15.144:0/1516580693 >> 172.21.15.144:0/1516580693 conn(0x7f6b400cb720 msgr2=0x7f6b400cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 -- 172.21.15.144:0/1516580693 shutdown_connections 2023-05-11T07:36:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.992+0000 7f6b449ff700 1 -- 172.21.15.144:0/1516580693 wait complete. 2023-05-11T07:36:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.994+0000 7f6b449ff700 1 Processor -- start 2023-05-11T07:36:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.994+0000 7f6b449ff700 1 -- start start 2023-05-11T07:36:56.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.995+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b4006cca0 0x7f6b400b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.995+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b400b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.995+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:56.999 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b449ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015c1b0 con 0x7f6b40158f40 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b449ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b3c40 con 0x7f6b400ce680 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b449ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b21f0 con 0x7f6b4006cca0 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46416/0 (socket says 172.21.15.144:46416) 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 -- 172.21.15.144:0/1316361424 learned_addr learned my addr 172.21.15.144:0/1316361424 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3e59c700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b4006cca0 0x7f6b400b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b37fff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b400b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 -- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b4006cca0 msgr2=0x7f6b400b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b4006cca0 0x7f6b400b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 -- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 msgr2=0x7f6b400b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b400b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 -- 172.21.15.144:0/1316361424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280094a0 con 0x7f6b40158f40 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.996+0000 7f6b3ed9d700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800cb40 tx=0x7f6b3800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.997+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800ab50 con 0x7f6b40158f40 2023-05-11T07:36:57.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.997+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800acb0 con 0x7f6b40158f40 2023-05-11T07:36:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.997+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38012620 con 0x7f6b40158f40 2023-05-11T07:36:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.997+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4006c240 con 0x7f6b40158f40 2023-05-11T07:36:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.997+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4006bf60 con 0x7f6b40158f40 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.998+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400cdb10 con 0x7f6b40158f40 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:56.999+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b3801b3b0 con 0x7f6b40158f40 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.000+0000 7f6b36ffd700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.000+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b380896a0 con 0x7f6b40158f40 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.000+0000 7f6b3e59c700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.000+0000 7f6b3e59c700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 0x7f6b2006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000f60 tx=0x7f6b30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.004+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b38054380 con 0x7f6b40158f40 2023-05-11T07:36:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.199+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b400744c0 con 0x7f6b40158f40 2023-05-11T07:36:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.200+0000 7f6b36ffd700 1 -- 172.21.15.144:0/1316361424 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b380579a0 con 0x7f6b40158f40 2023-05-11T07:36:57.202 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:36:57.204 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 msgr2=0x7f6b2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 0x7f6b2006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000f60 tx=0x7f6b30009040 comp rx=0 tx=0).stop 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 msgr2=0x7f6b4015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800cb40 tx=0x7f6b3800cf00 comp rx=0 tx=0).stop 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 shutdown_connections 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b4006cca0 0x7f6b400b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b40158f40 0x7f6b4015bc70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 --2- 172.21.15.144:0/1316361424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b400ce680 0x7f6b400b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 >> 172.21.15.144:0/1316361424 conn(0x7f6b400cb720 msgr2=0x7f6b4006fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 shutdown_connections 2023-05-11T07:36:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.202+0000 7f6b449ff700 1 -- 172.21.15.144:0/1316361424 wait complete. 2023-05-11T07:36:57.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:36:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.406+0000 7ff2951ff700 1 Processor -- start 2023-05-11T07:36:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.406+0000 7ff2951ff700 1 -- start start 2023-05-11T07:36:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff2951ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2900d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff2951ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2900d0e80 con 0x7ff29015c940 2023-05-11T07:36:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff2951ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2900cdb00 con 0x7ff290160ee0 2023-05-11T07:36:57.410 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff2951ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900cdde0 con 0x7ff29006b350 2023-05-11T07:36:57.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff28ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff29015c940 0x7ff2900b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49014/0 (socket says 172.21.15.144:49014) 2023-05-11T07:36:57.411 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff28ed9d700 1 -- 172.21.15.144:0/2513109816 learned_addr learned my addr 172.21.15.144:0/2513109816 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:57.413 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff28f59e700 1 --2- 172.21.15.144:0/2513109816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2900d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.413 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312220528 0 0) 0x7ff2900d0e80 con 0x7ff29015c940 2023-05-11T07:36:57.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.408+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff27c0035b0 con 0x7ff29015c940 2023-05-11T07:36:57.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28f59e700 1 -- 172.21.15.144:0/2513109816 >> v1:172.21.15.145:6789/0 conn(0x7ff290160ee0 legacy=0x7ff29006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124507491 0 0) 0x7ff27c0035b0 con 0x7ff29015c940 2023-05-11T07:36:57.414 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28f59e700 1 -- 172.21.15.144:0/2513109816 >> v1:172.21.15.144:6789/0 conn(0x7ff29015c940 legacy=0x7ff2900b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28f59e700 1 -- 172.21.15.144:0/2513109816 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900d1120 con 0x7ff29006b350 2023-05-11T07:36:57.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28f59e700 1 --2- 172.21.15.144:0/2513109816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2900d1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff288009dc0 tx=0x7ff28800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e2237fd3892f9d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.415 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800e070 con 0x7ff29006b350 2023-05-11T07:36:57.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288003a20 con 0x7ff29006b350 2023-05-11T07:36:57.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.409+0000 7ff28e59c700 1 -- 172.21.15.144:0/2513109816 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280001670 con 0x7ff29006b350 2023-05-11T07:36:57.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 -- 172.21.15.144:0/2513109816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 msgr2=0x7ff2900d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.416 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2513109816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2900d1920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff288009dc0 tx=0x7ff28800b330 comp rx=0 tx=0).stop 2023-05-11T07:36:57.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 -- 172.21.15.144:0/2513109816 shutdown_connections 2023-05-11T07:36:57.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2513109816 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2900d1920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 -- 172.21.15.144:0/2513109816 >> 172.21.15.144:0/2513109816 conn(0x7ff2900d3180 msgr2=0x7ff2900d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:57.417 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 -- 172.21.15.144:0/2513109816 shutdown_connections 2023-05-11T07:36:57.418 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.410+0000 7ff2951ff700 1 -- 172.21.15.144:0/2513109816 wait complete. 2023-05-11T07:36:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.411+0000 7ff2951ff700 1 Processor -- start 2023-05-11T07:36:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 -- start start 2023-05-11T07:36:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2901f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff290160ee0 0x7ff2900cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015df00 con 0x7ff29015c940 2023-05-11T07:36:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015e1e0 con 0x7ff290160ee0 2023-05-11T07:36:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.412+0000 7ff2951ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015e4c0 con 0x7ff29006b350 2023-05-11T07:36:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46430/0 (socket says 172.21.15.144:46430) 2023-05-11T07:36:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 -- 172.21.15.144:0/2020660606 learned_addr learned my addr 172.21.15.144:0/2020660606 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff28ed9d700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2901f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff28f59e700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff290160ee0 0x7ff2900cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 -- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 msgr2=0x7ff2901f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2901f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 -- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff290160ee0 msgr2=0x7ff2900cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff290160ee0 0x7ff2900cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.425 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 -- 172.21.15.144:0/2020660606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009a70 con 0x7ff29015c940 2023-05-11T07:36:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.413+0000 7ff287fff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c450 tx=0x7ff27800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.414+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780052d0 con 0x7ff29015c940 2023-05-11T07:36:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.414+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278005430 con 0x7ff29015c940 2023-05-11T07:36:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.414+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2900b66e0 con 0x7ff29015c940 2023-05-11T07:36:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.414+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780038c0 con 0x7ff29015c940 2023-05-11T07:36:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.414+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2900d1400 con 0x7ff29015c940 2023-05-11T07:36:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.415+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff290161330 con 0x7ff29015c940 2023-05-11T07:36:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.416+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff278003a20 con 0x7ff29015c940 2023-05-11T07:36:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.416+0000 7ff2877fe700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 0x7ff27006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.417+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff278088ae0 con 0x7ff29015c940 2023-05-11T07:36:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.417+0000 7ff28ed9d700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 0x7ff27006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.417+0000 7ff28ed9d700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 0x7ff27006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff280000f60 tx=0x7ff280001e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.421+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff278053850 con 0x7ff29015c940 2023-05-11T07:36:57.617 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.615+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2900744c0 con 0x7ff29015c940 2023-05-11T07:36:57.618 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.615+0000 7ff2877fe700 1 -- 172.21.15.144:0/2020660606 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff27800ce60 con 0x7ff29015c940 2023-05-11T07:36:57.618 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:36:57.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 msgr2=0x7ff27006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.620 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 0x7ff27006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff280000f60 tx=0x7ff280001e40 comp rx=0 tx=0).stop 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 msgr2=0x7ff29015ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c450 tx=0x7ff27800c760 comp rx=0 tx=0).stop 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 shutdown_connections 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff27006ace0 0x7ff27006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff29006b350 0x7ff2901f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff290160ee0 0x7ff2900cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 --2- 172.21.15.144:0/2020660606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff29015c940 0x7ff29015ef80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 >> 172.21.15.144:0/2020660606 conn(0x7ff2900d3180 msgr2=0x7ff290159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:57.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 shutdown_connections 2023-05-11T07:36:57.622 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.618+0000 7ff2951ff700 1 -- 172.21.15.144:0/2020660606 wait complete. 2023-05-11T07:36:57.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:36:57.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.824+0000 7f95dadff700 1 Processor -- start 2023-05-11T07:36:57.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.824+0000 7f95dadff700 1 -- start start 2023-05-11T07:36:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.825+0000 7f95dadff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d4160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95dadff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95d406b350 0x7f95d40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95dadff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d40d0e80 con 0x7f95d40b5fd0 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95dadff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d4161420 con 0x7f95d406b350 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95dadff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40cdb00 con 0x7f95d415c940 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95d406b350 0x7f95d40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95d406b350 0x7f95d40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46446/0 (socket says 172.21.15.144:46446) 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 -- 172.21.15.144:0/3072197769 learned_addr learned my addr 172.21.15.144:0/3072197769 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:57.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d8b9b700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d4160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 -- 172.21.15.144:0/3072197769 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 msgr2=0x7f95d4160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d4160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 -- 172.21.15.144:0/3072197769 >> v1:172.21.15.145:6789/0 conn(0x7f95d40b5fd0 legacy=0x7f95d406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.826+0000 7f95d939c700 1 -- 172.21.15.144:0/3072197769 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40cdde0 con 0x7f95d406b350 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95d939c700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d406b350 0x7f95d40d1920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009e50 tx=0x7f95cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290693133929e9df server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95d37fe700 1 -- 172.21.15.144:0/3072197769 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00e070 con 0x7f95d406b350 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95d37fe700 1 -- 172.21.15.144:0/3072197769 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00b910 con 0x7f95d406b350 2023-05-11T07:36:57.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95d37fe700 1 -- 172.21.15.144:0/3072197769 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00bcc0 con 0x7f95d406b350 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 -- 172.21.15.144:0/3072197769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d406b350 msgr2=0x7f95d40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d406b350 0x7f95d40d1920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009e50 tx=0x7f95cc00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 -- 172.21.15.144:0/3072197769 shutdown_connections 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d406b350 0x7f95d40d1920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 --2- 172.21.15.144:0/3072197769 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d4160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 -- 172.21.15.144:0/3072197769 >> 172.21.15.144:0/3072197769 conn(0x7f95d40d3180 msgr2=0x7f95d40d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 -- 172.21.15.144:0/3072197769 shutdown_connections 2023-05-11T07:36:57.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.827+0000 7f95dadff700 1 -- 172.21.15.144:0/3072197769 wait complete. 2023-05-11T07:36:57.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.829+0000 7f95dadff700 1 Processor -- start 2023-05-11T07:36:57.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.829+0000 7f95dadff700 1 -- start start 2023-05-11T07:36:57.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95d406b350 0x7f95d415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d40c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41f68b0 con 0x7f95d40b5fd0 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d415c1d0 con 0x7f95d406b350 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95dadff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41594c0 con 0x7f95d415c940 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46458/0 (socket says 172.21.15.144:46458) 2023-05-11T07:36:57.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95d3fff700 1 -- 172.21.15.144:0/61628583 learned_addr learned my addr 172.21.15.144:0/61628583 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95d8b9b700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95d406b350 0x7f95d415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.830+0000 7f95d939c700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d40c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 -- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 msgr2=0x7f95d40c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d40c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 -- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95d406b350 msgr2=0x7f95d415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95d406b350 0x7f95d415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 -- 172.21.15.144:0/61628583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc009b30 con 0x7f95d40b5fd0 2023-05-11T07:36:57.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d3fff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c4e0 tx=0x7f95c000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00052d0 con 0x7f95d40b5fd0 2023-05-11T07:36:57.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0005430 con 0x7f95d40b5fd0 2023-05-11T07:36:57.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00038c0 con 0x7f95d40b5fd0 2023-05-11T07:36:57.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d40d1400 con 0x7f95d40b5fd0 2023-05-11T07:36:57.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.831+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d40d1120 con 0x7f95d40b5fd0 2023-05-11T07:36:57.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.833+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d415cd10 con 0x7f95d40b5fd0 2023-05-11T07:36:57.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.833+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95c0003a20 con 0x7f95d40b5fd0 2023-05-11T07:36:57.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.834+0000 7f95d17fa700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 0x7f95b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:57.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.835+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95c0088ac0 con 0x7f95d40b5fd0 2023-05-11T07:36:57.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.835+0000 7f95d8b9b700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 0x7f95b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:57.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.835+0000 7f95d8b9b700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 0x7f95b806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009b40 tx=0x7f95c8009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:57.841 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:57.839+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95c00538d0 con 0x7f95d40b5fd0 2023-05-11T07:36:58.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.031+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95d40744c0 con 0x7f95d40b5fd0 2023-05-11T07:36:58.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.032+0000 7f95d17fa700 1 -- 172.21.15.144:0/61628583 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95c0056ef0 con 0x7f95d40b5fd0 2023-05-11T07:36:58.035 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 msgr2=0x7f95b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 0x7f95b806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009b40 tx=0x7f95c8009210 comp rx=0 tx=0).stop 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 msgr2=0x7f95d414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95c000c4e0 tx=0x7f95c000c7f0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 shutdown_connections 2023-05-11T07:36:58.037 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f95b806ace0 0x7f95b806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f95d415c940 0x7f95d40c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95d406b350 0x7f95d415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 --2- 172.21.15.144:0/61628583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95d40b5fd0 0x7f95d414bb70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 >> 172.21.15.144:0/61628583 conn(0x7f95d40d3180 msgr2=0x7f95d40b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 shutdown_connections 2023-05-11T07:36:58.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.034+0000 7f95dadff700 1 -- 172.21.15.144:0/61628583 wait complete. 2023-05-11T07:36:58.054 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:36:58.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.238+0000 7f968abff700 1 Processor -- start 2023-05-11T07:36:58.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.238+0000 7f968abff700 1 -- start start 2023-05-11T07:36:58.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f968abff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9684167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f968abff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96840cf640 con 0x7f96840cfe00 2023-05-11T07:36:58.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f968abff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968415cd00 con 0x7f968415c930 2023-05-11T07:36:58.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f968abff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cd940 con 0x7f96840d14c0 2023-05-11T07:36:58.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f9683fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f96840cfe00 0x7f96840d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49022/0 (socket says 172.21.15.144:49022) 2023-05-11T07:36:58.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f9683fff700 1 -- 172.21.15.144:0/2402817861 learned_addr learned my addr 172.21.15.144:0/2402817861 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f968919c700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9684167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237313538 0 0) 0x7f96840cf640 con 0x7f96840cfe00 2023-05-11T07:36:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96740035b0 con 0x7f96840cfe00 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.240+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712691167 0 0) 0x7f968415cd00 con 0x7f968415c930 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96840cf640 con 0x7f968415c930 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787515206 0 0) 0x7f96740035b0 con 0x7f96840cfe00 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 msgr2=0x7f9684167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9684167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 >> v1:172.21.15.145:6789/0 conn(0x7f968415c930 legacy=0x7f968415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840cdc20 con 0x7f96840cfe00 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f9670001670 con 0x7f96840cfe00 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968919c700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9684167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 >> v1:172.21.15.144:6789/0 conn(0x7f96840cfe00 legacy=0x7f96840d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9674003bc0 0x7f9674003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9674004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9674004d90 0x7f9674005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cd940 con 0x7f9674003bc0 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967400bac0 con 0x7f9674004d90 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967400bc00 con 0x7f96840d14c0 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968899b700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9674003bc0 0x7f9674003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968919c700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9674004d90 0x7f9674005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f9683fff700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9674004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968899b700 1 -- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 msgr2=0x7f9674004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968899b700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96840d14c0 0x7f9674004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968899b700 1 -- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9674004d90 msgr2=0x7f9674005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.241+0000 7f968899b700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9674004d90 0x7f9674005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f968899b700 1 -- 172.21.15.144:0/2402817861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009a70 con 0x7f9674003bc0 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f968899b700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9674003bc0 0x7f9674003fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9678001940 tx=0x7f9674005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d922b515880a14 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678001430 con 0x7f9674003bc0 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678001d70 con 0x7f9674003bc0 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f96837fe700 1 -- 172.21.15.144:0/2402817861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678005510 con 0x7f9674003bc0 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f968abff700 1 -- 172.21.15.144:0/2402817861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9674003bc0 msgr2=0x7f9674003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f968abff700 1 --2- 172.21.15.144:0/2402817861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9674003bc0 0x7f9674003fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9678001940 tx=0x7f9674005880 comp rx=0 tx=0).stop 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.242+0000 7f968919c700 1 -- 172.21.15.144:0/2402817861 reap_dead start 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.243+0000 7f968abff700 1 -- 172.21.15.144:0/2402817861 shutdown_connections 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.243+0000 7f968abff700 1 -- 172.21.15.144:0/2402817861 >> 172.21.15.144:0/2402817861 conn(0x7f9684072650 msgr2=0x7f968406acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.243+0000 7f968abff700 1 -- 172.21.15.144:0/2402817861 shutdown_connections 2023-05-11T07:36:58.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.243+0000 7f968abff700 1 -- 172.21.15.144:0/2402817861 wait complete. 2023-05-11T07:36:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.244+0000 7f968abff700 1 Processor -- start 2023-05-11T07:36:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 -- start start 2023-05-11T07:36:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96841e2830 0x7f96841e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96841e6a50 0x7f96841e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841e7430 con 0x7f96840c7990 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840c7f00 con 0x7f96841e6a50 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.245+0000 7f968abff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840cc5d0 con 0x7f96841e2830 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46476/0 (socket says 172.21.15.144:46476) 2023-05-11T07:36:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 -- 172.21.15.144:0/4229730397 learned_addr learned my addr 172.21.15.144:0/4229730397 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f968899b700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96841e2830 0x7f96841e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f968919c700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96841e6a50 0x7f96841e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 -- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96841e2830 msgr2=0x7f96841e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96841e2830 0x7f96841e2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 -- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96841e6a50 msgr2=0x7f96841e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96841e6a50 0x7f96841e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 -- 172.21.15.144:0/4229730397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840cdf00 con 0x7f96840c7990 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f9683fff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9670007340 tx=0x7f9670007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.246+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000f660 con 0x7f96840c7990 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.247+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967000f7c0 con 0x7f96840c7990 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.247+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96840cf8e0 con 0x7f96840c7990 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.247+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000fb70 con 0x7f96840c7990 2023-05-11T07:36:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.247+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96840ce090 con 0x7f96840c7990 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.248+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840744c0 con 0x7f96840c7990 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.248+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f967000fcd0 con 0x7f96840c7990 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.250+0000 7f96817fa700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 0x7f966806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.250+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9670089740 con 0x7f96840c7990 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.250+0000 7f968899b700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 0x7f966806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.259 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.251+0000 7f968899b700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 0x7f966806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9678005040 tx=0x7f967800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.260 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.254+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f96700544b0 con 0x7f96840c7990 2023-05-11T07:36:58.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.445+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f968406b660 con 0x7f96840c7990 2023-05-11T07:36:58.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.445+0000 7f96817fa700 1 -- 172.21.15.144:0/4229730397 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9670057ad0 con 0x7f96840c7990 2023-05-11T07:36:58.448 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:36:58.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 msgr2=0x7f966806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 0x7f966806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9678005040 tx=0x7f967800a000 comp rx=0 tx=0).stop 2023-05-11T07:36:58.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 msgr2=0x7f96840cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9670007340 tx=0x7f9670007650 comp rx=0 tx=0).stop 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 shutdown_connections 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f966806ace0 0x7f966806d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f96841e2830 0x7f96841e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96841e6a50 0x7f96841e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 --2- 172.21.15.144:0/4229730397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96840c7990 0x7f96840cbcb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 >> 172.21.15.144:0/4229730397 conn(0x7f9674003bc0 msgr2=0x7f96840d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:58.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 shutdown_connections 2023-05-11T07:36:58.452 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.448+0000 7f968abff700 1 -- 172.21.15.144:0/4229730397 wait complete. 2023-05-11T07:36:58.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:36:58.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.655+0000 7f6c531ff700 1 Processor -- start 2023-05-11T07:36:58.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.655+0000 7f6c531ff700 1 -- start start 2023-05-11T07:36:58.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.656+0000 7f6c531ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4c15c930 0x7f6c4c15d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.656+0000 7f6c531ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0cfe00 0x7f6c4c0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.656+0000 7f6c531ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c15de80 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.656+0000 7f6c531ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c0cf640 con 0x7f6c4c15c930 2023-05-11T07:36:58.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.656+0000 7f6c531ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c15cd00 con 0x7f6c4c0cfe00 2023-05-11T07:36:58.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4c15c930 0x7f6c4c15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4c15c930 0x7f6c4c15d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46484/0 (socket says 172.21.15.144:46484) 2023-05-11T07:36:58.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2426753500 learned_addr learned my addr 172.21.15.144:0/2426753500 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:58.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c4bfff700 1 --2- 172.21.15.144:0/2426753500 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0cfe00 0x7f6c4c0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2426753500 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0cfe00 msgr2=0x7f6c4c0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:58.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 --2- 172.21.15.144:0/2426753500 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0cfe00 0x7f6c4c0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2426753500 >> v1:172.21.15.145:6789/0 conn(0x7f6c4c0d02a0 legacy=0x7f6c4c0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.657+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2426753500 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0cd940 con 0x7f6c4c15c930 2023-05-11T07:36:58.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c50f9b700 1 --2- 172.21.15.144:0/2426753500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c15c930 0x7f6c4c15d940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098f0 tx=0x7f6c40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508bec53e262a580 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c4b7fe700 1 -- 172.21.15.144:0/2426753500 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40011830 con 0x7f6c4c15c930 2023-05-11T07:36:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c4b7fe700 1 -- 172.21.15.144:0/2426753500 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40011990 con 0x7f6c4c15c930 2023-05-11T07:36:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c4b7fe700 1 -- 172.21.15.144:0/2426753500 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40011d20 con 0x7f6c4c15c930 2023-05-11T07:36:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 -- 172.21.15.144:0/2426753500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c15c930 msgr2=0x7f6c4c15d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2426753500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c15c930 0x7f6c4c15d940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098f0 tx=0x7f6c40009c00 comp rx=0 tx=0).stop 2023-05-11T07:36:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 -- 172.21.15.144:0/2426753500 shutdown_connections 2023-05-11T07:36:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2426753500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c15c930 0x7f6c4c15d940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2426753500 >> v2:172.21.15.145:3300/0 conn(0x7f6c4c0cfe00 0x7f6c4c0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.658+0000 7f6c531ff700 1 -- 172.21.15.144:0/2426753500 >> 172.21.15.144:0/2426753500 conn(0x7f6c4c072650 msgr2=0x7f6c4c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:58.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.659+0000 7f6c531ff700 1 -- 172.21.15.144:0/2426753500 shutdown_connections 2023-05-11T07:36:58.668 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.659+0000 7f6c531ff700 1 -- 172.21.15.144:0/2426753500 wait complete. 2023-05-11T07:36:58.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.661+0000 7f6c531ff700 1 Processor -- start 2023-05-11T07:36:58.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.661+0000 7f6c531ff700 1 -- start start 2023-05-11T07:36:58.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c15c930 0x7f6c4c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 0x7f6c4c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0c9a10 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1f66b0 con 0x7f6c4c15c930 2023-05-11T07:36:58.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c531ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1f5e10 con 0x7f6c4c14ed50 2023-05-11T07:36:58.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.662+0000 7f6c50f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46496/0 (socket says 172.21.15.144:46496) 2023-05-11T07:36:58.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2074871453 learned_addr learned my addr 172.21.15.144:0/2074871453 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:58.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c4bfff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c15c930 0x7f6c4c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c5179c700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 0x7f6c4c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 msgr2=0x7f6c4c1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 0x7f6c4c1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c15c930 msgr2=0x7f6c4c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c15c930 0x7f6c4c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 -- 172.21.15.144:0/2074871453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009550 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c5179c700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 0x7f6c4c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:36:58.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c50f9b700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009130 tx=0x7f6c40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.663+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40004590 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.664+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4001e070 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.664+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0cf8e0 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.664+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400038c0 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.664+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0cdc20 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.665+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c0cdf00 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.665+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c40003a20 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.667+0000 7f6c497fa700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 0x7f6c3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:58.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.667+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c4008a680 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.667+0000 7f6c4bfff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 0x7f6c3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:58.679 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.667+0000 7f6c4bfff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 0x7f6c3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009be0 tx=0x7f6c38009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:58.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.671+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6c40055490 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.866 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.864+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c4c0744c0 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.867 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.864+0000 7f6c497fa700 1 -- 172.21.15.144:0/2074871453 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c40058ab0 con 0x7f6c4c0d02a0 2023-05-11T07:36:58.867 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:36:58.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 msgr2=0x7f6c3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 0x7f6c3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009be0 tx=0x7f6c38009210 comp rx=0 tx=0).stop 2023-05-11T07:36:58.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 msgr2=0x7f6c4c1f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009130 tx=0x7f6c40004750 comp rx=0 tx=0).stop 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 shutdown_connections 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6c3006ace0 0x7f6c3006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6c4c14ed50 0x7f6c4c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4c0d02a0 0x7f6c4c1f5750 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 --2- 172.21.15.144:0/2074871453 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c15c930 0x7f6c4c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.866+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 >> 172.21.15.144:0/2074871453 conn(0x7f6c4c0cfe00 msgr2=0x7f6c4c0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.867+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 shutdown_connections 2023-05-11T07:36:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:58.867+0000 7f6c531ff700 1 -- 172.21.15.144:0/2074871453 wait complete. 2023-05-11T07:36:58.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T07:36:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.070+0000 7fbe165ff700 1 Processor -- start 2023-05-11T07:36:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.070+0000 7fbe165ff700 1 -- start start 2023-05-11T07:36:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe165ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 0x7fbe10160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe165ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100d0e80 con 0x7fbe1006b350 2023-05-11T07:36:59.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe165ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100cdb00 con 0x7fbe100b5fd0 2023-05-11T07:36:59.074 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe165ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10161420 con 0x7fbe1015c940 2023-05-11T07:36:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe14b9c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbe1006b350 0x7fbe100d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49026/0 (socket says 172.21.15.144:49026) 2023-05-11T07:36:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe14b9c700 1 -- 172.21.15.144:0/170702428 learned_addr learned my addr 172.21.15.144:0/170702428 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:36:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.071+0000 7fbe0ffff700 1 --2- 172.21.15.144:0/170702428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 0x7fbe10160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826171292 0 0) 0x7fbe100d0e80 con 0x7fbe1006b350 2023-05-11T07:36:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf80035b0 con 0x7fbe1006b350 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0ffff700 1 -- 172.21.15.144:0/170702428 >> v1:172.21.15.145:6789/0 conn(0x7fbe100b5fd0 legacy=0x7fbe1006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861423227 0 0) 0x7fbe100cdb00 con 0x7fbe100b5fd0 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0ffff700 1 -- 172.21.15.144:0/170702428 >> v1:172.21.15.144:6789/0 conn(0x7fbe1006b350 legacy=0x7fbe100d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0ffff700 1 -- 172.21.15.144:0/170702428 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100cdde0 con 0x7fbe1015c940 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.072+0000 7fbe0ffff700 1 --2- 172.21.15.144:0/170702428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 0x7fbe10160ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009870 tx=0x7fbe00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4120eeefadcae922 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00011830 con 0x7fbe1015c940 2023-05-11T07:36:59.076 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00011990 con 0x7fbe1015c940 2023-05-11T07:36:59.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe0effd700 1 -- 172.21.15.144:0/170702428 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00011d20 con 0x7fbe1015c940 2023-05-11T07:36:59.077 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 -- 172.21.15.144:0/170702428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 msgr2=0x7fbe10160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 --2- 172.21.15.144:0/170702428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 0x7fbe10160ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009870 tx=0x7fbe00009b80 comp rx=0 tx=0).stop 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 -- 172.21.15.144:0/170702428 shutdown_connections 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 --2- 172.21.15.144:0/170702428 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1015c940 0x7fbe10160ee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 -- 172.21.15.144:0/170702428 >> 172.21.15.144:0/170702428 conn(0x7fbe100d3180 msgr2=0x7fbe100d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 -- 172.21.15.144:0/170702428 shutdown_connections 2023-05-11T07:36:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.073+0000 7fbe165ff700 1 -- 172.21.15.144:0/170702428 wait complete. 2023-05-11T07:36:59.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.075+0000 7fbe165ff700 1 Processor -- start 2023-05-11T07:36:59.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.076+0000 7fbe165ff700 1 -- start start 2023-05-11T07:36:59.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1006b350 0x7fbe101f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe100b5fd0 0x7fbe101f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe101f2160 con 0x7fbe1015c940 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100caeb0 con 0x7fbe100b5fd0 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe165ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100cb190 con 0x7fbe1006b350 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe14b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.081 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe14b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46506/0 (socket says 172.21.15.144:46506) 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe14b9c700 1 -- 172.21.15.144:0/1138037380 learned_addr learned my addr 172.21.15.144:0/1138037380 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe0ffff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1006b350 0x7fbe101f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.077+0000 7fbe0f7fe700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe100b5fd0 0x7fbe101f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 -- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1006b350 msgr2=0x7fbe101f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1006b350 0x7fbe101f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 -- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe100b5fd0 msgr2=0x7fbe101f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe100b5fd0 0x7fbe101f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.082 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 -- 172.21.15.144:0/1138037380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000094a0 con 0x7fbe1015c940 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe14b9c700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800cb40 tx=0x7fbe0800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0800a9e0 con 0x7fbe1015c940 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0800ab40 con 0x7fbe1015c940 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08012400 con 0x7fbe1015c940 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100d1400 con 0x7fbe1015c940 2023-05-11T07:36:59.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.078+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe100d1120 con 0x7fbe1015c940 2023-05-11T07:36:59.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.079+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1015cd10 con 0x7fbe1015c940 2023-05-11T07:36:59.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.080+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe0801b3b0 con 0x7fbe1015c940 2023-05-11T07:36:59.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.081+0000 7fbe0cff9700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 0x7fbdfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.084 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.082+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe08089440 con 0x7fbe1015c940 2023-05-11T07:36:59.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.082+0000 7fbe0ffff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 0x7fbdfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.085 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.082+0000 7fbe0ffff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 0x7fbdfc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe000097c0 tx=0x7fbe0001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.088 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.086+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe080541d0 con 0x7fbe1015c940 2023-05-11T07:36:59.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.295+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe100744c0 con 0x7fbe1015c940 2023-05-11T07:36:59.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.296+0000 7fbe0cff9700 1 -- 172.21.15.144:0/1138037380 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe080577f0 con 0x7fbe1015c940 2023-05-11T07:36:59.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 msgr2=0x7fbdfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 0x7fbdfc06d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe000097c0 tx=0x7fbe0001c040 comp rx=0 tx=0).stop 2023-05-11T07:36:59.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 msgr2=0x7fbe101f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.301 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800cb40 tx=0x7fbe0800ce50 comp rx=0 tx=0).stop 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 shutdown_connections 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbdfc06ace0 0x7fbdfc06d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbe1006b350 0x7fbe101f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1015c940 0x7fbe101f5dc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 --2- 172.21.15.144:0/1138037380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe100b5fd0 0x7fbe101f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.298+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 >> 172.21.15.144:0/1138037380 conn(0x7fbe100d3180 msgr2=0x7fbe1015d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.299+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 shutdown_connections 2023-05-11T07:36:59.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.299+0000 7fbe165ff700 1 -- 172.21.15.144:0/1138037380 wait complete. 2023-05-11T07:36:59.303 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2023-05-11T07:36:59.318 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-05-11T07:36:59.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:59.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-05-11T07:36:59.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi145.front.sepia.ceph.com 2023-05-11T07:36:59.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:36:59.407 DEBUG:teuthology.orchestra.run.smithi145:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-11T07:36:59.451 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-11T07:36:59.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:36:59.638 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.636+0000 7f191a9ff700 1 Processor -- start 2023-05-11T07:36:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.636+0000 7f191a9ff700 1 -- start start 2023-05-11T07:36:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.637+0000 7f191a9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1914158be0 0x7f19140ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.637+0000 7f191a9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191406beb0 0x7f1914070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.637+0000 7f191a9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19140cb2b0 con 0x7f191406af50 2023-05-11T07:36:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.637+0000 7f191a9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19140c9790 con 0x7f191406beb0 2023-05-11T07:36:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.637+0000 7f191a9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191406c2c0 con 0x7f1914158be0 2023-05-11T07:36:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191406beb0 0x7f1914070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191406beb0 0x7f1914070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46510/0 (socket says 172.21.15.144:46510) 2023-05-11T07:36:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 -- 172.21.15.144:0/769584033 learned_addr learned my addr 172.21.15.144:0/769584033 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1913fff700 1 --2- 172.21.15.144:0/769584033 >> v2:172.21.15.145:3300/0 conn(0x7f1914158be0 0x7f19140ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 -- 172.21.15.144:0/769584033 >> v2:172.21.15.145:3300/0 conn(0x7f1914158be0 msgr2=0x7f19140ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:36:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 --2- 172.21.15.144:0/769584033 >> v2:172.21.15.145:3300/0 conn(0x7f1914158be0 0x7f19140ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 -- 172.21.15.144:0/769584033 >> v1:172.21.15.145:6789/0 conn(0x7f191406af50 legacy=0x7f191406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 -- 172.21.15.144:0/769584033 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191415d3c0 con 0x7f191406beb0 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1918f9c700 1 --2- 172.21.15.144:0/769584033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191406beb0 0x7f1914070f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f191406d390 tx=0x7f190c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38910fdc950d288f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.638+0000 7f1912ffd700 1 -- 172.21.15.144:0/769584033 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00e070 con 0x7f191406beb0 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f1912ffd700 1 -- 172.21.15.144:0/769584033 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00b910 con 0x7f191406beb0 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f1912ffd700 1 -- 172.21.15.144:0/769584033 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00bcc0 con 0x7f191406beb0 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 -- 172.21.15.144:0/769584033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191406beb0 msgr2=0x7f1914070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 --2- 172.21.15.144:0/769584033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191406beb0 0x7f1914070f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f191406d390 tx=0x7f190c00b330 comp rx=0 tx=0).stop 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 -- 172.21.15.144:0/769584033 shutdown_connections 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 --2- 172.21.15.144:0/769584033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191406beb0 0x7f1914070f00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 --2- 172.21.15.144:0/769584033 >> v2:172.21.15.145:3300/0 conn(0x7f1914158be0 0x7f19140ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 -- 172.21.15.144:0/769584033 >> 172.21.15.144:0/769584033 conn(0x7f19140cb7e0 msgr2=0x7f19140cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 -- 172.21.15.144:0/769584033 shutdown_connections 2023-05-11T07:36:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.639+0000 7f191a9ff700 1 -- 172.21.15.144:0/769584033 wait complete. 2023-05-11T07:36:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.641+0000 7f191a9ff700 1 Processor -- start 2023-05-11T07:36:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.641+0000 7f191a9ff700 1 -- start start 2023-05-11T07:36:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 0x7f19141554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191406beb0 0x7f19140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141563e0 con 0x7f1914158be0 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b3220 con 0x7f191406beb0 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f191a9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b3500 con 0x7f191406af50 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f1918f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f1913fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 0x7f19141554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f1918f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46524/0 (socket says 172.21.15.144:46524) 2023-05-11T07:36:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f1918f9c700 1 -- 172.21.15.144:0/626961265 learned_addr learned my addr 172.21.15.144:0/626961265 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f1913fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 0x7f19141554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:55466/0 (socket says 172.21.15.144:55466) 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.642+0000 7f19137fe700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191406beb0 0x7f19140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 -- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 msgr2=0x7f19141554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 0x7f19141554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 -- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191406beb0 msgr2=0x7f19140710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191406beb0 0x7f19140710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 -- 172.21.15.144:0/626961265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c009b30 con 0x7f1914158be0 2023-05-11T07:36:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1918f9c700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f191406dfa0 tx=0x7f190c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c004880 con 0x7f1914158be0 2023-05-11T07:36:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c0099b0 con 0x7f1914158be0 2023-05-11T07:36:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c01b670 con 0x7f1914158be0 2023-05-11T07:36:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19140c93b0 con 0x7f1914158be0 2023-05-11T07:36:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.643+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191415d6a0 con 0x7f1914158be0 2023-05-11T07:36:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.644+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19140ceab0 con 0x7f1914158be0 2023-05-11T07:36:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.645+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f190c01b7d0 con 0x7f1914158be0 2023-05-11T07:36:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.646+0000 7f1910ff9700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 0x7f190006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:36:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.646+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f190c08afd0 con 0x7f1914158be0 2023-05-11T07:36:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.646+0000 7f1913fff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 0x7f190006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:36:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.647+0000 7f1913fff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 0x7f190006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19140ae2b0 tx=0x7f190400b750 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:36:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.651+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f190c055d40 con 0x7f1914158be0 2023-05-11T07:36:59.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.890+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1914074530 con 0x7f1914158be0 2023-05-11T07:36:59.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.891+0000 7f1910ff9700 1 -- 172.21.15.144:0/626961265 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f190c059360 con 0x7f1914158be0 2023-05-11T07:36:59.893 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:36:59.893 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:36:59.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 msgr2=0x7f190006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 0x7f190006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19140ae2b0 tx=0x7f190400b750 comp rx=0 tx=0).stop 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 msgr2=0x7f1914153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f191406dfa0 tx=0x7f190c004ad0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 shutdown_connections 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f190006ace0 0x7f190006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f191406af50 0x7f19141554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1914158be0 0x7f1914153eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 --2- 172.21.15.144:0/626961265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f191406beb0 0x7f19140710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 >> 172.21.15.144:0/626961265 conn(0x7f19140cb7e0 msgr2=0x7f19140cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 shutdown_connections 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:36:59.893+0000 7f191a9ff700 1 -- 172.21.15.144:0/626961265 wait complete. 2023-05-11T07:36:59.897 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:36:59.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.099+0000 7fdff53ff700 1 Processor -- start 2023-05-11T07:37:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.100+0000 7fdff53ff700 1 -- start start 2023-05-11T07:37:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdff53ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdff00b52a0 0x7fdff00d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdff53ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff015cef0 con 0x7fdff00d02c0 2023-05-11T07:37:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdff53ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00cd760 con 0x7fdff00b87e0 2023-05-11T07:37:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdff53ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00b5a80 con 0x7fdff00b52a0 2023-05-11T07:37:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdfef7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdff00d02c0 0x7fdff00d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49040/0 (socket says 172.21.15.144:49040) 2023-05-11T07:37:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdfef7fe700 1 -- 172.21.15.144:0/1070969875 learned_addr learned my addr 172.21.15.144:0/1070969875 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdfe7fff700 1 --2- 172.21.15.144:0/1070969875 >> v2:172.21.15.145:3300/0 conn(0x7fdff00b52a0 0x7fdff00d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268229111 0 0) 0x7fdfe8001490 con 0x7fdff00d02c0 2023-05-11T07:37:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.101+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfdc0035b0 con 0x7fdff00d02c0 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758984973 0 0) 0x7fdfdc0035b0 con 0x7fdff00d02c0 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 >> v2:172.21.15.145:3300/0 conn(0x7fdff00b52a0 msgr2=0x7fdff00d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 --2- 172.21.15.144:0/1070969875 >> v2:172.21.15.145:3300/0 conn(0x7fdff00b52a0 0x7fdff00d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 >> v1:172.21.15.145:6789/0 conn(0x7fdff00b87e0 legacy=0x7fdff00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00d2d30 con 0x7fdff00d02c0 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fdfe8001b80 con 0x7fdff00d02c0 2023-05-11T07:37:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 >> v1:172.21.15.144:6789/0 conn(0x7fdff00d02c0 legacy=0x7fdff00d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdfdc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfdc004850 0x7fdfdc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfdc005200 0x7fdfdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00c0e0 con 0x7fdfdc003a00 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00c250 con 0x7fdfdc004850 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00c410 con 0x7fdfdc005200 2023-05-11T07:37:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdfdc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfef7fe700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfdc005200 0x7fdfdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.102+0000 7fdfe7fff700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfdc004850 0x7fdfdc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 -- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfdc005200 msgr2=0x7fdfdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdfdc005200 0x7fdfdc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 -- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfdc004850 msgr2=0x7fdfdc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfdc004850 0x7fdfdc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 -- 172.21.15.144:0/1070969875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0035b0 con 0x7fdfdc003a00 2023-05-11T07:37:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfef7fe700 1 -- 172.21.15.144:0/1070969875 reap_dead start 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdfdc003e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00017c0 tx=0x7fdfdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bb478911c125f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00052d0 con 0x7fdfdc003a00 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0005430 con 0x7fdfdc003a00 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.103+0000 7fdfee7fc700 1 -- 172.21.15.144:0/1070969875 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00038c0 con 0x7fdfdc003a00 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 -- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 msgr2=0x7fdfdc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdfdc003e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00017c0 tx=0x7fdfdc005880 comp rx=0 tx=0).stop 2023-05-11T07:37:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 -- 172.21.15.144:0/1070969875 shutdown_connections 2023-05-11T07:37:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 --2- 172.21.15.144:0/1070969875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdfdc003e10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 -- 172.21.15.144:0/1070969875 >> 172.21.15.144:0/1070969875 conn(0x7fdff006acf0 msgr2=0x7fdff006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 -- 172.21.15.144:0/1070969875 shutdown_connections 2023-05-11T07:37:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.104+0000 7fdff53ff700 1 -- 172.21.15.144:0/1070969875 wait complete. 2023-05-11T07:37:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.105+0000 7fdff53ff700 1 Processor -- start 2023-05-11T07:37:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 -- start start 2023-05-11T07:37:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff00b39a0 0x7fdff00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdff00cc0c0 0x7fdff00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c9a50 con 0x7fdfdc003a00 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b4350 con 0x7fdff00b39a0 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.106+0000 7fdff53ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0153150 con 0x7fdff00cc0c0 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdff00cc0c0 0x7fdff00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46534/0 (socket says 172.21.15.144:46534) 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 -- 172.21.15.144:0/4136129824 learned_addr learned my addr 172.21.15.144:0/4136129824 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfe7fff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff00b39a0 0x7fdff00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 -- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdff00cc0c0 msgr2=0x7fdff00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdff00cc0c0 0x7fdff00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 -- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff00b39a0 msgr2=0x7fdff00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff00b39a0 0x7fdff00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 -- 172.21.15.144:0/4136129824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00cdc90 con 0x7fdfdc003a00 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.107+0000 7fdfeeffd700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0001db0 tx=0x7fdfe0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.108+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0001290 con 0x7fdfdc003a00 2023-05-11T07:37:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.108+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe001d480 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.108+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00cd9b0 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.108+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001d830 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.108+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00b8bb0 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.109+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0154160 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.110+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfe0019040 con 0x7fdfdc003a00 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.111+0000 7fdfe77fe700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.111+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdfe008a1f0 con 0x7fdfdc003a00 2023-05-11T07:37:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.111+0000 7fdfe7fff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.111+0000 7fdfe7fff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 0x7fdfd006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdff00c9420 tx=0x7fdfd8009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.115+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdfe0055010 con 0x7fdfdc003a00 2023-05-11T07:37:00.310 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.307+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdff008b830 con 0x7fdfdc003a00 2023-05-11T07:37:00.311 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.309+0000 7fdfe77fe700 1 -- 172.21.15.144:0/4136129824 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fdfe0058630 con 0x7fdfdc003a00 2023-05-11T07:37:00.312 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:00.312 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:00.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 msgr2=0x7fdfd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 0x7fdfd006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdff00c9420 tx=0x7fdfd8009210 comp rx=0 tx=0).stop 2023-05-11T07:37:00.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 msgr2=0x7fdff0151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0001db0 tx=0x7fdfe0001120 comp rx=0 tx=0).stop 2023-05-11T07:37:00.314 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 shutdown_connections 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdfd006ace0 0x7fdfd006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdff00cc0c0 0x7fdff00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a00 0x7fdff0151820 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 --2- 172.21.15.144:0/4136129824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff00b39a0 0x7fdff00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 >> 172.21.15.144:0/4136129824 conn(0x7fdff006acf0 msgr2=0x7fdff00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 shutdown_connections 2023-05-11T07:37:00.315 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.311+0000 7fdff53ff700 1 -- 172.21.15.144:0/4136129824 wait complete. 2023-05-11T07:37:00.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T07:35:37.712980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T07:35:38.968347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T07:35:42.046200+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T07:37:00.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:37:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.515+0000 7f0f201ff700 1 Processor -- start 2023-05-11T07:37:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.516+0000 7f0f201ff700 1 -- start start 2023-05-11T07:37:00.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f201ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f180b49d0 0x7f0f1806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f201ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1806b750 con 0x7f0f1815aaf0 2023-05-11T07:37:00.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f201ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1815eaa0 con 0x7f0f1815e530 2023-05-11T07:37:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f201ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1815aec0 con 0x7f0f180b49d0 2023-05-11T07:37:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1df9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f1815aaf0 0x7f0f180b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49056/0 (socket says 172.21.15.144:49056) 2023-05-11T07:37:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1df9b700 1 -- 172.21.15.144:0/3716364062 learned_addr learned my addr 172.21.15.144:0/3716364062 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f180b49d0 0x7f0f1806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938023887 0 0) 0x7f0f1806b750 con 0x7f0f1815aaf0 2023-05-11T07:37:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f040035b0 con 0x7f0f1815aaf0 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038039988 0 0) 0x7f0f1815eaa0 con 0x7f0f1815e530 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.517+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f1806b750 con 0x7f0f1815e530 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098160668 0 0) 0x7f0f040035b0 con 0x7f0f1815aaf0 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f180b49d0 msgr2=0x7f0f1806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f180b49d0 0x7f0f1806bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 >> v1:172.21.15.145:6789/0 conn(0x7f0f1815e530 legacy=0x7f0f180b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1815ed80 con 0x7f0f1815aaf0 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f0f14001670 con 0x7f0f1815aaf0 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 >> v1:172.21.15.144:6789/0 conn(0x7f0f1815aaf0 legacy=0x7f0f180b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04003bc0 0x7f0f04003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f04004850 0x7f0f04004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f04005200 0x7f0f0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1815aec0 con 0x7f0f04005200 2023-05-11T07:37:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400bfd0 con 0x7f0f04004850 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400c190 con 0x7f0f04003bc0 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f180b49d0 0x7f0f1806bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1df9b700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04003bc0 0x7f0f04003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1d79a700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f04004850 0x7f0f04004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.518+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f04005200 0x7f0f0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 -- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04003bc0 msgr2=0x7f0f04003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04003bc0 0x7f0f04003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 -- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f04004850 msgr2=0x7f0f04004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f04004850 0x7f0f04004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 -- 172.21.15.144:0/3716364062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040035b0 con 0x7f0f04005200 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1df9b700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04003bc0 0x7f0f04003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f04005200 0x7f0f0400ba10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0f180b1680 tx=0x7f0f04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68c7e56a945d297 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003c20 con 0x7f0f04005200 2023-05-11T07:37:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000f040 con 0x7f0f04005200 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1cf99700 1 -- 172.21.15.144:0/3716364062 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000ea30 con 0x7f0f04005200 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f201ff700 1 -- 172.21.15.144:0/3716364062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f04005200 msgr2=0x7f0f0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f201ff700 1 --2- 172.21.15.144:0/3716364062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f04005200 0x7f0f0400ba10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0f180b1680 tx=0x7f0f04005880 comp rx=0 tx=0).stop 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.519+0000 7f0f1e79c700 1 -- 172.21.15.144:0/3716364062 reap_dead start 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.520+0000 7f0f201ff700 1 -- 172.21.15.144:0/3716364062 shutdown_connections 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.520+0000 7f0f201ff700 1 -- 172.21.15.144:0/3716364062 >> 172.21.15.144:0/3716364062 conn(0x7f0f180cb720 msgr2=0x7f0f180cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.520+0000 7f0f201ff700 1 -- 172.21.15.144:0/3716364062 shutdown_connections 2023-05-11T07:37:00.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.520+0000 7f0f201ff700 1 -- 172.21.15.144:0/3716364062 wait complete. 2023-05-11T07:37:00.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.521+0000 7f0f201ff700 1 Processor -- start 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.522+0000 7f0f201ff700 1 -- start start 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.522+0000 7f0f201ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04005200 0x7f0f181497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.522+0000 7f0f201ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f18156340 0x7f0f181567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f201ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f201ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18158330 con 0x7f0f180c76d0 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f201ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18156cf0 con 0x7f0f18156340 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f201ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18149d00 con 0x7f0f04005200 2023-05-11T07:37:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46562/0 (socket says 172.21.15.144:46562) 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 -- 172.21.15.144:0/2565677046 learned_addr learned my addr 172.21.15.144:0/2565677046 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1d79a700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f18156340 0x7f0f181567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1df9b700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04005200 0x7f0f181497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 -- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04005200 msgr2=0x7f0f181497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04005200 0x7f0f181497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 -- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f18156340 msgr2=0x7f0f181567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f18156340 0x7f0f181567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 -- 172.21.15.144:0/2565677046 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1815f340 con 0x7f0f180c76d0 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.523+0000 7f0f1e79c700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400bfa0 tx=0x7f0f10009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.524+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10004440 con 0x7f0f180c76d0 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.524+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100045c0 con 0x7f0f180c76d0 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.524+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10004970 con 0x7f0f180c76d0 2023-05-11T07:37:00.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.524+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1815f060 con 0x7f0f180c76d0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.524+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f180c92f0 con 0x7f0f180c76d0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.525+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f180744c0 con 0x7f0f180c76d0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.526+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f10025030 con 0x7f0f180c76d0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.526+0000 7f0f0e7fc700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 0x7f0efc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.527+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f1008b210 con 0x7f0f180c76d0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.527+0000 7f0f1df9b700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 0x7f0efc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.527+0000 7f0f1df9b700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 0x7f0efc06d1c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f14001030 tx=0x7f0f14001e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.531+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0f10059ab0 con 0x7f0f180c76d0 2023-05-11T07:37:00.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.727+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f180cae90 con 0x7f0f180c76d0 2023-05-11T07:37:00.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.728+0000 7f0f0e7fc700 1 -- 172.21.15.144:0/2565677046 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f10059640 con 0x7f0f180c76d0 2023-05-11T07:37:00.732 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:37:00.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 msgr2=0x7f0efc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 0x7f0efc06d1c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f14001030 tx=0x7f0f14001e20 comp rx=0 tx=0).stop 2023-05-11T07:37:00.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 msgr2=0x7f0f180c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400bfa0 tx=0x7f0f10009750 comp rx=0 tx=0).stop 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 shutdown_connections 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0efc06ad10 0x7f0efc06d1c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0f04005200 0x7f0f181497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f180c76d0 0x7f0f180c7b40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 --2- 172.21.15.144:0/2565677046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f18156340 0x7f0f181567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 >> 172.21.15.144:0/2565677046 conn(0x7f0f180cb720 msgr2=0x7f0f180cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:00.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 shutdown_connections 2023-05-11T07:37:00.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.730+0000 7f0f201ff700 1 -- 172.21.15.144:0/2565677046 wait complete. 2023-05-11T07:37:00.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:37:00.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.936+0000 7f3ec63ff700 1 Processor -- start 2023-05-11T07:37:00.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.936+0000 7f3ec63ff700 1 -- start start 2023-05-11T07:37:00.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec63ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 0x7f3ec006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec63ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ec006cca0 0x7f3ec015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec63ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec006d0a0 con 0x7f3ec0158f40 2023-05-11T07:37:00.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec63ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec006b6c0 con 0x7f3ec006cca0 2023-05-11T07:37:00.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec63ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec006b9a0 con 0x7f3ec00ce680 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec499c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ec006cca0 0x7f3ec015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec499c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ec006cca0 0x7f3ec015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46570/0 (socket says 172.21.15.144:46570) 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ec499c700 1 -- 172.21.15.144:0/1670052862 learned_addr learned my addr 172.21.15.144:0/1670052862 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.937+0000 7f3ebffff700 1 --1- 172.21.15.144:0/1670052862 >> v1:172.21.15.144:6789/0 conn(0x7f3ec0158f40 0x7f3ec006fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49070/0 (socket says 172.21.15.144:49070) 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/1670052862 >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 0x7f3ec006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ec499c700 1 -- 172.21.15.144:0/1670052862 >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 msgr2=0x7f3ec006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:00.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ec499c700 1 --2- 172.21.15.144:0/1670052862 >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 0x7f3ec006c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ec499c700 1 -- 172.21.15.144:0/1670052862 >> v1:172.21.15.144:6789/0 conn(0x7f3ec0158f40 legacy=0x7f3ec006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ec499c700 1 -- 172.21.15.144:0/1670052862 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec006bc80 con 0x7f3ec006cca0 2023-05-11T07:37:00.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/1670052862 >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 0x7f3ec006c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:00.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ec499c700 1 --2- 172.21.15.144:0/1670052862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec015cb30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006f980 tx=0x7f3eb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7e5fcda58f320a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ebeffd700 1 -- 172.21.15.144:0/1670052862 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800e070 con 0x7f3ec006cca0 2023-05-11T07:37:00.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ebeffd700 1 -- 172.21.15.144:0/1670052862 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800b9c0 con 0x7f3ec006cca0 2023-05-11T07:37:00.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.938+0000 7f3ebeffd700 1 -- 172.21.15.144:0/1670052862 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800bd70 con 0x7f3ec006cca0 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 -- 172.21.15.144:0/1670052862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 msgr2=0x7f3ec015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/1670052862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec015cb30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ec006f980 tx=0x7f3eb800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 -- 172.21.15.144:0/1670052862 shutdown_connections 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/1670052862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec015cb30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/1670052862 >> v2:172.21.15.145:3300/0 conn(0x7f3ec00ce680 0x7f3ec006c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 -- 172.21.15.144:0/1670052862 >> 172.21.15.144:0/1670052862 conn(0x7f3ec00cb720 msgr2=0x7f3ec00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 -- 172.21.15.144:0/1670052862 shutdown_connections 2023-05-11T07:37:00.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.939+0000 7f3ec63ff700 1 -- 172.21.15.144:0/1670052862 wait complete. 2023-05-11T07:37:00.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.940+0000 7f3ec63ff700 1 Processor -- start 2023-05-11T07:37:00.946 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.940+0000 7f3ec63ff700 1 -- start start 2023-05-11T07:37:00.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 0x7f3ec0147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 0x7f3ec015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0158800 con 0x7f3ec006cca0 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0148280 con 0x7f3ec00ce680 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.941+0000 7f3ec63ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0159b00 con 0x7f3ec0158f40 2023-05-11T07:37:00.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46574/0 (socket says 172.21.15.144:46574) 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 -- 172.21.15.144:0/779615424 learned_addr learned my addr 172.21.15.144:0/779615424 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 0x7f3ec0147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ec499c700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 0x7f3ec015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 -- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 msgr2=0x7f3ec015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 0x7f3ec015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 -- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 msgr2=0x7f3ec0147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:00.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 0x7f3ec0147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 -- 172.21.15.144:0/779615424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8009b30 con 0x7f3ec006cca0 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ec499c700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 0x7f3ec015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 0x7f3ec0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebffff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c500 tx=0x7f3eb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0005cb0 con 0x7f3ec006cca0 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0005e10 con 0x7f3ec006cca0 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.942+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec006c240 con 0x7f3ec006cca0 2023-05-11T07:37:00.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.943+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00072d0 con 0x7f3ec006cca0 2023-05-11T07:37:00.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.943+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec006bf60 con 0x7f3ec006cca0 2023-05-11T07:37:00.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.944+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00cdb10 con 0x7f3ec006cca0 2023-05-11T07:37:00.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.944+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3eb0007430 con 0x7f3ec006cca0 2023-05-11T07:37:00.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.945+0000 7f3ebcff9700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 0x7f3eac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:00.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.945+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3eb0088b20 con 0x7f3ec006cca0 2023-05-11T07:37:00.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.946+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 0x7f3eac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:00.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.946+0000 7f3ebf7fe700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 0x7f3eac06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0154b10 tx=0x7f3eb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:00.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:00.950+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3eb0053940 con 0x7f3ec006cca0 2023-05-11T07:37:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.139+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ec00744c0 con 0x7f3ec006cca0 2023-05-11T07:37:01.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.139+0000 7f3ebcff9700 1 -- 172.21.15.144:0/779615424 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3eb0017020 con 0x7f3ec006cca0 2023-05-11T07:37:01.144 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:37:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.141+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 msgr2=0x7f3eac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.141+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 0x7f3eac06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0154b10 tx=0x7f3eb4008040 comp rx=0 tx=0).stop 2023-05-11T07:37:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.141+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 msgr2=0x7f3ec01471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.141+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c500 tx=0x7f3eb000c8c0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 shutdown_connections 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3eac06ace0 0x7f3eac06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3ec0158f40 0x7f3ec015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec006cca0 0x7f3ec01471c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 --2- 172.21.15.144:0/779615424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ec00ce680 0x7f3ec0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 >> 172.21.15.144:0/779615424 conn(0x7f3ec00cb720 msgr2=0x7f3ec00cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:01.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 shutdown_connections 2023-05-11T07:37:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.142+0000 7f3ec63ff700 1 -- 172.21.15.144:0/779615424 wait complete. 2023-05-11T07:37:01.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T07:37:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.345+0000 7fd0defff700 1 Processor -- start 2023-05-11T07:37:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.346+0000 7fd0defff700 1 -- start start 2023-05-11T07:37:01.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0defff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0d815aaf0 0x7fd0d80b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0defff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fd0d815e530 0x7fd0d80b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0defff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d806b750 con 0x7fd0d80c92f0 2023-05-11T07:37:01.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0defff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d815aec0 con 0x7fd0d815aaf0 2023-05-11T07:37:01.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0defff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d815eaa0 con 0x7fd0d815e530 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0d815aaf0 0x7fd0d80b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0d815aaf0 0x7fd0d80b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46576/0 (socket says 172.21.15.144:46576) 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 -- 172.21.15.144:0/2805088406 learned_addr learned my addr 172.21.15.144:0/2805088406 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0d7fff700 1 --2- 172.21.15.144:0/2805088406 >> v2:172.21.15.145:3300/0 conn(0x7fd0d815e530 0x7fd0d80b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 -- 172.21.15.144:0/2805088406 >> v2:172.21.15.145:3300/0 conn(0x7fd0d815e530 msgr2=0x7fd0d80b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 --2- 172.21.15.144:0/2805088406 >> v2:172.21.15.145:3300/0 conn(0x7fd0d815e530 0x7fd0d80b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 -- 172.21.15.144:0/2805088406 >> v1:172.21.15.145:6789/0 conn(0x7fd0d80c92f0 legacy=0x7fd0d806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:01.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.347+0000 7fd0dcd9b700 1 -- 172.21.15.144:0/2805088406 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d815ed80 con 0x7fd0d815aaf0 2023-05-11T07:37:01.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0dcd9b700 1 --2- 172.21.15.144:0/2805088406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80b0a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098f0 tx=0x7fd0cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0a7d31a31ae106 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0d77fe700 1 -- 172.21.15.144:0/2805088406 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc004230 con 0x7fd0d815aaf0 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0d77fe700 1 -- 172.21.15.144:0/2805088406 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc004390 con 0x7fd0d815aaf0 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0d77fe700 1 -- 172.21.15.144:0/2805088406 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0036a0 con 0x7fd0d815aaf0 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0defff700 1 -- 172.21.15.144:0/2805088406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 msgr2=0x7fd0d80b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0defff700 1 --2- 172.21.15.144:0/2805088406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80b0a90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0098f0 tx=0x7fd0cc009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.348+0000 7fd0defff700 1 -- 172.21.15.144:0/2805088406 shutdown_connections 2023-05-11T07:37:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.349+0000 7fd0defff700 1 --2- 172.21.15.144:0/2805088406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80b0a90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.349+0000 7fd0defff700 1 --2- 172.21.15.144:0/2805088406 >> v2:172.21.15.145:3300/0 conn(0x7fd0d815e530 0x7fd0d80b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.349+0000 7fd0defff700 1 -- 172.21.15.144:0/2805088406 >> 172.21.15.144:0/2805088406 conn(0x7fd0d80cb720 msgr2=0x7fd0d80cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.349+0000 7fd0defff700 1 -- 172.21.15.144:0/2805088406 shutdown_connections 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.349+0000 7fd0defff700 1 -- 172.21.15.144:0/2805088406 wait complete. 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.350+0000 7fd0defff700 1 Processor -- start 2023-05-11T07:37:01.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.350+0000 7fd0defff700 1 -- start start 2023-05-11T07:37:01.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0d80c92f0 0x7fd0d80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0d815e530 0x7fd0d80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815ca90 con 0x7fd0d815aaf0 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815be80 con 0x7fd0d80c92f0 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0defff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815c160 con 0x7fd0d815e530 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.351+0000 7fd0d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46588/0 (socket says 172.21.15.144:46588) 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 -- 172.21.15.144:0/3295026354 learned_addr learned my addr 172.21.15.144:0/3295026354 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0dd59c700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0d815e530 0x7fd0d80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0dcd9b700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0d80c92f0 0x7fd0d80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 -- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0d815e530 msgr2=0x7fd0d80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0d815e530 0x7fd0d80cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 -- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0d80c92f0 msgr2=0x7fd0d80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0d80c92f0 0x7fd0d80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 -- 172.21.15.144:0/3295026354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc009550 con 0x7fd0d815aaf0 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d7fff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400e7e0 tx=0x7fd0c400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400c070 con 0x7fd0d815aaf0 2023-05-11T07:37:01.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4013610 con 0x7fd0d815aaf0 2023-05-11T07:37:01.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d815f340 con 0x7fd0d815aaf0 2023-05-11T07:37:01.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.352+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4013980 con 0x7fd0d815aaf0 2023-05-11T07:37:01.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.353+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d815f060 con 0x7fd0d815aaf0 2023-05-11T07:37:01.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.354+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d80b0fd0 con 0x7fd0d815aaf0 2023-05-11T07:37:01.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.354+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0c4013ae0 con 0x7fd0d815aaf0 2023-05-11T07:37:01.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.355+0000 7fd0d57fa700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.356+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0c4089610 con 0x7fd0d815aaf0 2023-05-11T07:37:01.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.356+0000 7fd0dcd9b700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.356+0000 7fd0dcd9b700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 0x7fd0bc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009130 tx=0x7fd0cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.360+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd0c4057d90 con 0x7fd0d815aaf0 2023-05-11T07:37:01.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.552+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0d80744c0 con 0x7fd0d815aaf0 2023-05-11T07:37:01.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.553+0000 7fd0d57fa700 1 -- 172.21.15.144:0/3295026354 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0c4057920 con 0x7fd0d815aaf0 2023-05-11T07:37:01.557 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:37:01.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 msgr2=0x7fd0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 0x7fd0bc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009130 tx=0x7fd0cc008030 comp rx=0 tx=0).stop 2023-05-11T07:37:01.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 msgr2=0x7fd0d80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400e7e0 tx=0x7fd0c400eaf0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 shutdown_connections 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd0d815e530 0x7fd0d80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0d80c92f0 0x7fd0d80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.555+0000 7fd0defff700 1 --2- 172.21.15.144:0/3295026354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d815aaf0 0x7fd0d80cf370 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.556+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 >> 172.21.15.144:0/3295026354 conn(0x7fd0d80cb720 msgr2=0x7fd0d8154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.556+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 shutdown_connections 2023-05-11T07:37:01.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.556+0000 7fd0defff700 1 -- 172.21.15.144:0/3295026354 wait complete. 2023-05-11T07:37:01.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T07:37:01.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.761+0000 7f302adff700 1 Processor -- start 2023-05-11T07:37:01.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.762+0000 7f302adff700 1 -- start start 2023-05-11T07:37:01.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f302adff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 0x7f302406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f302adff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240b1c00 con 0x7f30240d0660 2023-05-11T07:37:01.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f302adff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240b1340 con 0x7f302415cd60 2023-05-11T07:37:01.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f302adff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302406bda0 con 0x7f302406b3e0 2023-05-11T07:37:01.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f3023fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f30240d0660 0x7f30240b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49078/0 (socket says 172.21.15.144:49078) 2023-05-11T07:37:01.767 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f3023fff700 1 -- 172.21.15.144:0/1124360596 learned_addr learned my addr 172.21.15.144:0/1124360596 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:01.768 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.763+0000 7f302939c700 1 --2- 172.21.15.144:0/1124360596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 0x7f302406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333741583 0 0) 0x7f30240b1c00 con 0x7f30240d0660 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30140035b0 con 0x7f30240d0660 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593862205 0 0) 0x7f30240b1340 con 0x7f302415cd60 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30240b1c00 con 0x7f302415cd60 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f302939c700 1 -- 172.21.15.144:0/1124360596 >> v1:172.21.15.145:6789/0 conn(0x7f302415cd60 legacy=0x7f30240cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f302939c700 1 -- 172.21.15.144:0/1124360596 >> v1:172.21.15.144:6789/0 conn(0x7f30240d0660 legacy=0x7f30240b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.769 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f302939c700 1 -- 172.21.15.144:0/1124360596 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240b15b0 con 0x7f302406b3e0 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f302939c700 1 --2- 172.21.15.144:0/1124360596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 0x7f302406b860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f301c009dc0 tx=0x7f301c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3669245007fa2a3c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.764+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00e070 con 0x7f302406b3e0 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00bb20 con 0x7f302406b3e0 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f30237fe700 1 -- 172.21.15.144:0/1124360596 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c012430 con 0x7f302406b3e0 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 -- 172.21.15.144:0/1124360596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 msgr2=0x7f302406b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 --2- 172.21.15.144:0/1124360596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 0x7f302406b860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f301c009dc0 tx=0x7f301c00b330 comp rx=0 tx=0).stop 2023-05-11T07:37:01.770 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 -- 172.21.15.144:0/1124360596 shutdown_connections 2023-05-11T07:37:01.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 --2- 172.21.15.144:0/1124360596 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302406b3e0 0x7f302406b860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 -- 172.21.15.144:0/1124360596 >> 172.21.15.144:0/1124360596 conn(0x7f302409a2c0 msgr2=0x7f30240d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:01.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 -- 172.21.15.144:0/1124360596 shutdown_connections 2023-05-11T07:37:01.771 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.765+0000 7f302adff700 1 -- 172.21.15.144:0/1124360596 wait complete. 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.767+0000 7f302adff700 1 Processor -- start 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.767+0000 7f302adff700 1 -- start start 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 0x7f30240c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 0x7f3024156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240cafb0 con 0x7f302415cd60 2023-05-11T07:37:01.773 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024157160 con 0x7f302406b3e0 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302adff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30240c4c00 con 0x7f30240d0660 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302939c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302939c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46594/0 (socket says 172.21.15.144:46594) 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f302939c700 1 -- 172.21.15.144:0/2345741581 learned_addr learned my addr 172.21.15.144:0/2345741581 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f3023fff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 0x7f3024156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.768+0000 7f3028b9b700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 0x7f30240c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 -- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 msgr2=0x7f3024156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.774 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 0x7f3024156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 -- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 msgr2=0x7f30240c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 0x7f30240c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 -- 172.21.15.144:0/2345741581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c009a70 con 0x7f302415cd60 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f3023fff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 0x7f3024156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f3028b9b700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 0x7f30240c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302939c700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b370 tx=0x7f301c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.775 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c01b810 con 0x7f302415cd60 2023-05-11T07:37:01.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c020070 con 0x7f302415cd60 2023-05-11T07:37:01.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30240b27a0 con 0x7f302415cd60 2023-05-11T07:37:01.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c01bbf0 con 0x7f302415cd60 2023-05-11T07:37:01.776 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.769+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30240b1890 con 0x7f302415cd60 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.770+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30240cfb10 con 0x7f302415cd60 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.771+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f301c01bd50 con 0x7f302415cd60 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.772+0000 7f30217fa700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 0x7f300806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.772+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f301c022070 con 0x7f302415cd60 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.773+0000 7f3028b9b700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 0x7f300806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:01.777 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.773+0000 7f3028b9b700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 0x7f300806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3018001230 tx=0x7f3018009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:01.779 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.776+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f301c0569b0 con 0x7f302415cd60 2023-05-11T07:37:01.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.971+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30240744c0 con 0x7f302415cd60 2023-05-11T07:37:01.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.972+0000 7f30217fa700 1 -- 172.21.15.144:0/2345741581 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f301c02c020 con 0x7f302415cd60 2023-05-11T07:37:01.976 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 msgr2=0x7f300806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 0x7f300806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3018001230 tx=0x7f3018009040 comp rx=0 tx=0).stop 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 msgr2=0x7f30240c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b370 tx=0x7f301c004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 shutdown_connections 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300806ace0 0x7f300806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302415cd60 0x7f30240c56a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f302406b3e0 0x7f30240c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 --2- 172.21.15.144:0/2345741581 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f30240d0660 0x7f3024156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 >> 172.21.15.144:0/2345741581 conn(0x7f302409a2c0 msgr2=0x7f30240b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 shutdown_connections 2023-05-11T07:37:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:01.974+0000 7f302adff700 1 -- 172.21.15.144:0/2345741581 wait complete. 2023-05-11T07:37:01.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T07:37:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.180+0000 7fbeb15ff700 1 Processor -- start 2023-05-11T07:37:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.180+0000 7fbeb15ff700 1 -- start start 2023-05-11T07:37:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.181+0000 7fbeb15ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbeac15aaf0 0x7fbeac0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.181+0000 7fbeb15ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.181+0000 7fbeb15ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06b750 con 0x7fbeac15e530 2023-05-11T07:37:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.181+0000 7fbeb15ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac15aec0 con 0x7fbeac15aaf0 2023-05-11T07:37:02.185 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.181+0000 7fbeb15ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac15eaa0 con 0x7fbeac0b49d0 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeaaffd700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbeac15aaf0 0x7fbeac0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:55540/0 (socket says 172.21.15.144:55540) 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 -- 172.21.15.144:0/1008674437 learned_addr learned my addr 172.21.15.144:0/1008674437 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 -- 172.21.15.144:0/1008674437 >> v2:172.21.15.145:3300/0 conn(0x7fbeac15aaf0 msgr2=0x7fbeac0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:02.187 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 --2- 172.21.15.144:0/1008674437 >> v2:172.21.15.145:3300/0 conn(0x7fbeac15aaf0 0x7fbeac0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 -- 172.21.15.144:0/1008674437 >> v1:172.21.15.145:6789/0 conn(0x7fbeac15e530 legacy=0x7fbeac0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.182+0000 7fbeab7fe700 1 -- 172.21.15.144:0/1008674437 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac15ed80 con 0x7fbeac0b49d0 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeab7fe700 1 --2- 172.21.15.144:0/1008674437 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e80 tx=0x7fbea400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e262496fbc1a24a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeaa7fc700 1 -- 172.21.15.144:0/1008674437 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400e070 con 0x7fbeac0b49d0 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeaa7fc700 1 -- 172.21.15.144:0/1008674437 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400b8d0 con 0x7fbeac0b49d0 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeaa7fc700 1 -- 172.21.15.144:0/1008674437 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400bc80 con 0x7fbeac0b49d0 2023-05-11T07:37:02.188 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 -- 172.21.15.144:0/1008674437 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 msgr2=0x7fbeac06bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/1008674437 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e80 tx=0x7fbea400b330 comp rx=0 tx=0).stop 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 -- 172.21.15.144:0/1008674437 shutdown_connections 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/1008674437 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac06bbe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/1008674437 >> v2:172.21.15.145:3300/0 conn(0x7fbeac15aaf0 0x7fbeac0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.183+0000 7fbeb15ff700 1 -- 172.21.15.144:0/1008674437 >> 172.21.15.144:0/1008674437 conn(0x7fbeac0cb720 msgr2=0x7fbeac0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.184+0000 7fbeb15ff700 1 -- 172.21.15.144:0/1008674437 shutdown_connections 2023-05-11T07:37:02.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.184+0000 7fbeb15ff700 1 -- 172.21.15.144:0/1008674437 wait complete. 2023-05-11T07:37:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.185+0000 7fbeb15ff700 1 Processor -- start 2023-05-11T07:37:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.185+0000 7fbeb15ff700 1 -- start start 2023-05-11T07:37:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbeac15e530 0x7fbeac15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cd3d0 con 0x7fbeac15aaf0 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac155970 con 0x7fbeac15e530 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbeb15ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cca30 con 0x7fbeac0b49d0 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.186+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46606/0 (socket says 172.21.15.144:46606) 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 -- 172.21.15.144:0/2584869006 learned_addr learned my addr 172.21.15.144:0/2584869006 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbeaaffd700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbeab7fe700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbeac15e530 0x7fbeac15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 -- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 msgr2=0x7fbeac14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac14d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 -- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbeac15e530 msgr2=0x7fbeac15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbeac15e530 0x7fbeac15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 -- 172.21.15.144:0/2584869006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009b30 con 0x7fbeac15aaf0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea3fff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c4e0 tx=0x7fbe9400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940052d0 con 0x7fbeac15aaf0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94005430 con 0x7fbeac15aaf0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940038c0 con 0x7fbeac15aaf0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.187+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac15f340 con 0x7fbeac15aaf0 2023-05-11T07:37:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.188+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac15f060 con 0x7fbeac15aaf0 2023-05-11T07:37:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.188+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac0b0fd0 con 0x7fbeac15aaf0 2023-05-11T07:37:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.189+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe94003a20 con 0x7fbeac15aaf0 2023-05-11T07:37:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.190+0000 7fbea37fe700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 0x7fbe8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.190+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe94088c40 con 0x7fbeac15aaf0 2023-05-11T07:37:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.191+0000 7fbeaaffd700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 0x7fbe8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.191+0000 7fbeaaffd700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 0x7fbe8c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009b40 tx=0x7fbe9c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.198 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.194+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe94053890 con 0x7fbeac15aaf0 2023-05-11T07:37:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.388+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbeac0cd510 con 0x7fbeac15aaf0 2023-05-11T07:37:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.388+0000 7fbea37fe700 1 -- 172.21.15.144:0/2584869006 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbeac0cd510 con 0x7fbeac15aaf0 2023-05-11T07:37:02.392 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2023-05-11T07:37:02.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 msgr2=0x7fbe8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 0x7fbe8c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009b40 tx=0x7fbe9c009210 comp rx=0 tx=0).stop 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 msgr2=0x7fbeac15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c4e0 tx=0x7fbe9400c7f0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 shutdown_connections 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbe8c06ace0 0x7fbe8c06d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbeac0b49d0 0x7fbeac14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbeac15e530 0x7fbeac15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 --2- 172.21.15.144:0/2584869006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeac15aaf0 0x7fbeac15d200 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 >> 172.21.15.144:0/2584869006 conn(0x7fbeac0cb720 msgr2=0x7fbeac0c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 shutdown_connections 2023-05-11T07:37:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.391+0000 7fbeb15ff700 1 -- 172.21.15.144:0/2584869006 wait complete. 2023-05-11T07:37:02.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:37:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.593+0000 7f7a29dff700 1 Processor -- start 2023-05-11T07:37:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.593+0000 7f7a29dff700 1 -- start start 2023-05-11T07:37:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.594+0000 7f7a29dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a240b87e0 0x7f7a240b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.594+0000 7f7a29dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240d27a0 0x7f7a240b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.594+0000 7f7a29dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2415cef0 con 0x7f7a240d02c0 2023-05-11T07:37:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a29dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240b5a80 con 0x7f7a240b87e0 2023-05-11T07:37:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a29dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240cdf70 con 0x7f7a240d27a0 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a240b87e0 0x7f7a240b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a240b87e0 0x7f7a240b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46614/0 (socket says 172.21.15.144:46614) 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 -- 172.21.15.144:0/3197132699 learned_addr learned my addr 172.21.15.144:0/3197132699 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a23fff700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240d27a0 0x7f7a240b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 -- 172.21.15.144:0/3197132699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240d27a0 msgr2=0x7f7a240b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240d27a0 0x7f7a240b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 -- 172.21.15.144:0/3197132699 >> v1:172.21.15.144:6789/0 conn(0x7f7a240d02c0 legacy=0x7f7a240d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.595+0000 7f7a237fe700 1 -- 172.21.15.144:0/3197132699 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240cd760 con 0x7f7a240b87e0 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a237fe700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240b87e0 0x7f7a240b4b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098f0 tx=0x7f7a14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d14b37d6007ad0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a22ffd700 1 -- 172.21.15.144:0/3197132699 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011830 con 0x7f7a240b87e0 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a22ffd700 1 -- 172.21.15.144:0/3197132699 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14011990 con 0x7f7a240b87e0 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a22ffd700 1 -- 172.21.15.144:0/3197132699 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011d20 con 0x7f7a240b87e0 2023-05-11T07:37:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 -- 172.21.15.144:0/3197132699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240b87e0 msgr2=0x7f7a240b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240b87e0 0x7f7a240b4b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098f0 tx=0x7f7a14009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 -- 172.21.15.144:0/3197132699 shutdown_connections 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240b87e0 0x7f7a240b4b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3197132699 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240d27a0 0x7f7a240b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 -- 172.21.15.144:0/3197132699 >> 172.21.15.144:0/3197132699 conn(0x7f7a2406acf0 msgr2=0x7f7a2406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 -- 172.21.15.144:0/3197132699 shutdown_connections 2023-05-11T07:37:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.596+0000 7f7a29dff700 1 -- 172.21.15.144:0/3197132699 wait complete. 2023-05-11T07:37:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.598+0000 7f7a29dff700 1 Processor -- start 2023-05-11T07:37:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.598+0000 7f7a29dff700 1 -- start start 2023-05-11T07:37:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240b87e0 0x7f7a240b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a240d27a0 0x7f7a240c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c69e0 con 0x7f7a240d02c0 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24152070 con 0x7f7a240d27a0 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a29dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241522c0 con 0x7f7a240b87e0 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46626/0 (socket says 172.21.15.144:46626) 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a1bfff700 1 -- 172.21.15.144:0/3900931204 learned_addr learned my addr 172.21.15.144:0/3900931204 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a237fe700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240b87e0 0x7f7a240b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.599+0000 7f7a23fff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a240d27a0 0x7f7a240c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 -- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240b87e0 msgr2=0x7f7a240b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240b87e0 0x7f7a240b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 -- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a240d27a0 msgr2=0x7f7a240c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a240d27a0 0x7f7a240c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 -- 172.21.15.144:0/3900931204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009550 con 0x7f7a240d02c0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a1bfff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c4e0 tx=0x7f7a0c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0052d0 con 0x7f7a240d02c0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c005430 con 0x7f7a240d02c0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a240cd9b0 con 0x7f7a240d02c0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.600+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0038c0 con 0x7f7a240d02c0 2023-05-11T07:37:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.601+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240d2d30 con 0x7f7a240d02c0 2023-05-11T07:37:02.608 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.602+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a240cdc90 con 0x7f7a240d02c0 2023-05-11T07:37:02.608 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.602+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a0c003a20 con 0x7f7a240d02c0 2023-05-11T07:37:02.608 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.603+0000 7f7a20ff9700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 0x7f7a0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:02.609 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.603+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a0c0889e0 con 0x7f7a240d02c0 2023-05-11T07:37:02.609 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.604+0000 7f7a237fe700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 0x7f7a0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:02.609 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.604+0000 7f7a237fe700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 0x7f7a0406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a14014040 tx=0x7f7a14008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:02.611 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.608+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a0c053750 con 0x7f7a240d02c0 2023-05-11T07:37:02.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.845+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a2415cef0 con 0x7f7a240d02c0 2023-05-11T07:37:02.849 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.846+0000 7f7a20ff9700 1 -- 172.21.15.144:0/3900931204 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f7a2415cef0 con 0x7f7a240d02c0 2023-05-11T07:37:02.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:02.850 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:37:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 msgr2=0x7f7a0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 0x7f7a0406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a14014040 tx=0x7f7a14008030 comp rx=0 tx=0).stop 2023-05-11T07:37:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 msgr2=0x7f7a240b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c4e0 tx=0x7f7a0c00c7f0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.852 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 shutdown_connections 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7a0406ace0 0x7f7a0406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7a240b87e0 0x7f7a240b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a240d27a0 0x7f7a240c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 --2- 172.21.15.144:0/3900931204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a240d02c0 0x7f7a240b42c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.848+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 >> 172.21.15.144:0/3900931204 conn(0x7f7a2406acf0 msgr2=0x7f7a240b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.849+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 shutdown_connections 2023-05-11T07:37:02.853 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:02.849+0000 7f7a29dff700 1 -- 172.21.15.144:0/3900931204 wait complete. 2023-05-11T07:37:02.854 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:37:02.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:02.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:37:02.917 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:37:03.058 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.055+0000 7fc386fff700 1 Processor -- start 2023-05-11T07:37:03.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.055+0000 7fc386fff700 1 -- start start 2023-05-11T07:37:03.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc386fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc38015a3e0 0x7fc3800cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc386fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3800d0510 con 0x7fc38015d880 2023-05-11T07:37:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc386fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3800cda80 con 0x7fc3800b5290 2023-05-11T07:37:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc386fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3800cf4f0 con 0x7fc38015a3e0 2023-05-11T07:37:03.061 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc384d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc38015a3e0 0x7fc3800cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.061 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc384d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc38015a3e0 0x7fc3800cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46630/0 (socket says 172.21.15.144:46630) 2023-05-11T07:37:03.061 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.056+0000 7fc384d9b700 1 -- 172.21.15.144:0/718384886 learned_addr learned my addr 172.21.15.144:0/718384886 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc384d9b700 1 -- 172.21.15.144:0/718384886 >> v1:172.21.15.145:6789/0 conn(0x7fc3800b5290 legacy=0x7fc38015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc384d9b700 1 -- 172.21.15.144:0/718384886 >> v1:172.21.15.144:6789/0 conn(0x7fc38015d880 legacy=0x7fc3800b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc384d9b700 1 -- 172.21.15.144:0/718384886 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800cf7d0 con 0x7fc38015a3e0 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc384d9b700 1 --2- 172.21.15.144:0/718384886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38015a3e0 0x7fc3800cffd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc374009920 tx=0x7fc374009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4449b24775bfe6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc37f7fe700 1 -- 172.21.15.144:0/718384886 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400ba20 con 0x7fc38015a3e0 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc37f7fe700 1 -- 172.21.15.144:0/718384886 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400bb80 con 0x7fc38015a3e0 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.057+0000 7fc37f7fe700 1 -- 172.21.15.144:0/718384886 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374009e70 con 0x7fc38015a3e0 2023-05-11T07:37:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 -- 172.21.15.144:0/718384886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38015a3e0 msgr2=0x7fc3800cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 --2- 172.21.15.144:0/718384886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38015a3e0 0x7fc3800cffd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc374009920 tx=0x7fc374009c30 comp rx=0 tx=0).stop 2023-05-11T07:37:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 -- 172.21.15.144:0/718384886 shutdown_connections 2023-05-11T07:37:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 --2- 172.21.15.144:0/718384886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc38015a3e0 0x7fc3800cffd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 -- 172.21.15.144:0/718384886 >> 172.21.15.144:0/718384886 conn(0x7fc38006ad30 msgr2=0x7fc38006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 -- 172.21.15.144:0/718384886 shutdown_connections 2023-05-11T07:37:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.058+0000 7fc386fff700 1 -- 172.21.15.144:0/718384886 wait complete. 2023-05-11T07:37:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.060+0000 7fc386fff700 1 Processor -- start 2023-05-11T07:37:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.061+0000 7fc386fff700 1 -- start start 2023-05-11T07:37:03.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 0x7fc380159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 0x7fc3801f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3801f3500 con 0x7fc3800b5290 2023-05-11T07:37:03.066 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc380159860 con 0x7fc38015d880 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc386fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800b1df0 con 0x7fc38015a3e0 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46646/0 (socket says 172.21.15.144:46646) 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 -- 172.21.15.144:0/4105972388 learned_addr learned my addr 172.21.15.144:0/4105972388 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc37ffff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 0x7fc380159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc38559c700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 0x7fc3801f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 -- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 msgr2=0x7fc380159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 0x7fc380159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 -- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 msgr2=0x7fc3801f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 0x7fc3801f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc384d9b700 1 -- 172.21.15.144:0/4105972388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009550 con 0x7fc3800b5290 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc37ffff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 0x7fc380159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.062+0000 7fc38559c700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 0x7fc3801f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc384d9b700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc374009520 tx=0x7fc374004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740036a0 con 0x7fc3800b5290 2023-05-11T07:37:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37401f070 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38015a7b0 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374003a40 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.063+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3800cfab0 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.064+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38015dd20 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.065+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc374003ba0 con 0x7fc3800b5290 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.066+0000 7fc37d7fa700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 0x7fc36406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.066+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc374021070 con 0x7fc3800b5290 2023-05-11T07:37:03.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.066+0000 7fc37ffff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 0x7fc36406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.071 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.067+0000 7fc37ffff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 0x7fc36406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3800b4770 tx=0x7fc36c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.073 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.070+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc374055f00 con 0x7fc3800b5290 2023-05-11T07:37:03.270 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.266+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc380074580 con 0x7fc3800b5290 2023-05-11T07:37:03.271 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.268+0000 7fc37d7fa700 1 -- 172.21.15.144:0/4105972388 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fc374015090 con 0x7fc3800b5290 2023-05-11T07:37:03.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:03.272 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:03.273 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 msgr2=0x7fc36406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 0x7fc36406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3800b4770 tx=0x7fc36c009040 comp rx=0 tx=0).stop 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 msgr2=0x7fc3801f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc374009520 tx=0x7fc374004750 comp rx=0 tx=0).stop 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 shutdown_connections 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fc36406ace0 0x7fc36406d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc38015d880 0x7fc3801f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3800b5290 0x7fc3801f2fc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 --2- 172.21.15.144:0/4105972388 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fc38015a3e0 0x7fc380159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 >> 172.21.15.144:0/4105972388 conn(0x7fc38006ad30 msgr2=0x7fc38015b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 shutdown_connections 2023-05-11T07:37:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.270+0000 7fc386fff700 1 -- 172.21.15.144:0/4105972388 wait complete. 2023-05-11T07:37:03.291 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-11T07:37:03.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:37:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.473+0000 7efe715ff700 1 Processor -- start 2023-05-11T07:37:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.473+0000 7efe715ff700 1 -- start start 2023-05-11T07:37:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.474+0000 7efe715ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7efe6c158be0 0x7efe6c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.474+0000 7efe715ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c06b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.474+0000 7efe715ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c0cb2b0 con 0x7efe6c06bce0 2023-05-11T07:37:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.474+0000 7efe715ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c0c9790 con 0x7efe6c158be0 2023-05-11T07:37:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.474+0000 7efe715ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c15d3c0 con 0x7efe6c06af50 2023-05-11T07:37:03.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe6b7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efe6c06bce0 0x7efe6c070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49116/0 (socket says 172.21.15.144:49116) 2023-05-11T07:37:03.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe6b7fe700 1 -- 172.21.15.144:0/1379905201 learned_addr learned my addr 172.21.15.144:0/1379905201 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe63fff700 1 --2- 172.21.15.144:0/1379905201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c06b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe6affd700 1 --2- 172.21.15.144:0/1379905201 >> v2:172.21.15.145:3300/0 conn(0x7efe6c158be0 0x7efe6c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe6a7fc700 1 -- 172.21.15.144:0/1379905201 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773382588 0 0) 0x7efe6c0cb2b0 con 0x7efe6c06bce0 2023-05-11T07:37:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe6a7fc700 1 -- 172.21.15.144:0/1379905201 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe580035b0 con 0x7efe6c06bce0 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe63fff700 1 -- 172.21.15.144:0/1379905201 >> v2:172.21.15.145:3300/0 conn(0x7efe6c158be0 msgr2=0x7efe6c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe63fff700 1 --2- 172.21.15.144:0/1379905201 >> v2:172.21.15.145:3300/0 conn(0x7efe6c158be0 0x7efe6c0ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe63fff700 1 -- 172.21.15.144:0/1379905201 >> v1:172.21.15.144:6789/0 conn(0x7efe6c06bce0 legacy=0x7efe6c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.475+0000 7efe63fff700 1 -- 172.21.15.144:0/1379905201 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c15d6a0 con 0x7efe6c06af50 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe63fff700 1 --2- 172.21.15.144:0/1379905201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c06b7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe54009840 tx=0x7efe54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44df478daa2964a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe6a7fc700 1 -- 172.21.15.144:0/1379905201 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54011830 con 0x7efe6c06af50 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe6a7fc700 1 -- 172.21.15.144:0/1379905201 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54011990 con 0x7efe6c06af50 2023-05-11T07:37:03.481 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe6a7fc700 1 -- 172.21.15.144:0/1379905201 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54011d20 con 0x7efe6c06af50 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe715ff700 1 -- 172.21.15.144:0/1379905201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 msgr2=0x7efe6c06b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.476+0000 7efe715ff700 1 --2- 172.21.15.144:0/1379905201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c06b7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe54009840 tx=0x7efe54009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 -- 172.21.15.144:0/1379905201 shutdown_connections 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 --2- 172.21.15.144:0/1379905201 >> v2:172.21.15.145:3300/0 conn(0x7efe6c158be0 0x7efe6c0ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 --2- 172.21.15.144:0/1379905201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c06b7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 -- 172.21.15.144:0/1379905201 >> 172.21.15.144:0/1379905201 conn(0x7efe6c0cb7e0 msgr2=0x7efe6c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 -- 172.21.15.144:0/1379905201 shutdown_connections 2023-05-11T07:37:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.477+0000 7efe715ff700 1 -- 172.21.15.144:0/1379905201 wait complete. 2023-05-11T07:37:03.484 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.478+0000 7efe715ff700 1 Processor -- start 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.478+0000 7efe715ff700 1 -- start start 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c1e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe6c06bce0 0x7efe6c1e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c1e4b00 con 0x7efe6c158be0 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c1e3550 con 0x7efe6c06bce0 2023-05-11T07:37:03.485 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.479+0000 7efe715ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c1e3830 con 0x7efe6c06af50 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46648/0 (socket says 172.21.15.144:46648) 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 -- 172.21.15.144:0/1050111874 learned_addr learned my addr 172.21.15.144:0/1050111874 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6affd700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c1e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe63fff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe6c06bce0 0x7efe6c1e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 -- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 msgr2=0x7efe6c1e27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.486 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c1e27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 -- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe6c06bce0 msgr2=0x7efe6c1e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe6c06bce0 0x7efe6c1e2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 -- 172.21.15.144:0/1050111874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540094a0 con 0x7efe6c158be0 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe6b7fe700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efe6400caa0 tx=0x7efe6400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400a9e0 con 0x7efe6c158be0 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6400ab40 con 0x7efe6c158be0 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64012400 con 0x7efe6c158be0 2023-05-11T07:37:03.487 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.480+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c0ceab0 con 0x7efe6c158be0 2023-05-11T07:37:03.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.481+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c0c93b0 con 0x7efe6c158be0 2023-05-11T07:37:03.488 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.482+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c0caea0 con 0x7efe6c158be0 2023-05-11T07:37:03.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.482+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe6401b3b0 con 0x7efe6c158be0 2023-05-11T07:37:03.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.483+0000 7efe637fe700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.483+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efe64089590 con 0x7efe6c158be0 2023-05-11T07:37:03.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.483+0000 7efe6affd700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.489 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.484+0000 7efe6affd700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 0x7efe4c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efe6c1f18c0 tx=0x7efe5c00a320 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.491 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.487+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe64054310 con 0x7efe6c158be0 2023-05-11T07:37:03.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.720+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe6c0ae520 con 0x7efe6c158be0 2023-05-11T07:37:03.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.721+0000 7efe637fe700 1 -- 172.21.15.144:0/1050111874 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7efe64057930 con 0x7efe6c158be0 2023-05-11T07:37:03.725 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:03.725 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:37:03.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.723+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 msgr2=0x7efe4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.723+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 0x7efe4c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efe6c1f18c0 tx=0x7efe5c00a320 comp rx=0 tx=0).stop 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.723+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 msgr2=0x7efe6c1f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.723+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efe6400caa0 tx=0x7efe6400cdb0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 shutdown_connections 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efe4c06ace0 0x7efe4c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efe6c06af50 0x7efe6c1e27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe6c158be0 0x7efe6c1f0790 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 --2- 172.21.15.144:0/1050111874 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe6c06bce0 0x7efe6c1e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 >> 172.21.15.144:0/1050111874 conn(0x7efe6c0cb7e0 msgr2=0x7efe6c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:03.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 shutdown_connections 2023-05-11T07:37:03.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.724+0000 7efe715ff700 1 -- 172.21.15.144:0/1050111874 wait complete. 2023-05-11T07:37:03.729 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:37:03.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:37:03.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.925+0000 7f4a44bff700 1 Processor -- start 2023-05-11T07:37:03.929 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.926+0000 7f4a44bff700 1 -- start start 2023-05-11T07:37:03.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a44bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400b87e0 0x7f4a400b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a44bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a400d27a0 0x7f4a400b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a44bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4015cef0 con 0x7f4a400d02c0 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a44bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a400b5a80 con 0x7f4a400d27a0 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a44bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a400cdf70 con 0x7f4a400b87e0 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a37fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a400d02c0 0x7f4a400d2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49122/0 (socket says 172.21.15.144:49122) 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a37fff700 1 -- 172.21.15.144:0/966198185 learned_addr learned my addr 172.21.15.144:0/966198185 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:03.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a3ed9d700 1 --2- 172.21.15.144:0/966198185 >> v2:172.21.15.144:3300/0 conn(0x7f4a400d27a0 0x7f4a400b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.927+0000 7f4a3e59c700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400b87e0 0x7f4a400b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3ed9d700 1 -- 172.21.15.144:0/966198185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400b87e0 msgr2=0x7f4a400b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3ed9d700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400b87e0 0x7f4a400b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3ed9d700 1 -- 172.21.15.144:0/966198185 >> v1:172.21.15.144:6789/0 conn(0x7f4a400d02c0 legacy=0x7f4a400d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3ed9d700 1 -- 172.21.15.144:0/966198185 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400cd760 con 0x7f4a400d27a0 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3ed9d700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d27a0 0x7f4a400b50d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009d90 tx=0x7f4a3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c313ccaf857a51d2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3dd9b700 1 -- 172.21.15.144:0/966198185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800e070 con 0x7f4a400d27a0 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3dd9b700 1 -- 172.21.15.144:0/966198185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3800bb20 con 0x7f4a400d27a0 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.928+0000 7f4a3dd9b700 1 -- 172.21.15.144:0/966198185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38012430 con 0x7f4a400d27a0 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 -- 172.21.15.144:0/966198185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d27a0 msgr2=0x7f4a400b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d27a0 0x7f4a400b50d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009d90 tx=0x7f4a3800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 -- 172.21.15.144:0/966198185 shutdown_connections 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d27a0 0x7f4a400b50d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 --2- 172.21.15.144:0/966198185 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400b87e0 0x7f4a400b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 -- 172.21.15.144:0/966198185 >> 172.21.15.144:0/966198185 conn(0x7f4a4006acf0 msgr2=0x7f4a4006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:03.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 -- 172.21.15.144:0/966198185 shutdown_connections 2023-05-11T07:37:03.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.929+0000 7f4a44bff700 1 -- 172.21.15.144:0/966198185 wait complete. 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.930+0000 7f4a44bff700 1 Processor -- start 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.931+0000 7f4a44bff700 1 -- start start 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.931+0000 7f4a44bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a400b87e0 0x7f4a400d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.931+0000 7f4a44bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a44bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400d27a0 0x7f4a40153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a44bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40154510 con 0x7f4a400d02c0 2023-05-11T07:37:03.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a44bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401e89b0 con 0x7f4a400b87e0 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a44bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401e72c0 con 0x7f4a400d27a0 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46668/0 (socket says 172.21.15.144:46668) 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 -- 172.21.15.144:0/2941989630 learned_addr learned my addr 172.21.15.144:0/2941989630 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a3e59c700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a400b87e0 0x7f4a400d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a3ed9d700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400d27a0 0x7f4a40153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 -- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400d27a0 msgr2=0x7f4a40153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400d27a0 0x7f4a40153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 -- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a400b87e0 msgr2=0x7f4a400d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a400b87e0 0x7f4a400d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 -- 172.21.15.144:0/2941989630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009a70 con 0x7f4a400d02c0 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.932+0000 7f4a37fff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c520 tx=0x7f4a2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.933+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28005d70 con 0x7f4a400d02c0 2023-05-11T07:37:03.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.933+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280070d0 con 0x7f4a400d02c0 2023-05-11T07:37:03.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.933+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28007440 con 0x7f4a400d02c0 2023-05-11T07:37:03.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.933+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a400cd9b0 con 0x7f4a400d02c0 2023-05-11T07:37:03.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.933+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a400d2d30 con 0x7f4a400d02c0 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.934+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a400cdc90 con 0x7f4a400d02c0 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.935+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a280075a0 con 0x7f4a400d02c0 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.936+0000 7f4a36ffd700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.936+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a28088890 con 0x7f4a400d02c0 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.936+0000 7f4a3e59c700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:03.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.937+0000 7f4a3e59c700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a400c7c80 tx=0x7f4a30009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:03.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:03.940+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4a280536b0 con 0x7f4a400d02c0 2023-05-11T07:37:04.189 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.186+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a4015ced0 con 0x7f4a400d02c0 2023-05-11T07:37:04.190 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.186+0000 7f4a36ffd700 1 -- 172.21.15.144:0/2941989630 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f4a28056cd0 con 0x7f4a400d02c0 2023-05-11T07:37:04.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:04.191 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2601265263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2601265263},{"type":"v1","addr":"172.21.15.144:6836","nonce":2601265263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/4249617113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":4249617113},{"type":"v1","addr":"172.21.15.145:6835","nonce":4249617113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2497731129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2497731129},{"type":"v1","addr":"172.21.15.144:6837","nonce":2497731129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:35:39.989779+0000","modified":"2023-05-11T07:36:07.268421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6834/3653158291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3653158291},{"type":"v1","addr":"172.21.15.145:6834","nonce":3653158291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T07:37:04.192 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 msgr2=0x7f4a2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a400c7c80 tx=0x7f4a30009210 comp rx=0 tx=0).stop 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 msgr2=0x7f4a40153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c520 tx=0x7f4a2800c830 comp rx=0 tx=0).stop 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 shutdown_connections 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4a2006ace0 0x7f4a2006d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4a400d27a0 0x7f4a40153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a400b87e0 0x7f4a400d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 --2- 172.21.15.144:0/2941989630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a400d02c0 0x7f4a40153a90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 >> 172.21.15.144:0/2941989630 conn(0x7f4a4006acf0 msgr2=0x7f4a400b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:04.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 shutdown_connections 2023-05-11T07:37:04.194 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.189+0000 7f4a44bff700 1 -- 172.21.15.144:0/2941989630 wait complete. 2023-05-11T07:37:04.194 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 9 2023-05-11T07:37:04.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:04.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.390+0000 7fca3cbff700 1 Processor -- start 2023-05-11T07:37:04.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.390+0000 7fca3cbff700 1 -- start start 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3cbff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca3815cc30 0x7fca380b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3cbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 0x7fca3806b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3cbff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380b3dc0 con 0x7fca380b23f0 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3cbff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380d08d0 con 0x7fca3815cc30 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3cbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380d0bb0 con 0x7fca3815d000 2023-05-11T07:37:04.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca3815cc30 0x7fca380b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3659c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca3815cc30 0x7fca380b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46680/0 (socket says 172.21.15.144:46680) 2023-05-11T07:37:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.391+0000 7fca3659c700 1 -- 172.21.15.144:0/618608743 learned_addr learned my addr 172.21.15.144:0/618608743 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:04.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca2ffff700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 0x7fca3806b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca3659c700 1 -- 172.21.15.144:0/618608743 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 msgr2=0x7fca3806b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca3659c700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 0x7fca3806b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca3659c700 1 -- 172.21.15.144:0/618608743 >> v1:172.21.15.145:6789/0 conn(0x7fca380b23f0 legacy=0x7fca380ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca3659c700 1 -- 172.21.15.144:0/618608743 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380b4010 con 0x7fca3815cc30 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca2ffff700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 0x7fca3806b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca3659c700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b1db0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca280098f0 tx=0x7fca28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4756de8792fcf971 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca35d9b700 1 -- 172.21.15.144:0/618608743 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800b8a0 con 0x7fca3815cc30 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca35d9b700 1 -- 172.21.15.144:0/618608743 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800ba00 con 0x7fca3815cc30 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.392+0000 7fca35d9b700 1 -- 172.21.15.144:0/618608743 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800bd90 con 0x7fca3815cc30 2023-05-11T07:37:04.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 -- 172.21.15.144:0/618608743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 msgr2=0x7fca380b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b1db0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca280098f0 tx=0x7fca28009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 -- 172.21.15.144:0/618608743 shutdown_connections 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b1db0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 --2- 172.21.15.144:0/618608743 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca3815d000 0x7fca3806b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 -- 172.21.15.144:0/618608743 >> 172.21.15.144:0/618608743 conn(0x7fca3809a2e0 msgr2=0x7fca380d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 -- 172.21.15.144:0/618608743 shutdown_connections 2023-05-11T07:37:04.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.393+0000 7fca3cbff700 1 -- 172.21.15.144:0/618608743 wait complete. 2023-05-11T07:37:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.395+0000 7fca3cbff700 1 Processor -- start 2023-05-11T07:37:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.395+0000 7fca3cbff700 1 -- start start 2023-05-11T07:37:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca380b23f0 0x7fca3814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 0x7fca380b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c4bb0 con 0x7fca3815cc30 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c4e90 con 0x7fca3815d000 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3cbff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c5170 con 0x7fca380b23f0 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46696/0 (socket says 172.21.15.144:46696) 2023-05-11T07:37:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 -- 172.21.15.144:0/72042869 learned_addr learned my addr 172.21.15.144:0/72042869 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca3659c700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca380b23f0 0x7fca3814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca36d9d700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 0x7fca380b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 -- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca380b23f0 msgr2=0x7fca3814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca380b23f0 0x7fca3814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 -- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 msgr2=0x7fca380b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 0x7fca380b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca2ffff700 1 -- 172.21.15.144:0/72042869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28009550 con 0x7fca3815cc30 2023-05-11T07:37:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.396+0000 7fca36d9d700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 0x7fca380b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca2ffff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca2000e810 tx=0x7fca2000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000c020 con 0x7fca3815cc30 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20004250 con 0x7fca3815cc30 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380d0560 con 0x7fca3815cc30 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200036a0 con 0x7fca3815cc30 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.397+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca380b42f0 con 0x7fca3815cc30 2023-05-11T07:37:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.398+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca380b5820 con 0x7fca3815cc30 2023-05-11T07:37:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.399+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca20003800 con 0x7fca3815cc30 2023-05-11T07:37:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.400+0000 7fca2effd700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 0x7fca1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.400+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca200891f0 con 0x7fca3815cc30 2023-05-11T07:37:04.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.400+0000 7fca3659c700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 0x7fca1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.406 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.400+0000 7fca3659c700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 0x7fca1806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca28009c40 tx=0x7fca28008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.407 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.404+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fca20053f60 con 0x7fca3815cc30 2023-05-11T07:37:04.600 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.596+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca380708d0 con 0x7fca3815cc30 2023-05-11T07:37:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.598+0000 7fca2effd700 1 -- 172.21.15.144:0/72042869 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20251 (secure 0 0 0) 0x7fca20057580 con 0x7fca3815cc30 2023-05-11T07:37:04.601 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:04.602 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:36:21.533228+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:35:37.712980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T07:35:38.968347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T07:35:42.046200+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:04.603 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 msgr2=0x7fca1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 0x7fca1806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca28009c40 tx=0x7fca28008030 comp rx=0 tx=0).stop 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 msgr2=0x7fca380b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca2000e810 tx=0x7fca2000eb20 comp rx=0 tx=0).stop 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 shutdown_connections 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fca1806ace0 0x7fca1806d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fca380b23f0 0x7fca3814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca3815d000 0x7fca380b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 --2- 172.21.15.144:0/72042869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca3815cc30 0x7fca380b5b90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 >> 172.21.15.144:0/72042869 conn(0x7fca3809a2e0 msgr2=0x7fca3806fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 shutdown_connections 2023-05-11T07:37:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.600+0000 7fca3cbff700 1 -- 172.21.15.144:0/72042869 wait complete. 2023-05-11T07:37:04.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-11T07:37:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.804+0000 7f3b851ff700 1 Processor -- start 2023-05-11T07:37:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.805+0000 7f3b851ff700 1 -- start start 2023-05-11T07:37:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b851ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f3b800cf880 0x7f3b8015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b851ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 0x7f3b8006a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b851ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800ceb70 con 0x7f3b8015c960 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b851ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b800af610 con 0x7f3b800cf880 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b851ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800af330 con 0x7f3b80161340 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b7ed9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3b8015c960 0x7f3b800aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49126/0 (socket says 172.21.15.144:49126) 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b7ed9d700 1 -- 172.21.15.144:0/3913545733 learned_addr learned my addr 172.21.15.144:0/3913545733 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b77fff700 1 --2- 172.21.15.144:0/3913545733 >> v2:172.21.15.145:3300/0 conn(0x7f3b800cf880 0x7f3b8015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.806+0000 7f3b7f59e700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 0x7f3b8006a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7e59c700 1 -- 172.21.15.144:0/3913545733 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308307756 0 0) 0x7f3b800ceb70 con 0x7f3b8015c960 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7e59c700 1 -- 172.21.15.144:0/3913545733 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c0035b0 con 0x7f3b8015c960 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b77fff700 1 -- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 msgr2=0x7f3b8006a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b77fff700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 0x7f3b8006a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b77fff700 1 -- 172.21.15.144:0/3913545733 >> v1:172.21.15.144:6789/0 conn(0x7f3b8015c960 legacy=0x7f3b800aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b77fff700 1 -- 172.21.15.144:0/3913545733 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800ceda0 con 0x7f3b800cf880 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7f59e700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 0x7f3b8006a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b77fff700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b800cf880 0x7f3b8015cd30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009840 tx=0x7f3b68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7fcdabef309b1b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7e59c700 1 -- 172.21.15.144:0/3913545733 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68011830 con 0x7f3b800cf880 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7e59c700 1 -- 172.21.15.144:0/3913545733 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68011990 con 0x7f3b800cf880 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.807+0000 7f3b7e59c700 1 -- 172.21.15.144:0/3913545733 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68011d20 con 0x7f3b800cf880 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 -- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b800cf880 msgr2=0x7f3b8015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.814 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b800cf880 0x7f3b8015cd30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009840 tx=0x7f3b68009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 -- 172.21.15.144:0/3913545733 shutdown_connections 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b80161340 0x7f3b8006a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 --2- 172.21.15.144:0/3913545733 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b800cf880 0x7f3b8015cd30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 -- 172.21.15.144:0/3913545733 >> 172.21.15.144:0/3913545733 conn(0x7f3b800cc830 msgr2=0x7f3b800ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 -- 172.21.15.144:0/3913545733 shutdown_connections 2023-05-11T07:37:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.808+0000 7f3b851ff700 1 -- 172.21.15.144:0/3913545733 wait complete. 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.810+0000 7f3b851ff700 1 Processor -- start 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.810+0000 7f3b851ff700 1 -- start start 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b8015c960 0x7f3b80151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80161340 0x7f3b800c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8015cff0 con 0x7f3b800cf880 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c96b0 con 0x7f3b80161340 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b851ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c9950 con 0x7f3b8015c960 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46708/0 (socket says 172.21.15.144:46708) 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 -- 172.21.15.144:0/374483893 learned_addr learned my addr 172.21.15.144:0/374483893 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b77fff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b8015c960 0x7f3b80151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7f59e700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80161340 0x7f3b800c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 -- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b8015c960 msgr2=0x7f3b80151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b8015c960 0x7f3b80151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 -- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80161340 msgr2=0x7f3b800c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80161340 0x7f3b800c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.812+0000 7f3b7ed9d700 1 -- 172.21.15.144:0/374483893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009a70 con 0x7f3b800cf880 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b7ed9d700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c700 tx=0x7f3b7000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70005d70 con 0x7f3b800cf880 2023-05-11T07:37:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b700070d0 con 0x7f3b800cf880 2023-05-11T07:37:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b680094a0 con 0x7f3b800cf880 2023-05-11T07:37:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70007460 con 0x7f3b800cf880 2023-05-11T07:37:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.813+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b800cf360 con 0x7f3b800cf880 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.814+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b800cf080 con 0x7f3b800cf880 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.815+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b700075c0 con 0x7f3b800cf880 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.816+0000 7f3b777fe700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 0x7f3b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.816+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3b70088d70 con 0x7f3b800cf880 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.816+0000 7f3b77fff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 0x7f3b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:04.821 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.817+0000 7f3b77fff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 0x7f3b6006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b68000c00 tx=0x7f3b68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:04.823 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:04.820+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3b70053af0 con 0x7f3b800cf880 2023-05-11T07:37:05.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.056+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3b8006a810 con 0x7f3b800cf880 2023-05-11T07:37:05.646 INFO:tasks.ceph.mon.a.smithi144.stderr:2023-05-11T07:37:05.642+0000 7f4b373f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-11T07:37:05.653 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.650+0000 7f3b777fe700 1 -- 172.21.15.144:0/374483893 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3b70057110 con 0x7f3b800cf880 2023-05-11T07:37:05.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 msgr2=0x7f3b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 0x7f3b6006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b68000c00 tx=0x7f3b68008030 comp rx=0 tx=0).stop 2023-05-11T07:37:05.657 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 msgr2=0x7f3b800c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c700 tx=0x7f3b7000ca10 comp rx=0 tx=0).stop 2023-05-11T07:37:05.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 shutdown_connections 2023-05-11T07:37:05.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f3b6006ace0 0x7f3b6006d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80161340 0x7f3b800c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b800cf880 0x7f3b800c6e80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 --2- 172.21.15.144:0/374483893 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f3b8015c960 0x7f3b80151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 >> 172.21.15.144:0/374483893 conn(0x7f3b800cc830 msgr2=0x7f3b800cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:05.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 shutdown_connections 2023-05-11T07:37:05.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.653+0000 7f3b851ff700 1 -- 172.21.15.144:0/374483893 wait complete. 2023-05-11T07:37:05.660 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-11T07:37:05.665 INFO:tasks.ceph.mds.d.smithi145.stderr: -6480> 2023-05-11T07:35:45.016+0000 7f65a79f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T07:37:05.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-11T07:37:05.718 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-05-11T07:37:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.865+0000 7f9bce7ff700 1 Processor -- start 2023-05-11T07:37:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.866+0000 7f9bce7ff700 1 -- start start 2023-05-11T07:37:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bce7ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9bc8160ee0 0x7f9bc806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bce7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 0x7f9bc80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bce7ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80d0e80 con 0x7f9bc815c940 2023-05-11T07:37:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bce7ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc806b600 con 0x7f9bc8160ee0 2023-05-11T07:37:05.871 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bce7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80cdb00 con 0x7f9bc806b180 2023-05-11T07:37:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bc7fff700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f9bc815c940 0x7f9bc80b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:43204/0 (socket says 172.21.15.144:43204) 2023-05-11T07:37:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bc7fff700 1 -- 172.21.15.144:0/3896908151 learned_addr learned my addr 172.21.15.144:0/3896908151 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3896908151 >> v2:172.21.15.145:3300/0 conn(0x7f9bc8160ee0 0x7f9bc806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bccd9c700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 0x7f9bc80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bc77fe700 1 -- 172.21.15.144:0/3896908151 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978590169 0 0) 0x7f9bc80d0e80 con 0x7f9bc815c940 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.867+0000 7f9bc77fe700 1 -- 172.21.15.144:0/3896908151 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb40035b0 con 0x7f9bc815c940 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bbffff700 1 -- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 msgr2=0x7f9bc80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 0x7f9bc80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bbffff700 1 -- 172.21.15.144:0/3896908151 >> v1:172.21.15.145:6789/0 conn(0x7f9bc815c940 legacy=0x7f9bc80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bbffff700 1 -- 172.21.15.144:0/3896908151 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80cdde0 con 0x7f9bc8160ee0 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bccd9c700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 0x7f9bc80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc8160ee0 0x7f9bc806ac40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009840 tx=0x7f9bb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7007d107e23b3f79 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bc77fe700 1 -- 172.21.15.144:0/3896908151 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0011830 con 0x7f9bc8160ee0 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bc77fe700 1 -- 172.21.15.144:0/3896908151 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0011990 con 0x7f9bc8160ee0 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.868+0000 7f9bc77fe700 1 -- 172.21.15.144:0/3896908151 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0011d00 con 0x7f9bc8160ee0 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc8160ee0 msgr2=0x7f9bc806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc8160ee0 0x7f9bc806ac40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009840 tx=0x7f9bb0009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3896908151 shutdown_connections 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc806b180 0x7f9bc80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3896908151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc8160ee0 0x7f9bc806ac40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3896908151 >> 172.21.15.144:0/3896908151 conn(0x7f9bc80d3180 msgr2=0x7f9bc80d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3896908151 shutdown_connections 2023-05-11T07:37:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.869+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3896908151 wait complete. 2023-05-11T07:37:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.870+0000 7f9bce7ff700 1 Processor -- start 2023-05-11T07:37:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.871+0000 7f9bce7ff700 1 -- start start 2023-05-11T07:37:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.871+0000 7f9bce7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 0x7f9bc81521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.871+0000 7f9bce7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bce7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc8160ee0 0x7f9bc80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bce7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc81f5f10 con 0x7f9bc815c940 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bce7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80c9550 con 0x7f9bc806b180 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bce7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80cb860 con 0x7f9bc8160ee0 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 0x7f9bc81521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46716/0 (socket says 172.21.15.144:46716) 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bbffff700 1 -- 172.21.15.144:0/3675566310 learned_addr learned my addr 172.21.15.144:0/3675566310 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bccd9c700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc8160ee0 0x7f9bc80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 -- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc8160ee0 msgr2=0x7f9bc80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc8160ee0 0x7f9bc80c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 -- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 msgr2=0x7f9bc81f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bc7fff700 1 -- 172.21.15.144:0/3675566310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0009a70 con 0x7f9bc806b180 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.872+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bc7fff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 0x7f9bc81521a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c420 tx=0x7f9bb800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8005d70 con 0x7f9bc806b180 2023-05-11T07:37:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800ce20 con 0x7f9bc806b180 2023-05-11T07:37:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb00094a0 con 0x7f9bc806b180 2023-05-11T07:37:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80072f0 con 0x7f9bc806b180 2023-05-11T07:37:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.873+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc80d1400 con 0x7f9bc806b180 2023-05-11T07:37:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.874+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc80d1120 con 0x7f9bc806b180 2023-05-11T07:37:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.875+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9bb8007450 con 0x7f9bc806b180 2023-05-11T07:37:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.876+0000 7f9bc57fa700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 0x7f9ba806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.876+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f9bb8088d80 con 0x7f9bc806b180 2023-05-11T07:37:05.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.876+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 0x7f9ba806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:05.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.877+0000 7f9bbffff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 0x7f9ba806d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009b90 tx=0x7f9bb001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:05.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:05.880+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9bb8053b20 con 0x7f9bc806b180 2023-05-11T07:37:06.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.116+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9bc80b66e0 con 0x7f9bc806b180 2023-05-11T07:37:06.660 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.656+0000 7f9bc57fa700 1 -- 172.21.15.144:0/3675566310 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bb8057140 con 0x7f9bc806b180 2023-05-11T07:37:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 msgr2=0x7f9ba806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 0x7f9ba806d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009b90 tx=0x7f9bb001c040 comp rx=0 tx=0).stop 2023-05-11T07:37:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 msgr2=0x7f9bc81521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 0x7f9bc81521a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c420 tx=0x7f9bb800c730 comp rx=0 tx=0).stop 2023-05-11T07:37:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 shutdown_connections 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f9ba806ace0 0x7f9ba806d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f9bc8160ee0 0x7f9bc80c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bc806b180 0x7f9bc81521a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 --2- 172.21.15.144:0/3675566310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bc815c940 0x7f9bc81f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 >> 172.21.15.144:0/3675566310 conn(0x7f9bc80d3180 msgr2=0x7f9bc8160780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 shutdown_connections 2023-05-11T07:37:06.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.659+0000 7f9bce7ff700 1 -- 172.21.15.144:0/3675566310 wait complete. 2023-05-11T07:37:06.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-11T07:37:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.872+0000 7fb7577ff700 1 Processor -- start 2023-05-11T07:37:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.873+0000 7fb7577ff700 1 -- start start 2023-05-11T07:37:06.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb75015ca70 0x7fb75006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb7500d2970 0x7fb75006ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb75006b160 0x7fb750160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75006b5e0 con 0x7fb75006b160 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7500cfa10 con 0x7fb7500d2970 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb7577ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500cded0 con 0x7fb75015ca70 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb755d9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb75006b160 0x7fb750160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb755d9c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb75006b160 0x7fb750160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60238/0 (socket says 172.21.15.144:60238) 2023-05-11T07:37:06.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb755d9c700 1 -- 172.21.15.144:0/1112834848 learned_addr learned my addr 172.21.15.144:0/1112834848 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:06.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb75559b700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb75015ca70 0x7fb75006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.879 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.874+0000 7fb754d9a700 1 --2- 172.21.15.144:0/1112834848 >> v2:172.21.15.145:3300/0 conn(0x7fb7500d2970 0x7fb75006ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 -- 172.21.15.144:0/1112834848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb75015ca70 msgr2=0x7fb75006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb75015ca70 0x7fb75006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 -- 172.21.15.144:0/1112834848 >> v2:172.21.15.145:3300/0 conn(0x7fb7500d2970 msgr2=0x7fb75006ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 --2- 172.21.15.144:0/1112834848 >> v2:172.21.15.145:3300/0 conn(0x7fb7500d2970 0x7fb75006ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 -- 172.21.15.144:0/1112834848 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500cf730 con 0x7fb75006b160 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb755d9c700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb750160460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b5ce0 tx=0x7fb74800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccf7667fd8fd144 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb747fff700 1 -- 172.21.15.144:0/1112834848 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800e070 con 0x7fb75006b160 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb747fff700 1 -- 172.21.15.144:0/1112834848 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74800b910 con 0x7fb75006b160 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.875+0000 7fb747fff700 1 -- 172.21.15.144:0/1112834848 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74800bcc0 con 0x7fb75006b160 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 -- 172.21.15.144:0/1112834848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 msgr2=0x7fb750160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb750160460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b5ce0 tx=0x7fb74800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 -- 172.21.15.144:0/1112834848 shutdown_connections 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb750160460 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 --2- 172.21.15.144:0/1112834848 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb75015ca70 0x7fb75006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 --2- 172.21.15.144:0/1112834848 >> v2:172.21.15.145:3300/0 conn(0x7fb7500d2970 0x7fb75006ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 -- 172.21.15.144:0/1112834848 >> 172.21.15.144:0/1112834848 conn(0x7fb7500d3120 msgr2=0x7fb7500d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 -- 172.21.15.144:0/1112834848 shutdown_connections 2023-05-11T07:37:06.882 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.876+0000 7fb7577ff700 1 -- 172.21.15.144:0/1112834848 wait complete. 2023-05-11T07:37:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.877+0000 7fb7577ff700 1 Processor -- start 2023-05-11T07:37:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.878+0000 7fb7577ff700 1 -- start start 2023-05-11T07:37:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.878+0000 7fb7577ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.878+0000 7fb7577ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7500d2970 0x7fb7500b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb7577ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb75015ca70 0x7fb7500b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb7577ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b5680 con 0x7fb75006b160 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb7577ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b3ca0 con 0x7fb75015ca70 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb7577ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500b3f80 con 0x7fb7500d2970 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60244/0 (socket says 172.21.15.144:60244) 2023-05-11T07:37:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 -- 172.21.15.144:0/2827908709 learned_addr learned my addr 172.21.15.144:0/2827908709 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb754d9a700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7500d2970 0x7fb7500b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb755d9c700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb75015ca70 0x7fb7500b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 -- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7500d2970 msgr2=0x7fb7500b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7500d2970 0x7fb7500b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 -- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb75015ca70 msgr2=0x7fb7500b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb75015ca70 0x7fb7500b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 -- 172.21.15.144:0/2827908709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748009b30 con 0x7fb75006b160 2023-05-11T07:37:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.879+0000 7fb75559b700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00e870 tx=0x7fb74c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.880+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c009590 con 0x7fb75006b160 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.880+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c00ee70 con 0x7fb75006b160 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.880+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00ca50 con 0x7fb75006b160 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.880+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7500cdb60 con 0x7fb75006b160 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.880+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7500cd880 con 0x7fb75006b160 2023-05-11T07:37:06.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.881+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7500d2de0 con 0x7fb75006b160 2023-05-11T07:37:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.882+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb74c00cbb0 con 0x7fb75006b160 2023-05-11T07:37:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.882+0000 7fb745ffb700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 0x7fb73406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.883+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fb74c0898b0 con 0x7fb75006b160 2023-05-11T07:37:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.883+0000 7fb754d9a700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 0x7fb73406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.883+0000 7fb754d9a700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 0x7fb73406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b8c60 tx=0x7fb740008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:06.887+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb74c057fd0 con 0x7fb75006b160 2023-05-11T07:37:07.083 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.079+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7501f26b0 con 0x7fb75006b160 2023-05-11T07:37:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.730+0000 7fb745ffb700 1 -- 172.21.15.144:0/2827908709 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb74c0210d0 con 0x7fb75006b160 2023-05-11T07:37:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 msgr2=0x7fb73406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 0x7fb73406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b8c60 tx=0x7fb740008040 comp rx=0 tx=0).stop 2023-05-11T07:37:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 msgr2=0x7fb7501f1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00e870 tx=0x7fb74c00ec30 comp rx=0 tx=0).stop 2023-05-11T07:37:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 shutdown_connections 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb73406ace0 0x7fb73406d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb75015ca70 0x7fb7500b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb75006b160 0x7fb7501f1d60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 --2- 172.21.15.144:0/2827908709 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb7500d2970 0x7fb7500b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.734+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 >> 172.21.15.144:0/2827908709 conn(0x7fb7500d3120 msgr2=0x7fb7500ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.735+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 shutdown_connections 2023-05-11T07:37:07.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.735+0000 7fb7577ff700 1 -- 172.21.15.144:0/2827908709 wait complete. 2023-05-11T07:37:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2023-05-11T07:37:07.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-11T07:37:07.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.946+0000 7f20aabff700 1 Processor -- start 2023-05-11T07:37:07.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.946+0000 7f20aabff700 1 -- start start 2023-05-11T07:37:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20aabff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a415cd10 0x7f20a406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20aabff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20a40d01e0 0x7f20a406b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20aabff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a406e690 con 0x7f20a406b920 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20aabff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40d0080 con 0x7f20a40d01e0 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20aabff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a406bd90 con 0x7f20a415cd10 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20a3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20a40d01e0 0x7f20a406b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20a3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20a40d01e0 0x7f20a406b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60250/0 (socket says 172.21.15.144:60250) 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.947+0000 7f20a3fff700 1 -- 172.21.15.144:0/2002847520 learned_addr learned my addr 172.21.15.144:0/2002847520 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a899b700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a415cd10 0x7f20a406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a3fff700 1 -- 172.21.15.144:0/2002847520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a415cd10 msgr2=0x7f20a406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a3fff700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a415cd10 0x7f20a406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a3fff700 1 -- 172.21.15.144:0/2002847520 >> v1:172.21.15.145:6789/0 conn(0x7f20a406b920 legacy=0x7f20a40ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a3fff700 1 -- 172.21.15.144:0/2002847520 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a406e970 con 0x7f20a40d01e0 2023-05-11T07:37:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a3fff700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a406b3e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2090009920 tx=0x7f2090009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee91df149b55c046 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a37fe700 1 -- 172.21.15.144:0/2002847520 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090011830 con 0x7f20a40d01e0 2023-05-11T07:37:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a37fe700 1 -- 172.21.15.144:0/2002847520 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2090011990 con 0x7f20a40d01e0 2023-05-11T07:37:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.948+0000 7f20a37fe700 1 -- 172.21.15.144:0/2002847520 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090011d20 con 0x7f20a40d01e0 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 -- 172.21.15.144:0/2002847520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 msgr2=0x7f20a406b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a406b3e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2090009920 tx=0x7f2090009c30 comp rx=0 tx=0).stop 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 -- 172.21.15.144:0/2002847520 shutdown_connections 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a415cd10 0x7f20a406f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 --2- 172.21.15.144:0/2002847520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a406b3e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 -- 172.21.15.144:0/2002847520 >> 172.21.15.144:0/2002847520 conn(0x7f20a409a230 msgr2=0x7f20a40d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 -- 172.21.15.144:0/2002847520 shutdown_connections 2023-05-11T07:37:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.949+0000 7f20aabff700 1 -- 172.21.15.144:0/2002847520 wait complete. 2023-05-11T07:37:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.951+0000 7f20aabff700 1 Processor -- start 2023-05-11T07:37:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.951+0000 7f20aabff700 1 -- start start 2023-05-11T07:37:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 0x7f20a4157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20a415cd10 0x7f20a409b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40c5dc0 con 0x7f20a40d01e0 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a409e090 con 0x7f20a415cd10 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20aabff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a409e370 con 0x7f20a406b920 2023-05-11T07:37:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60260/0 (socket says 172.21.15.144:60260) 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 -- 172.21.15.144:0/790029180 learned_addr learned my addr 172.21.15.144:0/790029180 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a899b700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 0x7f20a4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a919c700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20a415cd10 0x7f20a409b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 -- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 msgr2=0x7f20a4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 0x7f20a4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 -- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20a415cd10 msgr2=0x7f20a409b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20a415cd10 0x7f20a409b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a3fff700 1 -- 172.21.15.144:0/790029180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090009550 con 0x7f20a40d01e0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.952+0000 7f20a899b700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 0x7f20a4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20a3fff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090004510 con 0x7f20a40d01e0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209001f070 con 0x7f20a40d01e0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a406ef30 con 0x7f20a40d01e0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900038e0 con 0x7f20a40d01e0 2023-05-11T07:37:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.953+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a406ec50 con 0x7f20a40d01e0 2023-05-11T07:37:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.954+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a406f990 con 0x7f20a40d01e0 2023-05-11T07:37:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.955+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2090003a40 con 0x7f20a40d01e0 2023-05-11T07:37:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.956+0000 7f20a17fa700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 0x7f208806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.956+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f2090021070 con 0x7f20a40d01e0 2023-05-11T07:37:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.956+0000 7f20a899b700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 0x7f208806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.957+0000 7f20a899b700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 0x7f208806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2098009b70 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:07.961+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2090055980 con 0x7f20a40d01e0 2023-05-11T07:37:08.175 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.172+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20a40c47c0 con 0x7f20a40d01e0 2023-05-11T07:37:08.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.733+0000 7f20a17fa700 1 -- 172.21.15.144:0/790029180 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f209002a0d0 con 0x7f20a40d01e0 2023-05-11T07:37:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 msgr2=0x7f208806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 0x7f208806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2098009b70 tx=0x7f2098008040 comp rx=0 tx=0).stop 2023-05-11T07:37:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 msgr2=0x7f20a409afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f2090004750 comp rx=0 tx=0).stop 2023-05-11T07:37:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 shutdown_connections 2023-05-11T07:37:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f208806ace0 0x7f208806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f20a406b920 0x7f20a4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20a415cd10 0x7f20a409b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 --2- 172.21.15.144:0/790029180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a40d01e0 0x7f20a409afd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.737+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 >> 172.21.15.144:0/790029180 conn(0x7f20a409a230 msgr2=0x7f20a406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:08.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.738+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 shutdown_connections 2023-05-11T07:37:08.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.738+0000 7f20aabff700 1 -- 172.21.15.144:0/790029180 wait complete. 2023-05-11T07:37:08.743 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2023-05-11T07:37:08.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-11T07:37:08.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.948+0000 7fa0699ff700 1 Processor -- start 2023-05-11T07:37:08.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.949+0000 7fa0699ff700 1 -- start start 2023-05-11T07:37:08.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 0x7fa06415a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:08.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0699ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06415a080 con 0x7fa06406dfb0 2023-05-11T07:37:08.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0699ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06415db40 con 0x7fa0640709d0 2023-05-11T07:37:08.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0699ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415de20 con 0x7fa06415d560 2023-05-11T07:37:08.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa05bfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa06406dfb0 0x7fa06406c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57376/0 (socket says 172.21.15.144:57376) 2023-05-11T07:37:08.954 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa05bfff700 1 -- 172.21.15.144:0/66274527 learned_addr learned my addr 172.21.15.144:0/66274527 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:08.955 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0637fe700 1 --2- 172.21.15.144:0/66274527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 0x7fa06415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356334926 0 0) 0x7fa06415a080 con 0x7fa06406dfb0 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.950+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0500035b0 con 0x7fa06406dfb0 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798136397 0 0) 0x7fa06415db40 con 0x7fa0640709d0 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa06415a080 con 0x7fa0640709d0 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0637fe700 1 -- 172.21.15.144:0/66274527 >> v1:172.21.15.145:6789/0 conn(0x7fa0640709d0 legacy=0x7fa064070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0637fe700 1 -- 172.21.15.144:0/66274527 >> v1:172.21.15.144:6789/0 conn(0x7fa06406dfb0 legacy=0x7fa06406c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0637fe700 1 -- 172.21.15.144:0/66274527 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06415e100 con 0x7fa06415d560 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0637fe700 1 --2- 172.21.15.144:0/66274527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 0x7fa06415a530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009dc0 tx=0x7fa05c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afd3b408286d822 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00e070 con 0x7fa06415d560 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00bb20 con 0x7fa06415d560 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.951+0000 7fa0627fc700 1 -- 172.21.15.144:0/66274527 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c012430 con 0x7fa06415d560 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 -- 172.21.15.144:0/66274527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 msgr2=0x7fa06415a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 --2- 172.21.15.144:0/66274527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 0x7fa06415a530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009dc0 tx=0x7fa05c00b330 comp rx=0 tx=0).stop 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 -- 172.21.15.144:0/66274527 shutdown_connections 2023-05-11T07:37:08.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 --2- 172.21.15.144:0/66274527 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa06415d560 0x7fa06415a530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 -- 172.21.15.144:0/66274527 >> 172.21.15.144:0/66274527 conn(0x7fa0640cef20 msgr2=0x7fa0640cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:08.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 -- 172.21.15.144:0/66274527 shutdown_connections 2023-05-11T07:37:08.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.952+0000 7fa0699ff700 1 -- 172.21.15.144:0/66274527 wait complete. 2023-05-11T07:37:08.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.954+0000 7fa0699ff700 1 Processor -- start 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.954+0000 7fa0699ff700 1 -- start start 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0640709d0 0x7fa0640c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa06415d560 0x7fa0640ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640c5f60 con 0x7fa06406dfb0 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064153b70 con 0x7fa06415d560 2023-05-11T07:37:08.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0699ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b4880 con 0x7fa0640709d0 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60272/0 (socket says 172.21.15.144:60272) 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 -- 172.21.15.144:0/3899718174 learned_addr learned my addr 172.21.15.144:0/3899718174 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa0637fe700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa06415d560 0x7fa0640ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa05bfff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0640709d0 0x7fa0640c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 -- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0640709d0 msgr2=0x7fa0640c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0640709d0 0x7fa0640c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 -- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa06415d560 msgr2=0x7fa0640ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa06415d560 0x7fa0640ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.955+0000 7fa062ffd700 1 -- 172.21.15.144:0/3899718174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009a70 con 0x7fa06406dfb0 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa062ffd700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa05400c520 tx=0x7fa05400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540052d0 con 0x7fa06406dfb0 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054005430 con 0x7fa06406dfb0 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06415e3e0 con 0x7fa06406dfb0 2023-05-11T07:37:08.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540038c0 con 0x7fa06406dfb0 2023-05-11T07:37:08.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.956+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06406dc90 con 0x7fa06406dfb0 2023-05-11T07:37:08.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.957+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06406c8f0 con 0x7fa06406dfb0 2023-05-11T07:37:08.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.958+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa054003a20 con 0x7fa06406dfb0 2023-05-11T07:37:08.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.959+0000 7fa060ff9700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 0x7fa04406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:08.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.959+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa0540889b0 con 0x7fa06406dfb0 2023-05-11T07:37:08.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.959+0000 7fa05bfff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 0x7fa04406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:08.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.960+0000 7fa05bfff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 0x7fa04406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0011e0 tx=0x7fa04c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:08.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:08.963+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa054053b00 con 0x7fa06406dfb0 2023-05-11T07:37:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.168+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa064070840 con 0x7fa06406dfb0 2023-05-11T07:37:09.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.749+0000 7fa060ff9700 1 -- 172.21.15.144:0/3899718174 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa054057120 con 0x7fa06406dfb0 2023-05-11T07:37:09.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 msgr2=0x7fa04406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 0x7fa04406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0011e0 tx=0x7fa04c009040 comp rx=0 tx=0).stop 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 msgr2=0x7fa064153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa05400c520 tx=0x7fa05400c8e0 comp rx=0 tx=0).stop 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 shutdown_connections 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fa04406ace0 0x7fa04406d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:09.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa06415d560 0x7fa0640ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:09.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa06406dfb0 0x7fa064153010 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:09.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 --2- 172.21.15.144:0/3899718174 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fa0640709d0 0x7fa0640c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:09.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 >> 172.21.15.144:0/3899718174 conn(0x7fa0640cef20 msgr2=0x7fa0640ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:09.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 shutdown_connections 2023-05-11T07:37:09.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:09.753+0000 7fa0699ff700 1 -- 172.21.15.144:0/3899718174 wait complete. 2023-05-11T07:37:09.759 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data_ec' removed 2023-05-11T07:37:09.776 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-11T07:37:09.776 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-11T07:37:09.777 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-11T07:37:09.777 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T07:37:09.777 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-11T07:37:09.777 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-11T07:37:09.778 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-11T07:37:09.778 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T07:37:09.778 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-11T07:37:09.778 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-11T07:37:09.779 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-11T07:37:09.779 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T07:37:09.779 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-11T07:37:09.779 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-11T07:37:09.780 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-11T07:37:09.780 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T07:37:09.793 INFO:tasks.ceph.mds.a:Stopped 2023-05-11T07:37:09.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-11T07:37:09.794 INFO:tasks.ceph.mds.c:Stopped 2023-05-11T07:37:09.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-11T07:37:09.796 INFO:tasks.ceph.mds.d:Stopped 2023-05-11T07:37:09.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-11T07:37:09.797 INFO:tasks.ceph.mds.b:Stopped 2023-05-11T07:37:09.797 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-11T07:37:09.837 INFO:tasks.ceph.mds.a:Started 2023-05-11T07:37:09.838 DEBUG:teuthology.parallel:result is None 2023-05-11T07:37:09.839 INFO:tasks.ceph.mds.c:Started 2023-05-11T07:37:09.839 DEBUG:teuthology.parallel:result is None 2023-05-11T07:37:09.841 INFO:tasks.ceph.mds.d:Started 2023-05-11T07:37:09.842 DEBUG:teuthology.parallel:result is None 2023-05-11T07:37:09.844 INFO:tasks.ceph.mds.b:Started 2023-05-11T07:37:09.844 DEBUG:teuthology.parallel:result is None 2023-05-11T07:37:09.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-11T07:37:09.978 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2023-05-11T07:37:09.978 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2023-05-11T07:37:09.985 INFO:tasks.ceph.mds.b.smithi145.stdout:starting mds.b at 2023-05-11T07:37:09.986 INFO:tasks.ceph.mds.d.smithi145.stdout:starting mds.d at 2023-05-11T07:37:10.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.041+0000 7f292a1ff700 1 Processor -- start 2023-05-11T07:37:10.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.041+0000 7f292a1ff700 1 -- start start 2023-05-11T07:37:10.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.042+0000 7f292a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f29240c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:10.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f292a1ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292415e200 con 0x7f29240ca020 2023-05-11T07:37:10.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f292a1ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292415a100 con 0x7f29240b0e30 2023-05-11T07:37:10.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f292a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292415a3e0 con 0x7f29241599e0 2023-05-11T07:37:10.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f291bfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f29240ca020 0x7f29240b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57384/0 (socket says 172.21.15.144:57384) 2023-05-11T07:37:10.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f291bfff700 1 -- 172.21.15.144:0/735235571 learned_addr learned my addr 172.21.15.144:0/735235571 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:10.047 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f29237fe700 1 --2- 172.21.15.144:0/735235571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f29240c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:10.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543425774 0 0) 0x7f292415e200 con 0x7f29240ca020 2023-05-11T07:37:10.048 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29100035b0 con 0x7f29240ca020 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350831942 0 0) 0x7f292415a100 con 0x7f29240b0e30 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f29237fe700 1 -- 172.21.15.144:0/735235571 >> v1:172.21.15.145:6789/0 conn(0x7f29240b0e30 legacy=0x7f29240ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f29237fe700 1 -- 172.21.15.144:0/735235571 >> v1:172.21.15.144:6789/0 conn(0x7f29240ca020 legacy=0x7f29240b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.043+0000 7f29237fe700 1 -- 172.21.15.144:0/735235571 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292415a6c0 con 0x7f29241599e0 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f29237fe700 1 --2- 172.21.15.144:0/735235571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f29240c9ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2914009870 tx=0x7f2914009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a191156bf5b179 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:10.049 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011830 con 0x7f29241599e0 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914011990 con 0x7f29241599e0 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f2922ffd700 1 -- 172.21.15.144:0/735235571 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011d20 con 0x7f29241599e0 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f292a1ff700 1 -- 172.21.15.144:0/735235571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 msgr2=0x7f29240c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f292a1ff700 1 --2- 172.21.15.144:0/735235571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f29240c9ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2914009870 tx=0x7f2914009b80 comp rx=0 tx=0).stop 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f292a1ff700 1 -- 172.21.15.144:0/735235571 shutdown_connections 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f292a1ff700 1 --2- 172.21.15.144:0/735235571 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f29240c9ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.044+0000 7f292a1ff700 1 -- 172.21.15.144:0/735235571 >> 172.21.15.144:0/735235571 conn(0x7f29240cb720 msgr2=0x7f29240cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:10.050 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.045+0000 7f292a1ff700 1 -- 172.21.15.144:0/735235571 shutdown_connections 2023-05-11T07:37:10.051 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.045+0000 7f292a1ff700 1 -- 172.21.15.144:0/735235571 wait complete. 2023-05-11T07:37:10.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.046+0000 7f292a1ff700 1 Processor -- start 2023-05-11T07:37:10.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.046+0000 7f292a1ff700 1 -- start start 2023-05-11T07:37:10.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29240ca020 0x7f29241494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f2924155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29241499e0 con 0x7f29240b0e30 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c1f40 con 0x7f29240ca020 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f292a1ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292415b200 con 0x7f29241599e0 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f29237fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:10.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f29237fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60312/0 (socket says 172.21.15.144:60312) 2023-05-11T07:37:10.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.047+0000 7f29237fe700 1 -- 172.21.15.144:0/2106836717 learned_addr learned my addr 172.21.15.144:0/2106836717 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:10.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f291bfff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29240ca020 0x7f29241494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:10.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f2923fff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f2924155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:10.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 -- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 msgr2=0x7f2924155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:10.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f2924155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:10.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 -- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29240ca020 msgr2=0x7f29241494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:10.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29240ca020 0x7f29241494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:10.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 -- 172.21.15.144:0/2106836717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140094a0 con 0x7f29240b0e30 2023-05-11T07:37:10.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f29237fe700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29140090b0 tx=0x7f2914004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291401ab20 con 0x7f29240b0e30 2023-05-11T07:37:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291401ac80 con 0x7f29240b0e30 2023-05-11T07:37:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2924159db0 con 0x7f29240b0e30 2023-05-11T07:37:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.048+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140243f0 con 0x7f29240b0e30 2023-05-11T07:37:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.049+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292415a9a0 con 0x7f29240b0e30 2023-05-11T07:37:10.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.049+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29240cd5f0 con 0x7f29240b0e30 2023-05-11T07:37:10.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.050+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f291402d450 con 0x7f29240b0e30 2023-05-11T07:37:10.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.051+0000 7f2920ff9700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:10.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.052+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f291408a810 con 0x7f29240b0e30 2023-05-11T07:37:10.058 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.052+0000 7f291bfff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:10.058 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.052+0000 7f291bfff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 0x7f290406d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f290c005910 tx=0x7f290c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.056+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2914055c30 con 0x7f29240b0e30 2023-05-11T07:37:10.268 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:10.265+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f29240b1700 con 0x7f29240b0e30 2023-05-11T07:37:11.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.025+0000 7f2920ff9700 1 -- 172.21.15.144:0/2106836717 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2914015080 con 0x7f29240b0e30 2023-05-11T07:37:11.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 msgr2=0x7f290406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 0x7f290406d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f290c005910 tx=0x7f290c009040 comp rx=0 tx=0).stop 2023-05-11T07:37:11.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 msgr2=0x7f2924156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29140090b0 tx=0x7f2914004750 comp rx=0 tx=0).stop 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 shutdown_connections 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f290406ace0 0x7f290406d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f29241599e0 0x7f2924155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29240b0e30 0x7f2924156c00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 --2- 172.21.15.144:0/2106836717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29240ca020 0x7f29241494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.028+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 >> 172.21.15.144:0/2106836717 conn(0x7f29240cb720 msgr2=0x7f2924070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.029+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 shutdown_connections 2023-05-11T07:37:11.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.029+0000 7f292a1ff700 1 -- 172.21.15.144:0/2106836717 wait complete. 2023-05-11T07:37:11.034 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2023-05-11T07:37:11.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-11T07:37:11.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.237+0000 7fb28bfff700 1 Processor -- start 2023-05-11T07:37:11.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.237+0000 7fb28bfff700 1 -- start start 2023-05-11T07:37:11.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.238+0000 7fb28bfff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb2841597f0 0x7fb2840c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.238+0000 7fb28bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb28415dc80 0x7fb2840cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.238+0000 7fb28bfff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb284159bc0 con 0x7fb2840cdcd0 2023-05-11T07:37:11.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.238+0000 7fb28bfff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2840c9e30 con 0x7fb2841597f0 2023-05-11T07:37:11.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.238+0000 7fb28bfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840ca110 con 0x7fb28415dc80 2023-05-11T07:37:11.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb28a59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb2840cdcd0 0x7fb28406a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57400/0 (socket says 172.21.15.144:57400) 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb28a59c700 1 -- 172.21.15.144:0/2705646838 learned_addr learned my addr 172.21.15.144:0/2705646838 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb289d9b700 1 --2- 172.21.15.144:0/2705646838 >> v2:172.21.15.145:3300/0 conn(0x7fb2841597f0 0x7fb2840c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017139525 0 0) 0x7fb27c001490 con 0x7fb2840cdcd0 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2700035b0 con 0x7fb2840cdcd0 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb28959a700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb28415dc80 0x7fb2840cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559293583 0 0) 0x7fb2700035b0 con 0x7fb2840cdcd0 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb28415dc80 msgr2=0x7fb2840cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb28415dc80 0x7fb2840cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 >> v2:172.21.15.145:3300/0 conn(0x7fb2841597f0 msgr2=0x7fb2840c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 --2- 172.21.15.144:0/2705646838 >> v2:172.21.15.145:3300/0 conn(0x7fb2841597f0 0x7fb2840c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840cccb0 con 0x7fb2840cdcd0 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fb27c001b80 con 0x7fb2840cdcd0 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.239+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 >> v1:172.21.15.144:6789/0 conn(0x7fb2840cdcd0 legacy=0x7fb28406a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb270003a00 0x7fb270003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270004430 0x7fb2700048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb270004fc0 0x7fb27000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840c9e30 con 0x7fb270003a00 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840ca110 con 0x7fb270004fc0 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27000e160 con 0x7fb270004430 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb28959a700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb28415dc80 0x7fb2840cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb270003a00 0x7fb270003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb28a59c700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb270004fc0 0x7fb27000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb28959a700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270004430 0x7fb2700048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 -- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270004430 msgr2=0x7fb2700048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270004430 0x7fb2700048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 -- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb270004fc0 msgr2=0x7fb27000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb270004fc0 0x7fb27000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 -- 172.21.15.144:0/2705646838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2700035b0 con 0x7fb270003a00 2023-05-11T07:37:11.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.240+0000 7fb289d9b700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb270003a00 0x7fb270003e10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb280009b90 tx=0x7fb270005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7802d5b82430f42e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000e6c0 con 0x7fb270003a00 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28000e820 con 0x7fb270003a00 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb288d99700 1 -- 172.21.15.144:0/2705646838 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000eb90 con 0x7fb270003a00 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 -- 172.21.15.144:0/2705646838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb270003a00 msgr2=0x7fb270003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 --2- 172.21.15.144:0/2705646838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb270003a00 0x7fb270003e10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb280009b90 tx=0x7fb270005880 comp rx=0 tx=0).stop 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28a59c700 1 -- 172.21.15.144:0/2705646838 reap_dead start 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 -- 172.21.15.144:0/2705646838 shutdown_connections 2023-05-11T07:37:11.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 -- 172.21.15.144:0/2705646838 >> 172.21.15.144:0/2705646838 conn(0x7fb2840cb7e0 msgr2=0x7fb2840cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:11.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 -- 172.21.15.144:0/2705646838 shutdown_connections 2023-05-11T07:37:11.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.241+0000 7fb28bfff700 1 -- 172.21.15.144:0/2705646838 wait complete. 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.243+0000 7fb28bfff700 1 Processor -- start 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.243+0000 7fb28bfff700 1 -- start start 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270003a00 0x7fb2841550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 0x7fb2840b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840b4030 con 0x7fb2840b44c0 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840b2ae0 con 0x7fb284148220 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28bfff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb284148690 con 0x7fb270003a00 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60342/0 (socket says 172.21.15.144:60342) 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb28a59c700 1 -- 172.21.15.144:0/209653529 learned_addr learned my addr 172.21.15.144:0/209653529 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.244+0000 7fb289d9b700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270003a00 0x7fb2841550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28959a700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 0x7fb2840b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.253 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 -- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270003a00 msgr2=0x7fb2841550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270003a00 0x7fb2841550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 -- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 msgr2=0x7fb2840b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 0x7fb2840b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 -- 172.21.15.144:0/209653529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840cd270 con 0x7fb2840b44c0 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28959a700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 0x7fb2840b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28a59c700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb28406fcf0 tx=0x7fb27c00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.254 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00ec30 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c00ed90 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c013660 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2840ccf90 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.245+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28415e0f0 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.246+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28406f130 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.247+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb27c0137c0 con 0x7fb2840b44c0 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.248+0000 7fb27a7fc700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 0x7fb26806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.248+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb27c089600 con 0x7fb2840b44c0 2023-05-11T07:37:11.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.249+0000 7fb289d9b700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 0x7fb26806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.249+0000 7fb289d9b700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 0x7fb26806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2800090b0 tx=0x7fb28001f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.253+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb27c0548c0 con 0x7fb2840b44c0 2023-05-11T07:37:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.524+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb284159bc0 con 0x7fb2840b44c0 2023-05-11T07:37:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.524+0000 7fb27a7fc700 1 -- 172.21.15.144:0/209653529 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb284159bc0 con 0x7fb2840b44c0 2023-05-11T07:37:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:11.528 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkfkDcAhAA91Vpr22kB+XW9/2J5htf+Q==", 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkGmIqGBAAXMQe715J4UOVXuCIEPK1Ow==", 2023-05-11T07:37:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkRY99DRAAyKD3JPJAYq4iOxaAOeXZng==", 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkCXDHIhAAwJXEP7y9MvqCK7svXzcT2Q==", 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCQmlxkKkAPGhAAMA4ZjlqSUC0unvFDt+r4sg==", 2023-05-11T07:37:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2023-05-11T07:37:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCTmlxkeLzQHBAAkT2yaRU8rjcMwkrCt8ZfFA==", 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCWmlxkpbetHxAAREQ9bdYsNSYxZ7yDRNPFLw==", 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCZmlxk304JIxAAUQPloZFgbnYcOadQrva8mg==", 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCfmlxkI1rYMBAA3aqv/jBnoSM0L/COnBKPdQ==", 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCimlxkjS8pMxAAuQl8VUOGeOi1ic7IeagDpA==", 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQClmlxkH+FwNhAAxBhCd8bHDSbIAUTUDpIMPA==", 2023-05-11T07:37:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2023-05-11T07:37:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQComlxka1jsOBAApuNcTCjkMDrqK3i3GbyuzQ==", 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkS28MLBAAPJKGvz9gDu4/TOZZQtaAwg==", 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkre/WORAAXSl2kvjbZherxg9dG42wmw==", 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2023-05-11T07:37:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCMmlxkSurfMhAAjANT8HT//tiOCLqvVrOomw==", 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2023-05-11T07:37:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCNmlxkkHUOBRAA+s14BPlmofpdRDmPI51X5g==", 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw==", 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mds", 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxkunkpKhAAJN4F4qDaDolCSA++NCkUyA==", 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mds" 2023-05-11T07:37:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mgr", 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxklYMpKhAApQfsxRShrD7xgaJz3/2Pug==", 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-osd", 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxkGIwpKhAAEe9ip/ERjaA6irY5G/LDiw==", 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-osd" 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd", 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxkiJQpKhAAVByTT+jrYn345OoiJ4yaTQ==", 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxkRp8pKhAAdRJ83AVm+fgBPcaNoCMG0A==", 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rgw", 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCwmlxklqkpKhAAm7cap5RC8CG3I+eSd3FsVg==", 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2023-05-11T07:37:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCLmlxkeeyGNxAA4x7O4iT7WGR7zKrWcTVovQ==", 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCLmlxkC8zALxAANIK/NFIBgjNBUfJp0ngOXQ==", 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-05-11T07:37:11.558 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-05-11T07:37:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 msgr2=0x7fb26806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 0x7fb26806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2800090b0 tx=0x7fb28001f040 comp rx=0 tx=0).stop 2023-05-11T07:37:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 msgr2=0x7fb2840c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb28406fcf0 tx=0x7fb27c00e440 comp rx=0 tx=0).stop 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 shutdown_connections 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb26806ace0 0x7fb26806d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb270003a00 0x7fb2841550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2840b44c0 0x7fb2840c4070 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 --2- 172.21.15.144:0/209653529 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb284148220 0x7fb2840b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 >> 172.21.15.144:0/209653529 conn(0x7fb2840cb7e0 msgr2=0x7fb2840af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 shutdown_connections 2023-05-11T07:37:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.527+0000 7fb28bfff700 1 -- 172.21.15.144:0/209653529 wait complete. 2023-05-11T07:37:11.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-11T07:37:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.744+0000 7f65d0dff700 1 Processor -- start 2023-05-11T07:37:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.744+0000 7f65d0dff700 1 -- start start 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65d0dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc1599e0 0x7f65cc0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65d0dff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc15e200 con 0x7f65cc0ca020 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65d0dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc15a100 con 0x7f65cc0b0e30 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65d0dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15a3e0 con 0x7f65cc1599e0 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65c9d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f65cc0ca020 0x7f65cc0b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57410/0 (socket says 172.21.15.144:57410) 2023-05-11T07:37:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.745+0000 7f65c9d9b700 1 -- 172.21.15.144:0/2355141426 learned_addr learned my addr 172.21.15.144:0/2355141426 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009688807 0 0) 0x7f65cc15e200 con 0x7f65cc0ca020 2023-05-11T07:37:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b40035b0 con 0x7f65cc0ca020 2023-05-11T07:37:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65ca59c700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc1599e0 0x7f65cc0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1160809443 0 0) 0x7f65b40035b0 con 0x7f65cc0ca020 2023-05-11T07:37:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc1599e0 msgr2=0x7f65cc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc1599e0 0x7f65cc0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 >> v1:172.21.15.145:6789/0 conn(0x7f65cc0b0e30 legacy=0x7f65cc0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc15a6c0 con 0x7f65cc0ca020 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f65c0001670 con 0x7f65cc0ca020 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 >> v1:172.21.15.144:6789/0 conn(0x7f65cc0ca020 legacy=0x7f65cc0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65b4003a30 0x7f65b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65b4004850 0x7f65b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15a3e0 con 0x7f65b4005200 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b400c0e0 con 0x7f65b4003a30 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.746+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b400e4b0 con 0x7f65b4004850 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65ca59c700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc1599e0 0x7f65cc0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65c9d9b700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65b4004850 0x7f65b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65ca59c700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65b4003a30 0x7f65b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 -- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65b4004850 msgr2=0x7f65b4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65b4004850 0x7f65b4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 -- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65b4003a30 msgr2=0x7f65b4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65b4003a30 0x7f65b4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 -- 172.21.15.144:0/2355141426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40035b0 con 0x7f65b4005200 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65cad9d700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65b400ba10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c160 tx=0x7f65b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e0f920d487b1cf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4001db0 con 0x7f65b4005200 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400cca0 con 0x7f65b4005200 2023-05-11T07:37:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.747+0000 7f65c959a700 1 -- 172.21.15.144:0/2355141426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4003c40 con 0x7f65b4005200 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 -- 172.21.15.144:0/2355141426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 msgr2=0x7f65b400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 --2- 172.21.15.144:0/2355141426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65b400ba10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c160 tx=0x7f65b4005880 comp rx=0 tx=0).stop 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65cad9d700 1 -- 172.21.15.144:0/2355141426 reap_dead start 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 -- 172.21.15.144:0/2355141426 shutdown_connections 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 -- 172.21.15.144:0/2355141426 >> 172.21.15.144:0/2355141426 conn(0x7f65cc0cb720 msgr2=0x7f65cc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 -- 172.21.15.144:0/2355141426 shutdown_connections 2023-05-11T07:37:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.748+0000 7f65d0dff700 1 -- 172.21.15.144:0/2355141426 wait complete. 2023-05-11T07:37:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.750+0000 7f65d0dff700 1 Processor -- start 2023-05-11T07:37:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.750+0000 7f65d0dff700 1 -- start start 2023-05-11T07:37:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 0x7f65cc15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc0c62a0 0x7f65cc0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc14ad10 con 0x7f65b4005200 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15cc50 con 0x7f65cc15b040 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65d0dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c6c50 con 0x7f65cc0c62a0 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60358/0 (socket says 172.21.15.144:60358) 2023-05-11T07:37:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 -- 172.21.15.144:0/3593857205 learned_addr learned my addr 172.21.15.144:0/3593857205 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65c9d9b700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 0x7f65cc15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65cad9d700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc0c62a0 0x7f65cc0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 -- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc0c62a0 msgr2=0x7f65cc0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc0c62a0 0x7f65cc0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 -- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 msgr2=0x7f65cc15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 0x7f65cc15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65ca59c700 1 -- 172.21.15.144:0/3593857205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc159db0 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.751+0000 7f65c9d9b700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 0x7f65cc15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65ca59c700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0108a0 tx=0x7f65bc010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc004230 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc00c050 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0036a0 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc15a9a0 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.752+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc0c9ae0 con 0x7f65b4005200 2023-05-11T07:37:11.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.753+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc0b1700 con 0x7f65b4005200 2023-05-11T07:37:11.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.754+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65bc003800 con 0x7f65b4005200 2023-05-11T07:37:11.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.755+0000 7f65baffd700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:11.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.756+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f65bc089a30 con 0x7f65b4005200 2023-05-11T07:37:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.756+0000 7f65c9d9b700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.756+0000 7f65c9d9b700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 0x7f65ac06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1f6170 tx=0x7f65c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:11.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:11.761+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f65bc054c50 con 0x7f65b4005200 2023-05-11T07:37:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.028+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f65cc0c3950 con 0x7f65b4005200 2023-05-11T07:37:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.032+0000 7f65baffd700 1 -- 172.21.15.144:0/3593857205 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f65bc058270 con 0x7f65b4005200 2023-05-11T07:37:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 msgr2=0x7f65ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 0x7f65ac06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1f6170 tx=0x7f65c0009040 comp rx=0 tx=0).stop 2023-05-11T07:37:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 msgr2=0x7f65cc14a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0108a0 tx=0x7f65bc010c60 comp rx=0 tx=0).stop 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 shutdown_connections 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f65ac06ace0 0x7f65ac06d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f65cc0c62a0 0x7f65cc0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65b4005200 0x7f65cc14a7d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 --2- 172.21.15.144:0/3593857205 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65cc15b040 0x7f65cc15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.034+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 >> 172.21.15.144:0/3593857205 conn(0x7f65cc0cb720 msgr2=0x7f65cc0701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.035+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 shutdown_connections 2023-05-11T07:37:12.040 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.035+0000 7f65d0dff700 1 -- 172.21.15.144:0/3593857205 wait complete. 2023-05-11T07:37:12.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-11T07:37:12.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.237+0000 7efce21ff700 1 Processor -- start 2023-05-11T07:37:12.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.237+0000 7efce21ff700 1 -- start start 2023-05-11T07:37:12.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efce21ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcdc15c940 0x7efcdc160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efce21ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc06b350 0x7efcdc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efce21ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0d0e80 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efce21ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc161420 con 0x7efcdc15c940 2023-05-11T07:37:12.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efce21ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0cdb00 con 0x7efcdc06b350 2023-05-11T07:37:12.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efcdb7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcdc15c940 0x7efcdc160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efcdb7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcdc15c940 0x7efcdc160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60366/0 (socket says 172.21.15.144:60366) 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.238+0000 7efcdb7fe700 1 -- 172.21.15.144:0/2372124230 learned_addr learned my addr 172.21.15.144:0/2372124230 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdbfff700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc06b350 0x7efcdc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdb7fe700 1 -- 172.21.15.144:0/2372124230 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc06b350 msgr2=0x7efcdc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdb7fe700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc06b350 0x7efcdc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdb7fe700 1 -- 172.21.15.144:0/2372124230 >> v1:172.21.15.145:6789/0 conn(0x7efcdc0b5fd0 legacy=0x7efcdc06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdb7fe700 1 -- 172.21.15.144:0/2372124230 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0cdde0 con 0x7efcdc15c940 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcdb7fe700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc15c940 0x7efcdc160ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098f0 tx=0x7efccc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1ad9e1fb44728b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcda7fc700 1 -- 172.21.15.144:0/2372124230 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc011830 con 0x7efcdc15c940 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcda7fc700 1 -- 172.21.15.144:0/2372124230 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc011990 con 0x7efcdc15c940 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.239+0000 7efcda7fc700 1 -- 172.21.15.144:0/2372124230 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc011d20 con 0x7efcdc15c940 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 -- 172.21.15.144:0/2372124230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc15c940 msgr2=0x7efcdc160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc15c940 0x7efcdc160ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098f0 tx=0x7efccc009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:12.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 -- 172.21.15.144:0/2372124230 shutdown_connections 2023-05-11T07:37:12.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc06b350 0x7efcdc0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 --2- 172.21.15.144:0/2372124230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc15c940 0x7efcdc160ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 -- 172.21.15.144:0/2372124230 >> 172.21.15.144:0/2372124230 conn(0x7efcdc0d3180 msgr2=0x7efcdc0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:12.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 -- 172.21.15.144:0/2372124230 shutdown_connections 2023-05-11T07:37:12.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.240+0000 7efce21ff700 1 -- 172.21.15.144:0/2372124230 wait complete. 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.242+0000 7efce21ff700 1 Processor -- start 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.242+0000 7efce21ff700 1 -- start start 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcdc06b350 0x7efcdc0a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc15c940 0x7efcdc0b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc159db0 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15a000 con 0x7efcdc06b350 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efce21ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15a2e0 con 0x7efcdc15c940 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60370/0 (socket says 172.21.15.144:60370) 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 -- 172.21.15.144:0/1732069801 learned_addr learned my addr 172.21.15.144:0/1732069801 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdbfff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc15c940 0x7efcdc0b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdb7fe700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcdc06b350 0x7efcdc0a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 -- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc15c940 msgr2=0x7efcdc0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc15c940 0x7efcdc0b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 -- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcdc06b350 msgr2=0x7efcdc0a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcdc06b350 0x7efcdc0a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.243+0000 7efcdaffd700 1 -- 172.21.15.144:0/1732069801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009550 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efcdaffd700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c490 tx=0x7efcd000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00052d0 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.250 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0005450 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0d1400 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0006aa0 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.251 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.244+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc0d1120 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.245+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc15cd10 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.246+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efcd0003680 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.247+0000 7efcc3fff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 0x7efcc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.248+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efcd0088590 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.248+0000 7efcdb7fe700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 0x7efcc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.252 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.248+0000 7efcdb7fe700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 0x7efcc806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efccc014040 tx=0x7efccc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.255 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.252+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efcd0053840 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.524+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7efcdc0744c0 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.528+0000 7efcc3fff700 1 -- 172.21.15.144:0/1732069801 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7efcd0056e60 con 0x7efcdc0b5fd0 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 msgr2=0x7efcc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 0x7efcc806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efccc014040 tx=0x7efccc008030 comp rx=0 tx=0).stop 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 msgr2=0x7efcdc159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcd000c490 tx=0x7efcd000c850 comp rx=0 tx=0).stop 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 shutdown_connections 2023-05-11T07:37:12.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7efcc806ace0 0x7efcc806d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7efcdc15c940 0x7efcdc0b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efcdc06b350 0x7efcdc0a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 --2- 172.21.15.144:0/1732069801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcdc0b5fd0 0x7efcdc159740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 >> 172.21.15.144:0/1732069801 conn(0x7efcdc0d3180 msgr2=0x7efcdc15cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 shutdown_connections 2023-05-11T07:37:12.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.530+0000 7efce21ff700 1 -- 172.21.15.144:0/1732069801 wait complete. 2023-05-11T07:37:12.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-11T07:37:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.732+0000 7fd572bff700 1 Processor -- start 2023-05-11T07:37:12.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.732+0000 7fd572bff700 1 -- start start 2023-05-11T07:37:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd572bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd56c15c940 0x7fd56c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd572bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd572bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0d0e80 con 0x7fd56c0b6420 2023-05-11T07:37:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd572bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c161420 con 0x7fd56c15c940 2023-05-11T07:37:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd572bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0cdb00 con 0x7fd56c0b5fd0 2023-05-11T07:37:12.738 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd57099b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd56c15c940 0x7fd56c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd57119c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd56c0b6420 0x7fd56c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57412/0 (socket says 172.21.15.144:57412) 2023-05-11T07:37:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd57119c700 1 -- 172.21.15.144:0/1038715791 learned_addr learned my addr 172.21.15.144:0/1038715791 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:12.739 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.734+0000 7fd56bfff700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd57099b700 1 -- 172.21.15.144:0/1038715791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 msgr2=0x7fd56c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd57099b700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c06ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd57099b700 1 -- 172.21.15.144:0/1038715791 >> v1:172.21.15.144:6789/0 conn(0x7fd56c0b6420 legacy=0x7fd56c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd57099b700 1 -- 172.21.15.144:0/1038715791 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0cdde0 con 0x7fd56c15c940 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd56b7fe700 1 -- 172.21.15.144:0/1038715791 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821914877 0 0) 0x7fd56c0d0e80 con 0x7fd56c0b6420 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd57099b700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c160ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd560009840 tx=0x7fd560009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eed3c20f67cded server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd56b7fe700 1 -- 172.21.15.144:0/1038715791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011830 con 0x7fd56c15c940 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd56b7fe700 1 -- 172.21.15.144:0/1038715791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560011990 con 0x7fd56c15c940 2023-05-11T07:37:12.741 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.735+0000 7fd56b7fe700 1 -- 172.21.15.144:0/1038715791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011d20 con 0x7fd56c15c940 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 -- 172.21.15.144:0/1038715791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 msgr2=0x7fd56c160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c160ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd560009840 tx=0x7fd560009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 -- 172.21.15.144:0/1038715791 shutdown_connections 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c160ee0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 --2- 172.21.15.144:0/1038715791 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 -- 172.21.15.144:0/1038715791 >> 172.21.15.144:0/1038715791 conn(0x7fd56c0d3180 msgr2=0x7fd56c0d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:12.742 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 -- 172.21.15.144:0/1038715791 shutdown_connections 2023-05-11T07:37:12.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.736+0000 7fd572bff700 1 -- 172.21.15.144:0/1038715791 wait complete. 2023-05-11T07:37:12.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.738+0000 7fd572bff700 1 Processor -- start 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.738+0000 7fd572bff700 1 -- start start 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.739+0000 7fd572bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.739+0000 7fd572bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 0x7fd56c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.739+0000 7fd572bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd572bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c14dc00 con 0x7fd56c15c940 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd572bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0cc030 con 0x7fd56c0b6420 2023-05-11T07:37:12.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd572bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0cb0f0 con 0x7fd56c0b5fd0 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57099b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60402/0 (socket says 172.21.15.144:60402) 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 -- 172.21.15.144:0/2516890507 learned_addr learned my addr 172.21.15.144:0/2516890507 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd56bfff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 0x7fd56c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 -- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 msgr2=0x7fd56c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 -- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 msgr2=0x7fd56c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 0x7fd56c1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 -- 172.21.15.144:0/2516890507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600094a0 con 0x7fd56c15c940 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd56bfff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 0x7fd56c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.740+0000 7fd57119c700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cca0 tx=0x7fd56400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.741+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400ac20 con 0x7fd56c15c940 2023-05-11T07:37:12.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.741+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400ad80 con 0x7fd56c15c940 2023-05-11T07:37:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.741+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c0d1400 con 0x7fd56c15c940 2023-05-11T07:37:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.741+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564007310 con 0x7fd56c15c940 2023-05-11T07:37:12.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.741+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0d1120 con 0x7fd56c15c940 2023-05-11T07:37:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.742+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c15cd10 con 0x7fd56c15c940 2023-05-11T07:37:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.743+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd564007470 con 0x7fd56c15c940 2023-05-11T07:37:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.744+0000 7fd5697fa700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.744+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd564089090 con 0x7fd56c15c940 2023-05-11T07:37:12.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.744+0000 7fd57099b700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:12.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.745+0000 7fd57099b700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 0x7fd55006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5600090b0 tx=0x7fd56001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:12.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:12.748+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd5640543e0 con 0x7fd56c15c940 2023-05-11T07:37:13.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.019+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd56c0cc1a0 con 0x7fd56c15c940 2023-05-11T07:37:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.023+0000 7fd5697fa700 1 -- 172.21.15.144:0/2516890507 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd564057a00 con 0x7fd56c15c940 2023-05-11T07:37:13.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 msgr2=0x7fd55006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 0x7fd55006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5600090b0 tx=0x7fd56001c040 comp rx=0 tx=0).stop 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 msgr2=0x7fd56c0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cca0 tx=0x7fd56400a060 comp rx=0 tx=0).stop 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 shutdown_connections 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fd55006ace0 0x7fd55006d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fd56c0b5fd0 0x7fd56c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56c15c940 0x7fd56c0b44b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 --2- 172.21.15.144:0/2516890507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd56c0b6420 0x7fd56c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 >> 172.21.15.144:0/2516890507 conn(0x7fd56c0d3180 msgr2=0x7fd56c0c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:13.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 shutdown_connections 2023-05-11T07:37:13.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.026+0000 7fd572bff700 1 -- 172.21.15.144:0/2516890507 wait complete. 2023-05-11T07:37:13.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-11T07:37:13.232 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.229+0000 7f1e36bff700 1 Processor -- start 2023-05-11T07:37:13.233 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.229+0000 7f1e36bff700 1 -- start start 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e36bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 0x7f1e300b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e36bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e300ccee0 0x7f1e300cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e36bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3015e200 con 0x7f1e301599e0 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e36bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300b10d0 con 0x7f1e300ccee0 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e36bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3015a100 con 0x7f1e300b0720 2023-05-11T07:37:13.234 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e3519c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e300ccee0 0x7f1e300cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e3499b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1e301599e0 0x7f1e300c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57414/0 (socket says 172.21.15.144:57414) 2023-05-11T07:37:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.230+0000 7f1e3499b700 1 -- 172.21.15.144:0/3362820205 learned_addr learned my addr 172.21.15.144:0/3362820205 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2ffff700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 0x7f1e300b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e3519c700 1 -- 172.21.15.144:0/3362820205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 msgr2=0x7f1e300b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e3519c700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 0x7f1e300b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e3519c700 1 -- 172.21.15.144:0/3362820205 >> v1:172.21.15.144:6789/0 conn(0x7f1e301599e0 legacy=0x7f1e300c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e3519c700 1 -- 172.21.15.144:0/3362820205 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3015a3e0 con 0x7f1e300ccee0 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2f7fe700 1 -- 172.21.15.144:0/3362820205 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107044417 0 0) 0x7f1e3015e200 con 0x7f1e301599e0 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2ffff700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 0x7f1e300b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:13.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e3519c700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e300ccee0 0x7f1e300cd340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009d90 tx=0x7f1e2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af29d1e508a1ebd server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2f7fe700 1 -- 172.21.15.144:0/3362820205 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800e070 con 0x7f1e300ccee0 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2f7fe700 1 -- 172.21.15.144:0/3362820205 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800bbd0 con 0x7f1e300ccee0 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.231+0000 7f1e2f7fe700 1 -- 172.21.15.144:0/3362820205 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28012430 con 0x7f1e300ccee0 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 -- 172.21.15.144:0/3362820205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e300ccee0 msgr2=0x7f1e300cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e300ccee0 0x7f1e300cd340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009d90 tx=0x7f1e2800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 -- 172.21.15.144:0/3362820205 shutdown_connections 2023-05-11T07:37:13.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e300ccee0 0x7f1e300cd340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 --2- 172.21.15.144:0/3362820205 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300b0720 0x7f1e300b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 -- 172.21.15.144:0/3362820205 >> 172.21.15.144:0/3362820205 conn(0x7f1e300cb720 msgr2=0x7f1e300cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 -- 172.21.15.144:0/3362820205 shutdown_connections 2023-05-11T07:37:13.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.232+0000 7f1e36bff700 1 -- 172.21.15.144:0/3362820205 wait complete. 2023-05-11T07:37:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.234+0000 7f1e36bff700 1 Processor -- start 2023-05-11T07:37:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.234+0000 7f1e36bff700 1 -- start start 2023-05-11T07:37:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 0x7f1e3015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300ccee0 0x7f1e30070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30071be0 con 0x7f1e301599e0 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30070b40 con 0x7f1e300b0720 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e36bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30070e20 con 0x7f1e300ccee0 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e3519c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e3519c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60408/0 (socket says 172.21.15.144:60408) 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e3519c700 1 -- 172.21.15.144:0/2515420919 learned_addr learned my addr 172.21.15.144:0/2515420919 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:13.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e2ffff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300ccee0 0x7f1e30070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.235+0000 7f1e3499b700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 0x7f1e3015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 -- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300ccee0 msgr2=0x7f1e30070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300ccee0 0x7f1e30070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 -- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 msgr2=0x7f1e3015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 0x7f1e3015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 -- 172.21.15.144:0/2515420919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009a70 con 0x7f1e301599e0 2023-05-11T07:37:13.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3499b700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 0x7f1e3015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e3519c700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e300cea00 tx=0x7f1e28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28012430 con 0x7f1e301599e0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28020070 con 0x7f1e301599e0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3015a9a0 con 0x7f1e301599e0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28003ea0 con 0x7f1e301599e0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.236+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3015a6c0 con 0x7f1e301599e0 2023-05-11T07:37:13.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.237+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30159db0 con 0x7f1e301599e0 2023-05-11T07:37:13.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.238+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e28004280 con 0x7f1e301599e0 2023-05-11T07:37:13.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.239+0000 7f1e2d7fa700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 0x7f1e1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.239+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1e28022070 con 0x7f1e301599e0 2023-05-11T07:37:13.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.240+0000 7f1e3499b700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 0x7f1e1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.240+0000 7f1e3499b700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 0x7f1e1406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000f60 tx=0x7f1e24007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.243+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1e28056430 con 0x7f1e301599e0 2023-05-11T07:37:13.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.511+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1e300b1700 con 0x7f1e301599e0 2023-05-11T07:37:13.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.515+0000 7f1e2d7fa700 1 -- 172.21.15.144:0/2515420919 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1e28059a50 con 0x7f1e301599e0 2023-05-11T07:37:13.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 msgr2=0x7f1e1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 0x7f1e1406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000f60 tx=0x7f1e24007d30 comp rx=0 tx=0).stop 2023-05-11T07:37:13.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 msgr2=0x7f1e300c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e300cea00 tx=0x7f1e28004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 shutdown_connections 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f1e1406ace0 0x7f1e1406d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e301599e0 0x7f1e300c6ad0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e300b0720 0x7f1e3015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 --2- 172.21.15.144:0/2515420919 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f1e300ccee0 0x7f1e30070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 >> 172.21.15.144:0/2515420919 conn(0x7f1e300cb720 msgr2=0x7f1e300cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:13.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 shutdown_connections 2023-05-11T07:37:13.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.518+0000 7f1e36bff700 1 -- 172.21.15.144:0/2515420919 wait complete. 2023-05-11T07:37:13.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-11T07:37:13.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.719+0000 7f9219dff700 1 Processor -- start 2023-05-11T07:37:13.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.719+0000 7f9219dff700 1 -- start start 2023-05-11T07:37:13.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f921415c940 0x7f9214160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 0x7f921406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92140b6420 0x7f921406b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214161420 con 0x7f921415c940 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140d0e80 con 0x7f92140b5fd0 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9219dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140cdb00 con 0x7f92140b6420 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f921415c940 0x7f9214160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f921415c940 0x7f9214160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60422/0 (socket says 172.21.15.144:60422) 2023-05-11T07:37:13.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 -- 172.21.15.144:0/649890101 learned_addr learned my addr 172.21.15.144:0/649890101 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f9213fff700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92140b6420 0x7f921406b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f920bfff700 1 --2- 172.21.15.144:0/649890101 >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 0x7f921406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 -- 172.21.15.144:0/649890101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92140b6420 msgr2=0x7f921406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92140b6420 0x7f921406b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 -- 172.21.15.144:0/649890101 >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 msgr2=0x7f921406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 --2- 172.21.15.144:0/649890101 >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 0x7f921406ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f92137fe700 1 -- 172.21.15.144:0/649890101 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140cdde0 con 0x7f921415c940 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.721+0000 7f920bfff700 1 --2- 172.21.15.144:0/649890101 >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 0x7f921406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f92137fe700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f921415c940 0x7f9214160ee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92140d3e60 tx=0x7f9204009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58998a07ae055fcb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9212ffd700 1 -- 172.21.15.144:0/649890101 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400b870 con 0x7f921415c940 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9212ffd700 1 -- 172.21.15.144:0/649890101 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400b9d0 con 0x7f921415c940 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9212ffd700 1 -- 172.21.15.144:0/649890101 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400bd60 con 0x7f921415c940 2023-05-11T07:37:13.728 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 -- 172.21.15.144:0/649890101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f921415c940 msgr2=0x7f9214160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f921415c940 0x7f9214160ee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f92140d3e60 tx=0x7f9204009bd0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 -- 172.21.15.144:0/649890101 shutdown_connections 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f92140b6420 0x7f921406b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 --2- 172.21.15.144:0/649890101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f921415c940 0x7f9214160ee0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 --2- 172.21.15.144:0/649890101 >> v2:172.21.15.145:3300/0 conn(0x7f92140b5fd0 0x7f921406ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.722+0000 7f9219dff700 1 -- 172.21.15.144:0/649890101 >> 172.21.15.144:0/649890101 conn(0x7f92140d3180 msgr2=0x7f92140d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.723+0000 7f9219dff700 1 -- 172.21.15.144:0/649890101 shutdown_connections 2023-05-11T07:37:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.723+0000 7f9219dff700 1 -- 172.21.15.144:0/649890101 wait complete. 2023-05-11T07:37:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.724+0000 7f9219dff700 1 Processor -- start 2023-05-11T07:37:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.724+0000 7f9219dff700 1 -- start start 2023-05-11T07:37:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 0x7f9214145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 0x7f92140a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921415a080 con 0x7f92140b5fd0 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141f33f0 con 0x7f92140b6420 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f9219dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c97e0 con 0x7f921415c940 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f92137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f92137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60432/0 (socket says 172.21.15.144:60432) 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.725+0000 7f92137fe700 1 -- 172.21.15.144:0/1339677091 learned_addr learned my addr 172.21.15.144:0/1339677091 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f920bfff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 0x7f9214145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9213fff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 0x7f92140a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 -- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 msgr2=0x7f92140a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 0x7f92140a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 -- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 msgr2=0x7f9214145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:13.733 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 0x7f9214145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 -- 172.21.15.144:0/1339677091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204009550 con 0x7f92140b5fd0 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9213fff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 0x7f92140a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f920bfff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 0x7f9214145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f92137fe700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204004520 con 0x7f92140b5fd0 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920401e070 con 0x7f92140b5fd0 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92140d1400 con 0x7f92140b5fd0 2023-05-11T07:37:13.734 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040038c0 con 0x7f92140b5fd0 2023-05-11T07:37:13.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.726+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140d1120 con 0x7f92140b5fd0 2023-05-11T07:37:13.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.727+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921415cd10 con 0x7f92140b5fd0 2023-05-11T07:37:13.735 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.728+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9204003a20 con 0x7f92140b5fd0 2023-05-11T07:37:13.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.729+0000 7f9210ff9700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 0x7f91f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:13.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.729+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9204020070 con 0x7f92140b5fd0 2023-05-11T07:37:13.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.730+0000 7f920bfff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 0x7f91f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:13.736 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.730+0000 7f920bfff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 0x7f91f406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9214156db0 tx=0x7f91fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:13.737 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:13.734+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9204055b20 con 0x7f92140b5fd0 2023-05-11T07:37:14.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.005+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f92140744c0 con 0x7f92140b5fd0 2023-05-11T07:37:14.012 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.009+0000 7f9210ff9700 1 -- 172.21.15.144:0/1339677091 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9204059140 con 0x7f92140b5fd0 2023-05-11T07:37:14.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.011+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 msgr2=0x7f91f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.011+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 0x7f91f406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9214156db0 tx=0x7f91fc008040 comp rx=0 tx=0).stop 2023-05-11T07:37:14.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 msgr2=0x7f92141ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004750 comp rx=0 tx=0).stop 2023-05-11T07:37:14.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 shutdown_connections 2023-05-11T07:37:14.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f91f406ace0 0x7f91f406d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f921415c940 0x7f92140a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92140b5fd0 0x7f92141ef7a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 --2- 172.21.15.144:0/1339677091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f92140b6420 0x7f9214145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 >> 172.21.15.144:0/1339677091 conn(0x7f92140d3180 msgr2=0x7f92140b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:14.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 shutdown_connections 2023-05-11T07:37:14.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.012+0000 7f9219dff700 1 -- 172.21.15.144:0/1339677091 wait complete. 2023-05-11T07:37:14.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-11T07:37:14.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.214+0000 7fdcecdff700 1 Processor -- start 2023-05-11T07:37:14.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.214+0000 7fdcecdff700 1 -- start start 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdcecdff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdce80b4f80 0x7fdce80b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdcecdff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce80b58c0 con 0x7fdce815c8d0 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdcecdff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce80b6070 con 0x7fdce80b4b00 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdcecdff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80d2220 con 0x7fdce80b4f80 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdce6d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdce80b4f80 0x7fdce80b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.219 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdce659c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdce815c8d0 0x7fdce80d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57430/0 (socket says 172.21.15.144:57430) 2023-05-11T07:37:14.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.215+0000 7fdce659c700 1 -- 172.21.15.144:0/3529130396 learned_addr learned my addr 172.21.15.144:0/3529130396 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:14.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce6d9d700 1 -- 172.21.15.144:0/3529130396 >> v1:172.21.15.145:6789/0 conn(0x7fdce80b4b00 legacy=0x7fdce80b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce6d9d700 1 -- 172.21.15.144:0/3529130396 >> v1:172.21.15.144:6789/0 conn(0x7fdce815c8d0 legacy=0x7fdce80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce6d9d700 1 -- 172.21.15.144:0/3529130396 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80d1980 con 0x7fdce80b4f80 2023-05-11T07:37:14.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce559a700 1 -- 172.21.15.144:0/3529130396 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014665626 0 0) 0x7fdce80b58c0 con 0x7fdce815c8d0 2023-05-11T07:37:14.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce6d9d700 1 --2- 172.21.15.144:0/3529130396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce80b4f80 0x7fdce80b6c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009d90 tx=0x7fdce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bbc383ff557236 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce559a700 1 -- 172.21.15.144:0/3529130396 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000e070 con 0x7fdce80b4f80 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce559a700 1 -- 172.21.15.144:0/3529130396 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000bbd0 con 0x7fdce80b4f80 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.216+0000 7fdce559a700 1 -- 172.21.15.144:0/3529130396 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0012430 con 0x7fdce80b4f80 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 -- 172.21.15.144:0/3529130396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce80b4f80 msgr2=0x7fdce80b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 --2- 172.21.15.144:0/3529130396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce80b4f80 0x7fdce80b6c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009d90 tx=0x7fdce000b330 comp rx=0 tx=0).stop 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 -- 172.21.15.144:0/3529130396 shutdown_connections 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 --2- 172.21.15.144:0/3529130396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce80b4f80 0x7fdce80b6c60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 -- 172.21.15.144:0/3529130396 >> 172.21.15.144:0/3529130396 conn(0x7fdce806abd0 msgr2=0x7fdce806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:14.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 -- 172.21.15.144:0/3529130396 shutdown_connections 2023-05-11T07:37:14.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.217+0000 7fdcecdff700 1 -- 172.21.15.144:0/3529130396 wait complete. 2023-05-11T07:37:14.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.219+0000 7fdcecdff700 1 Processor -- start 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.219+0000 7fdcecdff700 1 -- start start 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 0x7fdce81e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 0x7fdce80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c6f70 con 0x7fdce815c8d0 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b8c90 con 0x7fdce80b4b00 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdcecdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b89b0 con 0x7fdce80b4f80 2023-05-11T07:37:14.225 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60462/0 (socket says 172.21.15.144:60462) 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 -- 172.21.15.144:0/4178859438 learned_addr learned my addr 172.21.15.144:0/4178859438 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce5d9b700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 0x7fdce80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce659c700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 0x7fdce81e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 -- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 msgr2=0x7fdce80b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 0x7fdce80b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.220+0000 7fdce6d9d700 1 -- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 msgr2=0x7fdce81e78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdce6d9d700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 0x7fdce81e78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdce6d9d700 1 -- 172.21.15.144:0/4178859438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0009a70 con 0x7fdce815c8d0 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdce5d9b700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 0x7fdce80b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdce659c700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 0x7fdce81e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdce6d9d700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdce0014040 tx=0x7fdce0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce001b810 con 0x7fdce815c8d0 2023-05-11T07:37:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0020070 con 0x7fdce815c8d0 2023-05-11T07:37:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80d1f40 con 0x7fdce815c8d0 2023-05-11T07:37:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce001bbb0 con 0x7fdce815c8d0 2023-05-11T07:37:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.221+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80d1c60 con 0x7fdce815c8d0 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.222+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce815cca0 con 0x7fdce815c8d0 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.223+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdce001bd10 con 0x7fdce815c8d0 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.224+0000 7fdcd6ffd700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 0x7fdcc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.224+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdce0022070 con 0x7fdce815c8d0 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.224+0000 7fdce659c700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 0x7fdcc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.225+0000 7fdce659c700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 0x7fdcc806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000f60 tx=0x7fdcd8007e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.231 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.228+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdce005a1b0 con 0x7fdce815c8d0 2023-05-11T07:37:14.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.498+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdce8066b30 con 0x7fdce815c8d0 2023-05-11T07:37:14.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.502+0000 7fdcd6ffd700 1 -- 172.21.15.144:0/4178859438 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdce0059d40 con 0x7fdce815c8d0 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 msgr2=0x7fdcc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 0x7fdcc806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000f60 tx=0x7fdcd8007e50 comp rx=0 tx=0).stop 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 msgr2=0x7fdce81f1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdce0014040 tx=0x7fdce0004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 shutdown_connections 2023-05-11T07:37:14.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdcc806ace0 0x7fdcc806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdce815c8d0 0x7fdce81f1570 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdce80b4b00 0x7fdce81e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 --2- 172.21.15.144:0/4178859438 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fdce80b4f80 0x7fdce80b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 >> 172.21.15.144:0/4178859438 conn(0x7fdce806abd0 msgr2=0x7fdce80b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 shutdown_connections 2023-05-11T07:37:14.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.505+0000 7fdcecdff700 1 -- 172.21.15.144:0/4178859438 wait complete. 2023-05-11T07:37:14.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:14.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.708+0000 7f4f625ff700 1 Processor -- start 2023-05-11T07:37:14.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.708+0000 7f4f625ff700 1 -- start start 2023-05-11T07:37:14.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.709+0000 7f4f625ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f5c0b52a0 0x7f4f5c0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f625ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c15cef0 con 0x7f4f5c0b87e0 2023-05-11T07:37:14.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f625ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0cd760 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f625ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0b5a80 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f53fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f5c0b52a0 0x7f4f5c0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f5bfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4f5c0b87e0 0x7f4f5c0b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57442/0 (socket says 172.21.15.144:57442) 2023-05-11T07:37:14.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f5bfff700 1 -- 172.21.15.144:0/1231419203 learned_addr learned my addr 172.21.15.144:0/1231419203 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:14.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f53fff700 1 -- 172.21.15.144:0/1231419203 >> v1:172.21.15.145:6789/0 conn(0x7f4f5c0d02c0 legacy=0x7f4f5c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f53fff700 1 -- 172.21.15.144:0/1231419203 >> v1:172.21.15.144:6789/0 conn(0x7f4f5c0b87e0 legacy=0x7f4f5c0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.710+0000 7f4f53fff700 1 -- 172.21.15.144:0/1231419203 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0d2d30 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f53fff700 1 --2- 172.21.15.144:0/1231419203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c0d2090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009840 tx=0x7f4f44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1ec276ca698508 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f5b7fe700 1 -- 172.21.15.144:0/1231419203 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44011830 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f5b7fe700 1 -- 172.21.15.144:0/1231419203 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f44011990 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f5b7fe700 1 -- 172.21.15.144:0/1231419203 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44011d20 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 -- 172.21.15.144:0/1231419203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0b52a0 msgr2=0x7f4f5c0d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 --2- 172.21.15.144:0/1231419203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c0d2090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009840 tx=0x7f4f44009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 -- 172.21.15.144:0/1231419203 shutdown_connections 2023-05-11T07:37:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 --2- 172.21.15.144:0/1231419203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c0d2090 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 -- 172.21.15.144:0/1231419203 >> 172.21.15.144:0/1231419203 conn(0x7f4f5c06acf0 msgr2=0x7f4f5c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 -- 172.21.15.144:0/1231419203 shutdown_connections 2023-05-11T07:37:14.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.711+0000 7f4f625ff700 1 -- 172.21.15.144:0/1231419203 wait complete. 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.713+0000 7f4f625ff700 1 Processor -- start 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.713+0000 7f4f625ff700 1 -- start start 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f5c0b87e0 0x7f4f5c0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1f3ac0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c7be0 con 0x7f4f5c0b52a0 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f625ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1f37e0 con 0x7f4f5c0b87e0 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f60b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f60b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60472/0 (socket says 172.21.15.144:60472) 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.714+0000 7f4f60b9c700 1 -- 172.21.15.144:0/2045759749 learned_addr learned my addr 172.21.15.144:0/2045759749 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f53fff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f5c0b87e0 0x7f4f5c0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f5bfff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 -- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f5c0b87e0 msgr2=0x7f4f5c0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f5c0b87e0 0x7f4f5c0c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 -- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f5c0b52a0 msgr2=0x7f4f5c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 -- 172.21.15.144:0/2045759749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440094a0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f60b9c700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400cb50 tx=0x7f4f5400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54003c00 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54003d60 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.721 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0cdc90 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400ab70 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.715+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c0cd9b0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.716+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c0b8bb0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.717+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f5400acd0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.718+0000 7f4f597fa700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 0x7f4f3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.718+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4f54089370 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.718+0000 7f4f5bfff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 0x7f4f3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:14.723 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.719+0000 7f4f5bfff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 0x7f4f3c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005910 tx=0x7f4f4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:14.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.722+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4f54054590 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.918+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f5c08b830 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.919+0000 7f4f597fa700 1 -- 172.21.15.144:0/2045759749 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14880 (secure 0 0 0) 0x7f4f54057bb0 con 0x7f4f5c0d02c0 2023-05-11T07:37:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:14.923 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":38,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:37:11.022177+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 msgr2=0x7f4f3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 0x7f4f3c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c005910 tx=0x7f4f4c009040 comp rx=0 tx=0).stop 2023-05-11T07:37:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 msgr2=0x7f4f5c1e63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400cb50 tx=0x7f4f5400cf10 comp rx=0 tx=0).stop 2023-05-11T07:37:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 shutdown_connections 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4f3c06ace0 0x7f4f3c06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c0d02c0 0x7f4f5c1e63d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4f5c0b52a0 0x7f4f5c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 --2- 172.21.15.144:0/2045759749 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4f5c0b87e0 0x7f4f5c0c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.921+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 >> 172.21.15.144:0/2045759749 conn(0x7f4f5c06acf0 msgr2=0x7f4f5c0b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.922+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 shutdown_connections 2023-05-11T07:37:14.926 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:14.922+0000 7f4f625ff700 1 -- 172.21.15.144:0/2045759749 wait complete. 2023-05-11T07:37:14.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T07:35:25.771103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T07:35:32.470059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T07:37:14.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T07:37:15.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.126+0000 7ffa131ff700 1 Processor -- start 2023-05-11T07:37:15.130 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.127+0000 7ffa131ff700 1 -- start start 2023-05-11T07:37:15.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa131ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffa0c0cfe00 0x7ffa0c0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.131 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa131ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0cf640 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa131ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c15cd00 con 0x7ffa0c15c930 2023-05-11T07:37:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa131ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cd940 con 0x7ffa0c0cfe00 2023-05-11T07:37:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa1179c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffa0c0d02a0 0x7ffa0c1604b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57444/0 (socket says 172.21.15.144:57444) 2023-05-11T07:37:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa1179c700 1 -- 172.21.15.144:0/492562479 learned_addr learned my addr 172.21.15.144:0/492562479 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa0bfff700 1 --2- 172.21.15.144:0/492562479 >> v2:172.21.15.145:3300/0 conn(0x7ffa0c0cfe00 0x7ffa0c0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709035376 0 0) 0x7ffa0c0cf640 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.128+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9fc0035b0 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629493822 0 0) 0x7ffa0c15cd00 con 0x7ffa0c15c930 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0c0cf640 con 0x7ffa0c15c930 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900384023 0 0) 0x7ff9fc0035b0 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 >> v2:172.21.15.145:3300/0 conn(0x7ffa0c0cfe00 msgr2=0x7ffa0c0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 --2- 172.21.15.144:0/492562479 >> v2:172.21.15.145:3300/0 conn(0x7ffa0c0cfe00 0x7ffa0c0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 >> v1:172.21.15.145:6789/0 conn(0x7ffa0c15c930 legacy=0x7ffa0c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0cdc20 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7ffa040019f0 con 0x7ffa0c0d02a0 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 >> v1:172.21.15.144:6789/0 conn(0x7ffa0c0d02a0 legacy=0x7ffa0c1604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9fc003bc0 0x7ff9fc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9fc004850 0x7ff9fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 0x7ff9fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cd940 con 0x7ff9fc005200 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc00c090 con 0x7ff9fc003bc0 2023-05-11T07:37:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc00c250 con 0x7ff9fc004850 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa1179c700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 0x7ff9fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa10f9b700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9fc003bc0 0x7ff9fc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.129+0000 7ffa0bfff700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9fc004850 0x7ff9fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 -- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9fc004850 msgr2=0x7ff9fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ff9fc004850 0x7ff9fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 -- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9fc003bc0 msgr2=0x7ff9fc003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff9fc003bc0 0x7ff9fc003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 -- 172.21.15.144:0/492562479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc0035b0 con 0x7ff9fc005200 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 -- 172.21.15.144:0/492562479 reap_dead start 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa1179c700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 0x7ff9fc00ba10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400a7a0 tx=0x7ff9fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9050990ef6ee69 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04012600 con 0x7ff9fc005200 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04012780 con 0x7ff9fc005200 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa0b7fe700 1 -- 172.21.15.144:0/492562479 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04012b30 con 0x7ff9fc005200 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa131ff700 1 -- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 msgr2=0x7ff9fc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.130+0000 7ffa131ff700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 0x7ff9fc00ba10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400a7a0 tx=0x7ff9fc005880 comp rx=0 tx=0).stop 2023-05-11T07:37:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.131+0000 7ffa131ff700 1 -- 172.21.15.144:0/492562479 shutdown_connections 2023-05-11T07:37:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.131+0000 7ffa131ff700 1 --2- 172.21.15.144:0/492562479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9fc005200 0x7ff9fc00ba10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.131+0000 7ffa131ff700 1 -- 172.21.15.144:0/492562479 >> 172.21.15.144:0/492562479 conn(0x7ffa0c072650 msgr2=0x7ffa0c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.131+0000 7ffa131ff700 1 -- 172.21.15.144:0/492562479 shutdown_connections 2023-05-11T07:37:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.131+0000 7ffa131ff700 1 -- 172.21.15.144:0/492562479 wait complete. 2023-05-11T07:37:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.133+0000 7ffa131ff700 1 Processor -- start 2023-05-11T07:37:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.133+0000 7ffa131ff700 1 -- start start 2023-05-11T07:37:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa0c1e5300 0x7ffa0c1f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 0x7ffa0c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1f69b0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1e29e0 con 0x7ffa0c151520 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.134+0000 7ffa131ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1f6c60 con 0x7ffa0c1e5300 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60492/0 (socket says 172.21.15.144:60492) 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 -- 172.21.15.144:0/766097687 learned_addr learned my addr 172.21.15.144:0/766097687 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa0bfff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa0c1e5300 0x7ffa0c1f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa1179c700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 0x7ffa0c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 -- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa0c1e5300 msgr2=0x7ffa0c1f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa0c1e5300 0x7ffa0c1f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 -- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 msgr2=0x7ffa0c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 0x7ffa0c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 -- 172.21.15.144:0/766097687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0cdf00 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa1179c700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 0x7ffa0c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa10f9b700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000f770 tx=0x7ffa0000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00005320 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.135+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa000054a0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.136+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0cf8e0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.136+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00006aa0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.136+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0ce090 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.136+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0744c0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.138+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa00006c00 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.139+0000 7ffa097fa700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 0x7ff9f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.139+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ffa00088ba0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.139+0000 7ffa0bfff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 0x7ff9f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.140+0000 7ffa0bfff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 0x7ff9f006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80045f0 tx=0x7ff9f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.143+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffa00053dc0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.335+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa0c15d230 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.336+0000 7ffa097fa700 1 -- 172.21.15.144:0/766097687 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa000573e0 con 0x7ffa0c1e4f30 2023-05-11T07:37:15.340 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2023-05-11T07:37:15.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 msgr2=0x7ff9f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 0x7ff9f006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80045f0 tx=0x7ff9f8008040 comp rx=0 tx=0).stop 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 msgr2=0x7ffa0c1f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000f770 tx=0x7ffa0000fb30 comp rx=0 tx=0).stop 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 shutdown_connections 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7ff9f006ace0 0x7ff9f006d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa0c151520 0x7ffa0c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa0c1e4f30 0x7ffa0c1f5f30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 --2- 172.21.15.144:0/766097687 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7ffa0c1e5300 0x7ffa0c1f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 >> 172.21.15.144:0/766097687 conn(0x7ff9fc005200 msgr2=0x7ffa0c0b72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:15.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 shutdown_connections 2023-05-11T07:37:15.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.338+0000 7ffa131ff700 1 -- 172.21.15.144:0/766097687 wait complete. 2023-05-11T07:37:15.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T07:37:15.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.544+0000 7f5884bff700 1 Processor -- start 2023-05-11T07:37:15.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.544+0000 7f5884bff700 1 -- start start 2023-05-11T07:37:15.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.545+0000 7f5884bff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5880160ee0 0x7f588006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.545+0000 7f5884bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.545+0000 7f5884bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800d0e80 con 0x7f588015c940 2023-05-11T07:37:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.545+0000 7f5884bff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588006b600 con 0x7f5880160ee0 2023-05-11T07:37:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.545+0000 7f5884bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800cdb00 con 0x7f588006b180 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:51930/0 (socket says 172.21.15.144:51930) 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 -- 172.21.15.144:0/1857212902 learned_addr learned my addr 172.21.15.144:0/1857212902 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587dd9b700 1 --2- 172.21.15.144:0/1857212902 >> v2:172.21.15.145:3300/0 conn(0x7f5880160ee0 0x7f588006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 -- 172.21.15.144:0/1857212902 >> v2:172.21.15.145:3300/0 conn(0x7f5880160ee0 msgr2=0x7f588006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 --2- 172.21.15.144:0/1857212902 >> v2:172.21.15.145:3300/0 conn(0x7f5880160ee0 0x7f588006ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 -- 172.21.15.144:0/1857212902 >> v1:172.21.15.145:6789/0 conn(0x7f588015c940 legacy=0x7f58800b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 -- 172.21.15.144:0/1857212902 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800cdde0 con 0x7f588006b180 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587d59a700 1 -- 172.21.15.144:0/1857212902 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281354833 0 0) 0x7f58800d0e80 con 0x7f588015c940 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.546+0000 7f587ed9d700 1 --2- 172.21.15.144:0/1857212902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5878009e50 tx=0x7f587800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3acef0ade4fb5beb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f587d59a700 1 -- 172.21.15.144:0/1857212902 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800e070 con 0x7f588006b180 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f587d59a700 1 -- 172.21.15.144:0/1857212902 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587800b910 con 0x7f588006b180 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f587d59a700 1 -- 172.21.15.144:0/1857212902 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800bcc0 con 0x7f588006b180 2023-05-11T07:37:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 -- 172.21.15.144:0/1857212902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 msgr2=0x7f58800d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 --2- 172.21.15.144:0/1857212902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5878009e50 tx=0x7f587800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 -- 172.21.15.144:0/1857212902 shutdown_connections 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 --2- 172.21.15.144:0/1857212902 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588006b180 0x7f58800d1920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 --2- 172.21.15.144:0/1857212902 >> v2:172.21.15.145:3300/0 conn(0x7f5880160ee0 0x7f588006ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 -- 172.21.15.144:0/1857212902 >> 172.21.15.144:0/1857212902 conn(0x7f58800d3180 msgr2=0x7f58800d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 -- 172.21.15.144:0/1857212902 shutdown_connections 2023-05-11T07:37:15.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.547+0000 7f5884bff700 1 -- 172.21.15.144:0/1857212902 wait complete. 2023-05-11T07:37:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.549+0000 7f5884bff700 1 Processor -- start 2023-05-11T07:37:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.549+0000 7f5884bff700 1 -- start start 2023-05-11T07:37:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588015c940 0x7f58801f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5880160ee0 0x7f588015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588015d120 con 0x7f588006b180 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58801eff70 con 0x7f5880160ee0 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f5884bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58801f2ee0 con 0x7f588015c940 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f587e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f587e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60508/0 (socket says 172.21.15.144:60508) 2023-05-11T07:37:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.550+0000 7f587e59c700 1 -- 172.21.15.144:0/3483236000 learned_addr learned my addr 172.21.15.144:0/3483236000 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587ed9d700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5880160ee0 0x7f588015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587dd9b700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588015c940 0x7f58801f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 -- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588015c940 msgr2=0x7f58801f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588015c940 0x7f58801f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 -- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5880160ee0 msgr2=0x7f588015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5880160ee0 0x7f588015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 -- 172.21.15.144:0/3483236000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009b30 con 0x7f588006b180 2023-05-11T07:37:15.557 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f587e59c700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58700011e0 tx=0x7f587000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700054e0 con 0x7f588006b180 2023-05-11T07:37:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870003680 con 0x7f588006b180 2023-05-11T07:37:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870003a30 con 0x7f588006b180 2023-05-11T07:37:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800d1400 con 0x7f588006b180 2023-05-11T07:37:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.551+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800d1120 con 0x7f588006b180 2023-05-11T07:37:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.552+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58800b66e0 con 0x7f588006b180 2023-05-11T07:37:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.553+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5870003b90 con 0x7f588006b180 2023-05-11T07:37:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.555+0000 7f586effd700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 0x7f586006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.555+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5870088750 con 0x7f588006b180 2023-05-11T07:37:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.555+0000 7f587dd9b700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 0x7f586006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.555+0000 7f587dd9b700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 0x7f586006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5880160080 tx=0x7f5874008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.559+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5870053aa0 con 0x7f588006b180 2023-05-11T07:37:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.751+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58800744c0 con 0x7f588006b180 2023-05-11T07:37:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.752+0000 7f586effd700 1 -- 172.21.15.144:0/3483236000 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58700170a0 con 0x7f588006b180 2023-05-11T07:37:15.756 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 8 2023-05-11T07:37:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 msgr2=0x7f586006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 0x7f586006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5880160080 tx=0x7f5874008040 comp rx=0 tx=0).stop 2023-05-11T07:37:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 msgr2=0x7f58801efa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58700011e0 tx=0x7f587000cae0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 shutdown_connections 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f586006ace0 0x7f586006d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5880160ee0 0x7f588015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588006b180 0x7f58801efa30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 --2- 172.21.15.144:0/3483236000 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f588015c940 0x7f58801f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 >> 172.21.15.144:0/3483236000 conn(0x7f58800d3180 msgr2=0x7f58800b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.754+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 shutdown_connections 2023-05-11T07:37:15.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.755+0000 7f5884bff700 1 -- 172.21.15.144:0/3483236000 wait complete. 2023-05-11T07:37:15.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-11T07:37:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.958+0000 7fb24fdff700 1 Processor -- start 2023-05-11T07:37:15.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.958+0000 7fb24fdff700 1 -- start start 2023-05-11T07:37:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.959+0000 7fb24fdff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fb2480cffd0 0x7fb2480b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24fdff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2480b5500 con 0x7fb2480b50c0 2023-05-11T07:37:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24fdff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2480cda80 con 0x7fb24815a3e0 2023-05-11T07:37:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24fdff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2480cf4f0 con 0x7fb2480cffd0 2023-05-11T07:37:15.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24e39c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb2480b50c0 0x7fb24815dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57454/0 (socket says 172.21.15.144:57454) 2023-05-11T07:37:15.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24e39c700 1 -- 172.21.15.144:0/2171456668 learned_addr learned my addr 172.21.15.144:0/2171456668 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223396436 0 0) 0x7fb2480b5500 con 0x7fb2480b50c0 2023-05-11T07:37:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2340035b0 con 0x7fb2480b50c0 2023-05-11T07:37:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24d39a700 1 --2- 172.21.15.144:0/2171456668 >> v2:172.21.15.145:3300/0 conn(0x7fb2480cffd0 0x7fb2480b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864210600 0 0) 0x7fb2340035b0 con 0x7fb2480b50c0 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 >> v2:172.21.15.145:3300/0 conn(0x7fb2480cffd0 msgr2=0x7fb2480b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 --2- 172.21.15.144:0/2171456668 >> v2:172.21.15.145:3300/0 conn(0x7fb2480cffd0 0x7fb2480b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 >> v1:172.21.15.145:6789/0 conn(0x7fb24815a3e0 legacy=0x7fb24815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480cf7d0 con 0x7fb2480b50c0 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.960+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fb2400019f0 con 0x7fb2480b50c0 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 >> v1:172.21.15.144:6789/0 conn(0x7fb2480b50c0 legacy=0x7fb24815dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234003a30 0x7fb234003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb234004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb234005200 0x7fb23400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480cf4f0 con 0x7fb234004850 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23400c0e0 con 0x7fb234005200 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23400c270 con 0x7fb234003a30 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb234004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24db9b700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234003a30 0x7fb234003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24e39c700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb234005200 0x7fb23400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 -- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234003a30 msgr2=0x7fb234003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb234003a30 0x7fb234003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 -- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb234005200 msgr2=0x7fb23400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb234005200 0x7fb23400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24d39a700 1 -- 172.21.15.144:0/2171456668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340035b0 con 0x7fb234004850 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.961+0000 7fb24e39c700 1 -- 172.21.15.144:0/2171456668 reap_dead start 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24d39a700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb234004cc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb238009b30 tx=0x7fb234005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8197a66c103e766 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23800e640 con 0x7fb234004850 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23800e7a0 con 0x7fb234004850 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24cb99700 1 -- 172.21.15.144:0/2171456668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23800eb10 con 0x7fb234004850 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24fdff700 1 -- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 msgr2=0x7fb234004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24fdff700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb234004cc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb238009b30 tx=0x7fb234005880 comp rx=0 tx=0).stop 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24fdff700 1 -- 172.21.15.144:0/2171456668 shutdown_connections 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24fdff700 1 --2- 172.21.15.144:0/2171456668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb234004cc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.962+0000 7fb24fdff700 1 -- 172.21.15.144:0/2171456668 >> 172.21.15.144:0/2171456668 conn(0x7fb24806ad30 msgr2=0x7fb24806b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:15.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.963+0000 7fb24fdff700 1 -- 172.21.15.144:0/2171456668 shutdown_connections 2023-05-11T07:37:15.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.963+0000 7fb24fdff700 1 -- 172.21.15.144:0/2171456668 wait complete. 2023-05-11T07:37:15.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.965+0000 7fb24fdff700 1 Processor -- start 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.965+0000 7fb24fdff700 1 -- start start 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2480cbf60 0x7fb2480b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2480b74c0 0x7fb2480b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480ca520 con 0x7fb234004850 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480cd7a0 con 0x7fb2480cbf60 2023-05-11T07:37:15.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24fdff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480cc700 con 0x7fb2480b74c0 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.966+0000 7fb24db9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60534/0 (socket says 172.21.15.144:60534) 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 -- 172.21.15.144:0/3095003390 learned_addr learned my addr 172.21.15.144:0/3095003390 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24e39c700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2480b74c0 0x7fb2480b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24d39a700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2480cbf60 0x7fb2480b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 -- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2480b74c0 msgr2=0x7fb2480b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2480b74c0 0x7fb2480b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 -- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2480cbf60 msgr2=0x7fb2480b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2480cbf60 0x7fb2480b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 -- 172.21.15.144:0/3095003390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480d0470 con 0x7fb234004850 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24db9b700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb24400f770 tx=0x7fb24400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440052e0 con 0x7fb234004850 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244005440 con 0x7fb234004850 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.967+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2480cfab0 con 0x7fb234004850 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.968+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440038c0 con 0x7fb234004850 2023-05-11T07:37:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.968+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24815a7b0 con 0x7fb234004850 2023-05-11T07:37:15.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.969+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb248067490 con 0x7fb234004850 2023-05-11T07:37:15.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.970+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb244003a20 con 0x7fb234004850 2023-05-11T07:37:15.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.971+0000 7fb23e7fc700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 0x7fb22c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:15.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.971+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb2440890b0 con 0x7fb234004850 2023-05-11T07:37:15.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.971+0000 7fb24d39a700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 0x7fb22c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:15.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.972+0000 7fb24d39a700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 0x7fb22c06d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2380090b0 tx=0x7fb238008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:15.975+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb248067490 con 0x7fb234004850 2023-05-11T07:37:16.179 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.176+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb24808bde0 con 0x7fb234004850 2023-05-11T07:37:16.180 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.176+0000 7fb23e7fc700 1 -- 172.21.15.144:0/3095003390 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb2440542d0 con 0x7fb234004850 2023-05-11T07:37:16.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:16.180 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2023-05-11T07:37:16.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:16.180 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 2, 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": "rbd" 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-05-11T07:37:16.181 INFO:teuthology.orchestra.run.smithi144.stdout:] 2023-05-11T07:37:16.182 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 msgr2=0x7fb22c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 0x7fb22c06d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2380090b0 tx=0x7fb238008030 comp rx=0 tx=0).stop 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 msgr2=0x7fb2480cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb24400f770 tx=0x7fb24400fb30 comp rx=0 tx=0).stop 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 shutdown_connections 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb22c06ace0 0x7fb22c06d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb2480b74c0 0x7fb2480b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb234004850 0x7fb2480cba20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.183 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 --2- 172.21.15.144:0/3095003390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2480cbf60 0x7fb2480b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 >> 172.21.15.144:0/3095003390 conn(0x7fb24806ad30 msgr2=0x7fb2480d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:16.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 shutdown_connections 2023-05-11T07:37:16.184 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.179+0000 7fb24fdff700 1 -- 172.21.15.144:0/3095003390 wait complete. 2023-05-11T07:37:16.199 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-11T07:37:16.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-11T07:37:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.384+0000 7f45f39ff700 1 Processor -- start 2023-05-11T07:37:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.384+0000 7f45f39ff700 1 -- start start 2023-05-11T07:37:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.385+0000 7f45f39ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 0x7f45ec06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.385+0000 7f45f39ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45ec0d2970 0x7f45ec06ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f39ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec0cfa10 con 0x7f45ec06b160 2023-05-11T07:37:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f39ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec06b5e0 con 0x7f45ec0d2970 2023-05-11T07:37:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f39ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec0cf730 con 0x7f45ec15ca70 2023-05-11T07:37:16.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f1f9c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45ec06b160 0x7f45ec160460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41552/0 (socket says 172.21.15.144:41552) 2023-05-11T07:37:16.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f1f9c700 1 -- 172.21.15.144:0/929167229 learned_addr learned my addr 172.21.15.144:0/929167229 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:16.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f0f9a700 1 --2- 172.21.15.144:0/929167229 >> v2:172.21.15.144:3300/0 conn(0x7f45ec0d2970 0x7f45ec06ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f179b700 1 --2- 172.21.15.144:0/929167229 >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 0x7f45ec06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.391 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f0f9a700 1 -- 172.21.15.144:0/929167229 >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 msgr2=0x7f45ec06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f0f9a700 1 --2- 172.21.15.144:0/929167229 >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 0x7f45ec06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f0f9a700 1 -- 172.21.15.144:0/929167229 >> v1:172.21.15.144:6789/0 conn(0x7f45ec06b160 legacy=0x7f45ec160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f0f9a700 1 -- 172.21.15.144:0/929167229 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0cded0 con 0x7f45ec0d2970 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.386+0000 7f45f179b700 1 --2- 172.21.15.144:0/929167229 >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 0x7f45ec06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f0f9a700 1 --2- 172.21.15.144:0/929167229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec0d2970 0x7f45ec06ac20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0d3e40 tx=0x7f45dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e08e3b9bb1b68d2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45e3fff700 1 -- 172.21.15.144:0/929167229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011830 con 0x7f45ec0d2970 2023-05-11T07:37:16.392 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45e3fff700 1 -- 172.21.15.144:0/929167229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc011990 con 0x7f45ec0d2970 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45e3fff700 1 -- 172.21.15.144:0/929167229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011d20 con 0x7f45ec0d2970 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f39ff700 1 -- 172.21.15.144:0/929167229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec0d2970 msgr2=0x7f45ec06ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f39ff700 1 --2- 172.21.15.144:0/929167229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec0d2970 0x7f45ec06ac20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0d3e40 tx=0x7f45dc009b20 comp rx=0 tx=0).stop 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f39ff700 1 -- 172.21.15.144:0/929167229 shutdown_connections 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f39ff700 1 --2- 172.21.15.144:0/929167229 >> v2:172.21.15.145:3300/0 conn(0x7f45ec15ca70 0x7f45ec06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.387+0000 7f45f39ff700 1 --2- 172.21.15.144:0/929167229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec0d2970 0x7f45ec06ac20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.393 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.388+0000 7f45f39ff700 1 -- 172.21.15.144:0/929167229 >> 172.21.15.144:0/929167229 conn(0x7f45ec0d3120 msgr2=0x7f45ec0d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:16.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.388+0000 7f45f39ff700 1 -- 172.21.15.144:0/929167229 shutdown_connections 2023-05-11T07:37:16.394 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.388+0000 7f45f39ff700 1 -- 172.21.15.144:0/929167229 wait complete. 2023-05-11T07:37:16.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.389+0000 7f45f39ff700 1 Processor -- start 2023-05-11T07:37:16.395 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.389+0000 7f45f39ff700 1 -- start start 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45ec06b160 0x7f45ec1e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45ec0d2970 0x7f45ec157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1598b0 con 0x7f45ec15ca70 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec159b90 con 0x7f45ec06b160 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f39ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec159e70 con 0x7f45ec0d2970 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.390+0000 7f45f1f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.396 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41754/0 (socket says 172.21.15.144:41754) 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 -- 172.21.15.144:0/2921819089 learned_addr learned my addr 172.21.15.144:0/2921819089 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f0f9a700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45ec0d2970 0x7f45ec157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f179b700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45ec06b160 0x7f45ec1e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 -- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45ec0d2970 msgr2=0x7f45ec157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45ec0d2970 0x7f45ec157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 -- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45ec06b160 msgr2=0x7f45ec1e5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45ec06b160 0x7f45ec1e5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 -- 172.21.15.144:0/2921819089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0094a0 con 0x7f45ec15ca70 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f1f9c700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f45e400cbc0 tx=0x7f45e400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400a9e0 con 0x7f45ec15ca70 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400ab40 con 0x7f45ec15ca70 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec0cdb60 con 0x7f45ec15ca70 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.391+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4012400 con 0x7f45ec15ca70 2023-05-11T07:37:16.398 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.392+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0cd880 con 0x7f45ec15ca70 2023-05-11T07:37:16.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.392+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec0d2e10 con 0x7f45ec15ca70 2023-05-11T07:37:16.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.393+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45e401b3b0 con 0x7f45ec15ca70 2023-05-11T07:37:16.399 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.394+0000 7f45e1ffb700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 0x7f45d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:16.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.394+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f45e4088da0 con 0x7f45ec15ca70 2023-05-11T07:37:16.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.395+0000 7f45f179b700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 0x7f45d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:16.400 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.395+0000 7f45f179b700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 0x7f45d006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c940 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:16.402 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.399+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f45e4054110 con 0x7f45ec15ca70 2023-05-11T07:37:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.591+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f45ec0744c0 con 0x7f45ec15ca70 2023-05-11T07:37:16.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.780+0000 7f45e1ffb700 1 -- 172.21.15.144:0/2921819089 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45e4057730 con 0x7f45ec15ca70 2023-05-11T07:37:16.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 msgr2=0x7f45d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 0x7f45d006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c940 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2023-05-11T07:37:16.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 msgr2=0x7f45ec15a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f45e400cbc0 tx=0x7f45e400ced0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 shutdown_connections 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45d006ace0 0x7f45d006d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec15ca70 0x7f45ec15a950 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45ec06b160 0x7f45ec1e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 --2- 172.21.15.144:0/2921819089 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f45ec0d2970 0x7f45ec157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:16.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 >> 172.21.15.144:0/2921819089 conn(0x7f45ec0d3120 msgr2=0x7f45ec15eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 shutdown_connections 2023-05-11T07:37:16.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.783+0000 7f45f39ff700 1 -- 172.21.15.144:0/2921819089 wait complete. 2023-05-11T07:37:16.789 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2023-05-11T07:37:16.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-11T07:37:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.997+0000 7f0fc49ff700 1 Processor -- start 2023-05-11T07:37:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.998+0000 7f0fc49ff700 1 -- start start 2023-05-11T07:37:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fc49ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0fc015c940 0x7f0fc0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fc49ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00d0e80 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fc49ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00cdb00 con 0x7f0fc006b350 2023-05-11T07:37:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fc49ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc0161420 con 0x7f0fc015c940 2023-05-11T07:37:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fb7fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0fc00b5fd0 0x7f0fc006ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41558/0 (socket says 172.21.15.144:41558) 2023-05-11T07:37:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fb7fff700 1 -- 172.21.15.144:0/1648597361 learned_addr learned my addr 172.21.15.144:0/1648597361 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:16.999+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> v2:172.21.15.145:3300/0 conn(0x7f0fc015c940 0x7f0fc0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214923372 0 0) 0x7f0fc00d0e80 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac0035b0 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608790376 0 0) 0x7f0fc00cdb00 con 0x7f0fc006b350 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc00d0e80 con 0x7f0fc006b350 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056127680 0 0) 0x7f0fac0035b0 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 >> v2:172.21.15.145:3300/0 conn(0x7f0fc015c940 msgr2=0x7f0fc0160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 --2- 172.21.15.144:0/1648597361 >> v2:172.21.15.145:3300/0 conn(0x7f0fc015c940 0x7f0fc0160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 >> v1:172.21.15.145:6789/0 conn(0x7f0fc006b350 legacy=0x7f0fc00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00cdde0 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f0fa8001670 con 0x7f0fc00b5fd0 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> v2:172.21.15.145:3300/0 conn(0x7f0fc015c940 0x7f0fc0160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 >> v1:172.21.15.144:6789/0 conn(0x7f0fc00b5fd0 legacy=0x7f0fc006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 0x7f0fac003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac004850 0x7f0fac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fac005200 0x7f0fac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0161420 con 0x7f0fac003b90 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac00c110 con 0x7f0fac005200 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac00c2d0 con 0x7f0fac004850 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 0x7f0fac003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.000+0000 7f0fbed9d700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fac005200 0x7f0fac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fb7fff700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac004850 0x7f0fac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 -- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac004850 msgr2=0x7f0fac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac004850 0x7f0fac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 -- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fac005200 msgr2=0x7f0fac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fac005200 0x7f0fac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 -- 172.21.15.144:0/1648597361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0035b0 con 0x7f0fac003b90 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbed9d700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fac005200 0x7f0fac00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbed9d700 1 -- 172.21.15.144:0/1648597361 reap_dead start 2023-05-11T07:37:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 0x7f0fac003f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009d00 tx=0x7f0fac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80017cc1c36fe7c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0009e50 con 0x7f0fac003b90 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000e9a0 con 0x7f0fac003b90 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.001+0000 7f0fbdd9b700 1 -- 172.21.15.144:0/1648597361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ed30 con 0x7f0fac003b90 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 -- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 msgr2=0x7f0fac003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 0x7f0fac003f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009d00 tx=0x7f0fac005880 comp rx=0 tx=0).stop 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 -- 172.21.15.144:0/1648597361 shutdown_connections 2023-05-11T07:37:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/1648597361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fac003b90 0x7f0fac003f80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 -- 172.21.15.144:0/1648597361 >> 172.21.15.144:0/1648597361 conn(0x7f0fc00d3180 msgr2=0x7f0fc00d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 -- 172.21.15.144:0/1648597361 shutdown_connections 2023-05-11T07:37:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.002+0000 7f0fc49ff700 1 -- 172.21.15.144:0/1648597361 wait complete. 2023-05-11T07:37:17.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.004+0000 7f0fc49ff700 1 Processor -- start 2023-05-11T07:37:17.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.004+0000 7f0fc49ff700 1 -- start start 2023-05-11T07:37:17.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac003b90 0x7f0fc014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fc015bbd0 0x7f0fc00d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00d2150 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc014ce60 con 0x7f0fc015bbd0 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fc49ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc014d8b0 con 0x7f0fac003b90 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41780/0 (socket says 172.21.15.144:41780) 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 -- 172.21.15.144:0/2504441223 learned_addr learned my addr 172.21.15.144:0/2504441223 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fb7fff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fc015bbd0 0x7f0fc00d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac003b90 0x7f0fc014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 -- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac003b90 msgr2=0x7f0fc014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac003b90 0x7f0fc014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 -- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fc015bbd0 msgr2=0x7f0fc00d1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fc015bbd0 0x7f0fc00d1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.005+0000 7f0fbed9d700 1 -- 172.21.15.144:0/2504441223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00d1400 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fbed9d700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00d3130 tx=0x7f0fb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8003c10 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8003d90 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc00d1120 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8005310 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.006+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc015cd10 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.007+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc0157620 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.009+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fb8005470 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.009+0000 7f0fb6ffd700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 0x7f0fa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.009+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f0fb8089f50 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.010+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 0x7f0fa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.010+0000 7f0fbe59c700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 0x7f0fa006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00090b0 tx=0x7f0fb001e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.013+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0fb8055080 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.204+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0fc0157620 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.788+0000 7f0fb6ffd700 1 -- 172.21.15.144:0/2504441223 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0fb80586a0 con 0x7f0fc00d1cb0 2023-05-11T07:37:17.800 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.797+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 msgr2=0x7f0fa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.797+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 0x7f0fa006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00090b0 tx=0x7f0fb001e040 comp rx=0 tx=0).stop 2023-05-11T07:37:17.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.797+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 msgr2=0x7f0fc014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:17.801 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.797+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00d3130 tx=0x7f0fb800eeb0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 shutdown_connections 2023-05-11T07:37:17.803 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f0fa006ace0 0x7f0fa006d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f0fac003b90 0x7f0fc014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00d1cb0 0x7f0fc014f5f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 --2- 172.21.15.144:0/2504441223 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fc015bbd0 0x7f0fc00d1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:17.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.800+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 >> 172.21.15.144:0/2504441223 conn(0x7f0fc00d3180 msgr2=0x7f0fc0160310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:17.804 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.801+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 shutdown_connections 2023-05-11T07:37:17.805 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:17.801+0000 7f0fc49ff700 1 -- 172.21.15.144:0/2504441223 wait complete. 2023-05-11T07:37:17.808 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2023-05-11T07:37:17.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-11T07:37:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.013+0000 7f7f7efff700 1 Processor -- start 2023-05-11T07:37:18.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.014+0000 7f7f7efff700 1 -- start start 2023-05-11T07:37:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f7efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f7806b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f7efff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780b1c00 con 0x7f7f780d0660 2023-05-11T07:37:18.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f7efff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780b1340 con 0x7f7f7815cd60 2023-05-11T07:37:18.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f7efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806bda0 con 0x7f7f7806b3e0 2023-05-11T07:37:18.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f77fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7f780d0660 0x7f7f780b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41574/0 (socket says 172.21.15.144:41574) 2023-05-11T07:37:18.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f77fff700 1 -- 172.21.15.144:0/553026139 learned_addr learned my addr 172.21.15.144:0/553026139 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836591884 0 0) 0x7f7f780b1c00 con 0x7f7f780d0660 2023-05-11T07:37:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f680035b0 con 0x7f7f780d0660 2023-05-11T07:37:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.015+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f7806b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.021 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865451648 0 0) 0x7f7f680035b0 con 0x7f7f780d0660 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 msgr2=0x7f7f7806b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f7806b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 >> v1:172.21.15.145:6789/0 conn(0x7f7f7815cd60 legacy=0x7f7f780cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780b15b0 con 0x7f7f780d0660 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f7f64001670 con 0x7f7f780d0660 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 >> v1:172.21.15.144:6789/0 conn(0x7f7f780d0660 legacy=0x7f7f780b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.022 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f68003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68003fb0 0x7f7f68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f68004d90 0x7f7f68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806bda0 con 0x7f7f68004d90 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6800baf0 con 0x7f7f68003fb0 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6800bcb0 con 0x7f7f7806b3e0 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f68004d90 0x7f7f68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.023 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f68003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.016+0000 7f7f77fff700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68003fb0 0x7f7f68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 -- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 msgr2=0x7f7f68003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f68003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 -- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68003fb0 msgr2=0x7f7f68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68003fb0 0x7f7f68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 -- 172.21.15.144:0/553026139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680035b0 con 0x7f7f68004d90 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f7806b3e0 0x7f7f68003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:18.024 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f68004d90 0x7f7f68005200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009f90 tx=0x7f7f68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c042c7febfa860c4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ec30 con 0x7f7f68004d90 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000f040 con 0x7f7f68004d90 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f777fe700 1 -- 172.21.15.144:0/553026139 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70014480 con 0x7f7f68004d90 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.017+0000 7f7f7efff700 1 -- 172.21.15.144:0/553026139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f68004d90 msgr2=0x7f7f68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7efff700 1 --2- 172.21.15.144:0/553026139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f68004d90 0x7f7f68005200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009f90 tx=0x7f7f68005880 comp rx=0 tx=0).stop 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7d59c700 1 -- 172.21.15.144:0/553026139 reap_dead start 2023-05-11T07:37:18.025 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7efff700 1 -- 172.21.15.144:0/553026139 shutdown_connections 2023-05-11T07:37:18.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7efff700 1 -- 172.21.15.144:0/553026139 >> 172.21.15.144:0/553026139 conn(0x7f7f7809a2c0 msgr2=0x7f7f780d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:18.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7efff700 1 -- 172.21.15.144:0/553026139 shutdown_connections 2023-05-11T07:37:18.026 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.018+0000 7f7f7efff700 1 -- 172.21.15.144:0/553026139 wait complete. 2023-05-11T07:37:18.027 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.019+0000 7f7f7efff700 1 Processor -- start 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 -- start start 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 0x7f7f781f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f781564f0 0x7f7f781e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781576c0 con 0x7f7f78156080 2023-05-11T07:37:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781f5580 con 0x7f7f68004d90 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.020+0000 7f7f7efff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78157b50 con 0x7f7f781564f0 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41792/0 (socket says 172.21.15.144:41792) 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 -- 172.21.15.144:0/1304146208 learned_addr learned my addr 172.21.15.144:0/1304146208 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f7d59c700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f781564f0 0x7f7f781e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 0x7f7f781f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 -- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f781564f0 msgr2=0x7f7f781e4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f781564f0 0x7f7f781e4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 -- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 msgr2=0x7f7f781f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 0x7f7f781f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 -- 172.21.15.144:0/1304146208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780b27a0 con 0x7f7f78156080 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 0x7f7f781f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f77fff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f640072c0 tx=0x7f7f64007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400f8d0 con 0x7f7f78156080 2023-05-11T07:37:18.030 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400fa50 con 0x7f7f78156080 2023-05-11T07:37:18.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400fe00 con 0x7f7f78156080 2023-05-11T07:37:18.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.021+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780b1890 con 0x7f7f78156080 2023-05-11T07:37:18.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.022+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780cfb10 con 0x7f7f78156080 2023-05-11T07:37:18.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.023+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f780744c0 con 0x7f7f78156080 2023-05-11T07:37:18.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.024+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f6401d460 con 0x7f7f78156080 2023-05-11T07:37:18.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.025+0000 7f7f757fa700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 0x7f7f5c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.025+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f7f64089640 con 0x7f7f78156080 2023-05-11T07:37:18.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.025+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 0x7f7f5c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.032 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.025+0000 7f7f7cd9b700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 0x7f7f5c06d1c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001800 tx=0x7f7f6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.029+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7f64054570 con 0x7f7f78156080 2023-05-11T07:37:18.269 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.265+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f7806c2a0 con 0x7f7f78156080 2023-05-11T07:37:18.277 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.274+0000 7f7f757fa700 1 -- 172.21.15.144:0/1304146208 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f64057b90 con 0x7f7f78156080 2023-05-11T07:37:18.284 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.281+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 msgr2=0x7f7f5c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.281+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 0x7f7f5c06d1c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001800 tx=0x7f7f6c009040 comp rx=0 tx=0).stop 2023-05-11T07:37:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.281+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 msgr2=0x7f7f781e4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.281+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f640072c0 tx=0x7f7f64007680 comp rx=0 tx=0).stop 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 shutdown_connections 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f7f5c06ad10 0x7f7f5c06d1c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f7f781564f0 0x7f7f781e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f68004d90 0x7f7f781f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 --2- 172.21.15.144:0/1304146208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f78156080 0x7f7f781e4810 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.284+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 >> 172.21.15.144:0/1304146208 conn(0x7f7f7809a2c0 msgr2=0x7f7f780b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:18.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.294+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 shutdown_connections 2023-05-11T07:37:18.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.294+0000 7f7f7efff700 1 -- 172.21.15.144:0/1304146208 wait complete. 2023-05-11T07:37:18.306 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 6 and data pool 7 2023-05-11T07:37:18.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:18.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.505+0000 7faebc9ff700 1 Processor -- start 2023-05-11T07:37:18.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.505+0000 7faebc9ff700 1 -- start start 2023-05-11T07:37:18.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faebc9ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faeb80b87e0 0x7faeb80b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faebc9ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb80d02c0 0x7faeb80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faebc9ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb815cef0 con 0x7faeb80d2090 2023-05-11T07:37:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faebc9ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80b5a80 con 0x7faeb80d02c0 2023-05-11T07:37:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faebc9ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80cdf70 con 0x7faeb80b87e0 2023-05-11T07:37:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb80d02c0 0x7faeb80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faeb80d02c0 0x7faeb80b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41802/0 (socket says 172.21.15.144:41802) 2023-05-11T07:37:18.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 -- 172.21.15.144:0/1719606046 learned_addr learned my addr 172.21.15.144:0/1719606046 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 -- 172.21.15.144:0/1719606046 >> v2:172.21.15.145:3300/0 conn(0x7faeb80b87e0 msgr2=0x7faeb80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 --2- 172.21.15.144:0/1719606046 >> v2:172.21.15.145:3300/0 conn(0x7faeb80b87e0 0x7faeb80b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 -- 172.21.15.144:0/1719606046 >> v1:172.21.15.145:6789/0 conn(0x7faeb80d2090 legacy=0x7faeb80d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.507+0000 7faeaffff700 1 -- 172.21.15.144:0/1719606046 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80cd760 con 0x7faeb80d02c0 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faeaffff700 1 --2- 172.21.15.144:0/1719606046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b50d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b5cb0 tx=0x7faea0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3523423967154aed server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faeb5d9b700 1 -- 172.21.15.144:0/1719606046 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0004230 con 0x7faeb80d02c0 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faeb5d9b700 1 -- 172.21.15.144:0/1719606046 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0004390 con 0x7faeb80d02c0 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faeb5d9b700 1 -- 172.21.15.144:0/1719606046 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00036a0 con 0x7faeb80d02c0 2023-05-11T07:37:18.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 -- 172.21.15.144:0/1719606046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 msgr2=0x7faeb80b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 --2- 172.21.15.144:0/1719606046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b50d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b5cb0 tx=0x7faea0009bd0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 -- 172.21.15.144:0/1719606046 shutdown_connections 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 --2- 172.21.15.144:0/1719606046 >> v2:172.21.15.145:3300/0 conn(0x7faeb80b87e0 0x7faeb80b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 --2- 172.21.15.144:0/1719606046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b50d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 -- 172.21.15.144:0/1719606046 >> 172.21.15.144:0/1719606046 conn(0x7faeb806acf0 msgr2=0x7faeb806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 -- 172.21.15.144:0/1719606046 shutdown_connections 2023-05-11T07:37:18.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.508+0000 7faebc9ff700 1 -- 172.21.15.144:0/1719606046 wait complete. 2023-05-11T07:37:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.510+0000 7faebc9ff700 1 Processor -- start 2023-05-11T07:37:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.510+0000 7faebc9ff700 1 -- start start 2023-05-11T07:37:18.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 0x7faeb8153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb80d2090 0x7faeb80b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81f5d90 con 0x7faeb80d02c0 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c7330 con 0x7faeb80d2090 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faebc9ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80cce20 con 0x7faeb80b87e0 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faeaffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faeaffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41804/0 (socket says 172.21.15.144:41804) 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.511+0000 7faeaffff700 1 -- 172.21.15.144:0/4037921899 learned_addr learned my addr 172.21.15.144:0/4037921899 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeb6d9d700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb80d2090 0x7faeb80b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeb659c700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 0x7faeb8153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 -- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 msgr2=0x7faeb8153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 0x7faeb8153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 -- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb80d2090 msgr2=0x7faeb80b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb80d2090 0x7faeb80b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 -- 172.21.15.144:0/4037921899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009550 con 0x7faeb80d02c0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeb659c700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 0x7faeb8153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaffff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faeb80676d0 tx=0x7faea0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0003dc0 con 0x7faeb80d02c0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea001f070 con 0x7faeb80d02c0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80cd9b0 con 0x7faeb80d02c0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0011870 con 0x7faeb80d02c0 2023-05-11T07:37:18.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.512+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb80d2d30 con 0x7faeb80d02c0 2023-05-11T07:37:18.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.513+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80cdc90 con 0x7faeb80d02c0 2023-05-11T07:37:18.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.515+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faea0021030 con 0x7faeb80d02c0 2023-05-11T07:37:18.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.516+0000 7faeaeffd700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 0x7fae9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.516+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faea008abc0 con 0x7faeb80d02c0 2023-05-11T07:37:18.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.516+0000 7faeb659c700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 0x7fae9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.516+0000 7faeb659c700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 0x7fae9806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faea8007900 tx=0x7faea8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.522 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.519+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faea0055ca0 con 0x7faeb80d02c0 2023-05-11T07:37:18.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.717+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeb815ced0 con 0x7faeb80d02c0 2023-05-11T07:37:18.722 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.718+0000 7faeaeffd700 1 -- 172.21.15.144:0/4037921899 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18549 (secure 0 0 0) 0x7faea00592c0 con 0x7faeb80d02c0 2023-05-11T07:37:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:18.722 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":41,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:37:18.267623+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:37:16.630101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T07:37:17.243357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:18.724 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 msgr2=0x7fae9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 0x7fae9806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faea8007900 tx=0x7faea8008040 comp rx=0 tx=0).stop 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 msgr2=0x7faeb80b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faeb80676d0 tx=0x7faea0004750 comp rx=0 tx=0).stop 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 shutdown_connections 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fae9806ace0 0x7fae9806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7faeb80b87e0 0x7faeb8153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.725 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb80d2090 0x7faeb80b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 --2- 172.21.15.144:0/4037921899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faeb80d02c0 0x7faeb80b2cc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 >> 172.21.15.144:0/4037921899 conn(0x7faeb806acf0 msgr2=0x7faeb80d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:18.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 shutdown_connections 2023-05-11T07:37:18.726 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.721+0000 7faebc9ff700 1 -- 172.21.15.144:0/4037921899 wait complete. 2023-05-11T07:37:18.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.924+0000 7fad5a5ff700 1 Processor -- start 2023-05-11T07:37:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.925+0000 7fad5a5ff700 1 -- start start 2023-05-11T07:37:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.926+0000 7fad5a5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fad540d27a0 0x7fad540d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.926+0000 7fad5a5ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5415cef0 con 0x7fad540b52a0 2023-05-11T07:37:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.926+0000 7fad5a5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad540cd760 con 0x7fad540b87e0 2023-05-11T07:37:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.926+0000 7fad5a5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540b5a80 con 0x7fad540d27a0 2023-05-11T07:37:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.926+0000 7fad537fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fad540b52a0 0x7fad540d2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41586/0 (socket says 172.21.15.144:41586) 2023-05-11T07:37:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad537fe700 1 -- 172.21.15.144:0/2003695172 learned_addr learned my addr 172.21.15.144:0/2003695172 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad58b9c700 1 --2- 172.21.15.144:0/2003695172 >> v2:172.21.15.145:3300/0 conn(0x7fad540d27a0 0x7fad540d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984867585 0 0) 0x7fad48001110 con 0x7fad540b52a0 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c0035b0 con 0x7fad540b52a0 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931024257 0 0) 0x7fad3c0035b0 con 0x7fad540b52a0 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 >> v2:172.21.15.145:3300/0 conn(0x7fad540d27a0 msgr2=0x7fad540d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 --2- 172.21.15.144:0/2003695172 >> v2:172.21.15.145:3300/0 conn(0x7fad540d27a0 0x7fad540d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 >> v1:172.21.15.145:6789/0 conn(0x7fad540b87e0 legacy=0x7fad540b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540d2d30 con 0x7fad540b52a0 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7fad48001800 con 0x7fad540b52a0 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 >> v1:172.21.15.144:6789/0 conn(0x7fad540b52a0 legacy=0x7fad540d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 0x7fad3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad3c004850 0x7fad3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c005200 0x7fad3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00c0e0 con 0x7fad3c003a00 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00c220 con 0x7fad3c004850 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.927+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00c3e0 con 0x7fad3c005200 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 0x7fad3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad537fe700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad3c004850 0x7fad3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad58b9c700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c005200 0x7fad3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 -- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c005200 msgr2=0x7fad3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c005200 0x7fad3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 -- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad3c004850 msgr2=0x7fad3c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad3c004850 0x7fad3c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 -- 172.21.15.144:0/2003695172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0035b0 con 0x7fad3c003a00 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad58b9c700 1 -- 172.21.15.144:0/2003695172 reap_dead start 2023-05-11T07:37:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.928+0000 7fad53fff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 0x7fad3c003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad44007fd0 tx=0x7fad3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe260df07025efd9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440052d0 con 0x7fad3c003a00 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44005450 con 0x7fad3c003a00 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad52ffd700 1 -- 172.21.15.144:0/2003695172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440038c0 con 0x7fad3c003a00 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 -- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 msgr2=0x7fad3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 0x7fad3c003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad44007fd0 tx=0x7fad3c005880 comp rx=0 tx=0).stop 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 -- 172.21.15.144:0/2003695172 shutdown_connections 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/2003695172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad3c003a00 0x7fad3c003dd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 -- 172.21.15.144:0/2003695172 >> 172.21.15.144:0/2003695172 conn(0x7fad5406acf0 msgr2=0x7fad5406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 -- 172.21.15.144:0/2003695172 shutdown_connections 2023-05-11T07:37:18.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.929+0000 7fad5a5ff700 1 -- 172.21.15.144:0/2003695172 wait complete. 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.931+0000 7fad5a5ff700 1 Processor -- start 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.931+0000 7fad5a5ff700 1 -- start start 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c003a00 0x7fad54154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad54157160 0x7fad541575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.940 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad541563c0 con 0x7fad541e6de0 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54157b10 con 0x7fad54157160 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad5a5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad541e77c0 con 0x7fad3c003a00 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad58b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad58b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41826/0 (socket says 172.21.15.144:41826) 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad58b9c700 1 -- 172.21.15.144:0/3667975035 learned_addr learned my addr 172.21.15.144:0/3667975035 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad537fe700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad54157160 0x7fad541575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.932+0000 7fad53fff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c003a00 0x7fad54154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 -- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c003a00 msgr2=0x7fad54154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c003a00 0x7fad54154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 -- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad54157160 msgr2=0x7fad541575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad54157160 0x7fad541575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 -- 172.21.15.144:0/3667975035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540cdc90 con 0x7fad541e6de0 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad58b9c700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad540c6be0 tx=0x7fad4c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00e070 con 0x7fad541e6de0 2023-05-11T07:37:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c003c30 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad540cd9b0 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c003e20 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.933+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad540b8bb0 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.934+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5408b830 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.935+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad4c011a40 con 0x7fad541e6de0 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.936+0000 7fad50ff9700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 0x7fad4006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.936+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fad4c0899f0 con 0x7fad541e6de0 2023-05-11T07:37:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.936+0000 7fad53fff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 0x7fad4006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.937+0000 7fad53fff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 0x7fad4006d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fad44005040 tx=0x7fad44009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:18.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:18.941+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fad4c0548c0 con 0x7fad541e6de0 2023-05-11T07:37:19.137 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.134+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad540c6850 con 0x7fad541e6de0 2023-05-11T07:37:19.138 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.135+0000 7fad50ff9700 1 -- 172.21.15.144:0/3667975035 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18549 (secure 0 0 0) 0x7fad4c057ee0 con 0x7fad541e6de0 2023-05-11T07:37:19.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:19.139 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":41,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:37:18.267623+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:37:16.630101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T07:37:17.243357+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:19.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.137+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 msgr2=0x7fad4006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.137+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 0x7fad4006d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fad44005040 tx=0x7fad44009030 comp rx=0 tx=0).stop 2023-05-11T07:37:19.141 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 msgr2=0x7fad541e7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad540c6be0 tx=0x7fad4c0114b0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 shutdown_connections 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fad4006ad10 0x7fad4006d1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fad3c003a00 0x7fad54154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad541e6de0 0x7fad541e7280 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 --2- 172.21.15.144:0/3667975035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad54157160 0x7fad541575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 >> 172.21.15.144:0/3667975035 conn(0x7fad5406acf0 msgr2=0x7fad540b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:19.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 shutdown_connections 2023-05-11T07:37:19.143 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.138+0000 7fad5a5ff700 1 -- 172.21.15.144:0/3667975035 wait complete. 2023-05-11T07:37:19.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-11T07:37:19.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.344+0000 7eff6f5ff700 1 Processor -- start 2023-05-11T07:37:19.348 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.345+0000 7eff6f5ff700 1 -- start start 2023-05-11T07:37:19.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6f5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.349 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6f5ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 0x7eff680cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6f5ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6815e200 con 0x7eff681599e0 2023-05-11T07:37:19.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6f5ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff680b10d0 con 0x7eff680ccee0 2023-05-11T07:37:19.350 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6f5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6815a100 con 0x7eff680b0720 2023-05-11T07:37:19.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6cb9a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6cb9a700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:57714/0 (socket says 172.21.15.144:57714) 2023-05-11T07:37:19.351 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6cb9a700 1 -- 172.21.15.144:0/2946355234 learned_addr learned my addr 172.21.15.144:0/2946355234 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.346+0000 7eff6db9c700 1 --2- 172.21.15.144:0/2946355234 >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 0x7eff680cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff5ffff700 1 -- 172.21.15.144:0/2946355234 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478355491 0 0) 0x7eff6815e200 con 0x7eff681599e0 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff5ffff700 1 -- 172.21.15.144:0/2946355234 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff540035b0 con 0x7eff681599e0 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6cb9a700 1 -- 172.21.15.144:0/2946355234 >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 msgr2=0x7eff680cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6cb9a700 1 --2- 172.21.15.144:0/2946355234 >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 0x7eff680cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6cb9a700 1 -- 172.21.15.144:0/2946355234 >> v1:172.21.15.145:6789/0 conn(0x7eff681599e0 legacy=0x7eff680c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6cb9a700 1 -- 172.21.15.144:0/2946355234 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6815a3e0 con 0x7eff680b0720 2023-05-11T07:37:19.352 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6db9c700 1 --2- 172.21.15.144:0/2946355234 >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 0x7eff680cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff6cb9a700 1 --2- 172.21.15.144:0/2946355234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff580098f0 tx=0x7eff58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3cf01a527b15272 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.347+0000 7eff5ffff700 1 -- 172.21.15.144:0/2946355234 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58011830 con 0x7eff680b0720 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff5ffff700 1 -- 172.21.15.144:0/2946355234 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58011990 con 0x7eff680b0720 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff5ffff700 1 -- 172.21.15.144:0/2946355234 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58011d20 con 0x7eff680b0720 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 -- 172.21.15.144:0/2946355234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 msgr2=0x7eff680b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.353 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/2946355234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff580098f0 tx=0x7eff58009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:19.355 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 -- 172.21.15.144:0/2946355234 shutdown_connections 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/2946355234 >> v2:172.21.15.145:3300/0 conn(0x7eff680ccee0 0x7eff680cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/2946355234 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff680b0720 0x7eff680b0b90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 -- 172.21.15.144:0/2946355234 >> 172.21.15.144:0/2946355234 conn(0x7eff680cb720 msgr2=0x7eff680cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 -- 172.21.15.144:0/2946355234 shutdown_connections 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.348+0000 7eff6f5ff700 1 -- 172.21.15.144:0/2946355234 wait complete. 2023-05-11T07:37:19.356 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.350+0000 7eff6f5ff700 1 Processor -- start 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.350+0000 7eff6f5ff700 1 -- start start 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff680b0720 0x7eff681f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 0x7eff6806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6815cab0 con 0x7eff680ccee0 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff681f62c0 con 0x7eff680b0720 2023-05-11T07:37:19.357 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6f5ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff681f65a0 con 0x7eff681599e0 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6cb9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6cb9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41836/0 (socket says 172.21.15.144:41836) 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6cb9a700 1 -- 172.21.15.144:0/1236808796 learned_addr learned my addr 172.21.15.144:0/1236808796 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6db9c700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 0x7eff6806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.351+0000 7eff6d39b700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff680b0720 0x7eff681f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 -- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 msgr2=0x7eff6806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 0x7eff6806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.358 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 -- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff680b0720 msgr2=0x7eff681f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff680b0720 0x7eff681f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 -- 172.21.15.144:0/1236808796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600099e0 con 0x7eff680ccee0 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6db9c700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 0x7eff6806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6cb9a700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58004480 con 0x7eff680ccee0 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5801f070 con 0x7eff680ccee0 2023-05-11T07:37:19.359 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580038c0 con 0x7eff680ccee0 2023-05-11T07:37:19.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff58009550 con 0x7eff680ccee0 2023-05-11T07:37:19.360 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.352+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6815a9a0 con 0x7eff680ccee0 2023-05-11T07:37:19.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.353+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6815a6c0 con 0x7eff680ccee0 2023-05-11T07:37:19.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.354+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff58021030 con 0x7eff680ccee0 2023-05-11T07:37:19.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.355+0000 7eff5dffb700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 0x7eff4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:19.361 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.355+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7eff5808a9e0 con 0x7eff680ccee0 2023-05-11T07:37:19.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.355+0000 7eff6d39b700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 0x7eff4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:19.362 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.356+0000 7eff6d39b700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 0x7eff4c06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff64007fd0 tx=0x7eff64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:19.363 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.359+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7eff58055a60 con 0x7eff680ccee0 2023-05-11T07:37:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:19.595+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff680b1700 con 0x7eff680ccee0 2023-05-11T07:37:20.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.286+0000 7eff5dffb700 1 -- 172.21.15.144:0/1236808796 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff580150b0 con 0x7eff680ccee0 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 msgr2=0x7eff4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 0x7eff4c06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff64007fd0 tx=0x7eff64009040 comp rx=0 tx=0).stop 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 msgr2=0x7eff6806c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58004750 comp rx=0 tx=0).stop 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 shutdown_connections 2023-05-11T07:37:20.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7eff4c06ace0 0x7eff4c06d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7eff681599e0 0x7eff6806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7eff680b0720 0x7eff681f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 --2- 172.21.15.144:0/1236808796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff680ccee0 0x7eff6806c710 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 >> 172.21.15.144:0/1236808796 conn(0x7eff680cb720 msgr2=0x7eff68154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 shutdown_connections 2023-05-11T07:37:20.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.289+0000 7eff6f5ff700 1 -- 172.21.15.144:0/1236808796 wait complete. 2023-05-11T07:37:20.313 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-11T07:37:20.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-11T07:37:20.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.500+0000 7fdedd3ff700 1 Processor -- start 2023-05-11T07:37:20.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.500+0000 7fdedd3ff700 1 -- start start 2023-05-11T07:37:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdedd3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 0x7fded80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdedd3ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 0x7fded80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdedd3ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded8070f10 con 0x7fded815a880 2023-05-11T07:37:20.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdedd3ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80cc700 con 0x7fded80b1150 2023-05-11T07:37:20.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdedd3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded806bc10 con 0x7fded80caf00 2023-05-11T07:37:20.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fded6ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fded815a880 0x7fded80ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41594/0 (socket says 172.21.15.144:41594) 2023-05-11T07:37:20.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fded6ffd700 1 -- 172.21.15.144:0/659474951 learned_addr learned my addr 172.21.15.144:0/659474951 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fded77fe700 1 --2- 172.21.15.144:0/659474951 >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 0x7fded80713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fdecffff700 1 --2- 172.21.15.144:0/659474951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 0x7fded80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156893356 0 0) 0x7fded8070f10 con 0x7fded815a880 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.502+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec40035b0 con 0x7fded815a880 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fdecffff700 1 -- 172.21.15.144:0/659474951 >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 msgr2=0x7fded80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fdecffff700 1 --2- 172.21.15.144:0/659474951 >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 0x7fded80713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811169816 0 0) 0x7fdec40035b0 con 0x7fded815a880 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fdecffff700 1 -- 172.21.15.144:0/659474951 >> v1:172.21.15.144:6789/0 conn(0x7fded815a880 legacy=0x7fded80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fdecffff700 1 -- 172.21.15.144:0/659474951 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded806bef0 con 0x7fded80caf00 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fded77fe700 1 --2- 172.21.15.144:0/659474951 >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 0x7fded80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fdecffff700 1 --2- 172.21.15.144:0/659474951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 0x7fded80b1b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009840 tx=0x7fdec0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2764094193d2b07 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 <== mon.2 v2:172.21.15.145:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8001670 con 0x7fded80caf00 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 <== mon.2 v2:172.21.15.145:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0004030 con 0x7fded80caf00 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.503+0000 7fded67fc700 1 -- 172.21.15.144:0/659474951 <== mon.2 v2:172.21.15.145:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00043a0 con 0x7fded80caf00 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 -- 172.21.15.144:0/659474951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 msgr2=0x7fded80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/659474951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 0x7fded80b1b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009840 tx=0x7fdec0009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 -- 172.21.15.144:0/659474951 shutdown_connections 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/659474951 >> v2:172.21.15.145:3300/0 conn(0x7fded80b1150 0x7fded80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/659474951 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80caf00 0x7fded80b1b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 -- 172.21.15.144:0/659474951 >> 172.21.15.144:0/659474951 conn(0x7fded80cb740 msgr2=0x7fded80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 -- 172.21.15.144:0/659474951 shutdown_connections 2023-05-11T07:37:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.504+0000 7fdedd3ff700 1 -- 172.21.15.144:0/659474951 wait complete. 2023-05-11T07:37:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.506+0000 7fdedd3ff700 1 Processor -- start 2023-05-11T07:37:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.506+0000 7fdedd3ff700 1 -- start start 2023-05-11T07:37:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.506+0000 7fdedd3ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80b1150 0x7fded81f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.506+0000 7fdedd3ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdedd3ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fded815a880 0x7fded80c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdedd3ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80c3b40 con 0x7fded80caf00 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdedd3ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80c3e20 con 0x7fded815a880 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdedd3ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded80c4100 con 0x7fded80b1150 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41846/0 (socket says 172.21.15.144:41846) 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 -- 172.21.15.144:0/159565398 learned_addr learned my addr 172.21.15.144:0/159565398 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fded6ffd700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80b1150 0x7fded81f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fded77fe700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fded815a880 0x7fded80c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 -- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80b1150 msgr2=0x7fded81f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80b1150 0x7fded81f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 -- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fded815a880 msgr2=0x7fded80c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fded815a880 0x7fded80c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.507+0000 7fdecffff700 1 -- 172.21.15.144:0/159565398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0009a70 con 0x7fded80caf00 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdecffff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdec00090b0 tx=0x7fdec0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:20.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0004570 con 0x7fded80caf00 2023-05-11T07:37:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec001f070 con 0x7fded80caf00 2023-05-11T07:37:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0011870 con 0x7fded80caf00 2023-05-11T07:37:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec00094a0 con 0x7fded80caf00 2023-05-11T07:37:20.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.508+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded806c4b0 con 0x7fded80caf00 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.509+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded806c1d0 con 0x7fded80caf00 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.510+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdec00119d0 con 0x7fded80caf00 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.511+0000 7fdecf7fe700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.511+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdec0021070 con 0x7fded80caf00 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.511+0000 7fded6ffd700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:20.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.512+0000 7fded6ffd700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 0x7fdeb806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdec8001eb0 tx=0x7fdec8001e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:20.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.515+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdec0055d80 con 0x7fded80caf00 2023-05-11T07:37:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:20.752+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fded806b8a0 con 0x7fded80caf00 2023-05-11T07:37:20.757 INFO:tasks.ceph.mds.a.smithi144.stderr:2023-05-11T07:37:20.754+0000 7fa6c8bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T07:37:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.288+0000 7fdecf7fe700 1 -- 172.21.15.144:0/159565398 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdec002b0c0 con 0x7fded80caf00 2023-05-11T07:37:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 msgr2=0x7fdeb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 0x7fdeb806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdec8001eb0 tx=0x7fdec8001e40 comp rx=0 tx=0).stop 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 msgr2=0x7fded81f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdec00090b0 tx=0x7fdec0004750 comp rx=0 tx=0).stop 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 shutdown_connections 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fdeb806ace0 0x7fdeb806d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fded80b1150 0x7fded81f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fded815a880 0x7fded80c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 --2- 172.21.15.144:0/159565398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded80caf00 0x7fded81f6060 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 >> 172.21.15.144:0/159565398 conn(0x7fded80cb740 msgr2=0x7fded80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 shutdown_connections 2023-05-11T07:37:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.291+0000 7fdedd3ff700 1 -- 172.21.15.144:0/159565398 wait complete. 2023-05-11T07:37:21.313 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-11T07:37:21.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:37:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.493+0000 7fde531ff700 1 Processor -- start 2023-05-11T07:37:21.497 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.494+0000 7fde531ff700 1 -- start start 2023-05-11T07:37:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde531ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 0x7fde4c06a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde531ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fde4c06b7a0 0x7fde4c06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde531ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c06ac60 con 0x7fde4c15a750 2023-05-11T07:37:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde531ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c06cfe0 con 0x7fde4c06b7a0 2023-05-11T07:37:21.499 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde531ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c15ab20 con 0x7fde4c06a2d0 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 0x7fde4c06a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde5179c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fde4c06b7a0 0x7fde4c06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde5179c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fde4c06b7a0 0x7fde4c06bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.144:50148/0 (socket says 172.21.15.144:50148) 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 0x7fde4c06a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3301/0 says I am v2:172.21.15.144:57754/0 (socket says 172.21.15.144:57754) 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde5179c700 1 -- 172.21.15.144:0/2170294558 learned_addr learned my addr 172.21.15.144:0/2170294558 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:21.500 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.495+0000 7fde50f9b700 1 --1- 172.21.15.144:0/2170294558 >> v1:172.21.15.145:6789/0 conn(0x7fde4c15a750 0x7fde4c071bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:39228/0 (socket says 172.21.15.144:39228) 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde5179c700 1 -- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 msgr2=0x7fde4c06a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde5179c700 1 --2- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 0x7fde4c06a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde5179c700 1 -- 172.21.15.144:0/2170294558 >> v1:172.21.15.145:6789/0 conn(0x7fde4c15a750 legacy=0x7fde4c071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde5179c700 1 -- 172.21.15.144:0/2170294558 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c071740 con 0x7fde4c06b7a0 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde5179c700 1 --2- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c06b7a0 0x7fde4c06bc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ec9a7133702642 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde4b7fe700 1 -- 172.21.15.144:0/2170294558 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400e070 con 0x7fde4c06b7a0 2023-05-11T07:37:21.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde4b7fe700 1 -- 172.21.15.144:0/2170294558 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400b910 con 0x7fde4c06b7a0 2023-05-11T07:37:21.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.496+0000 7fde4b7fe700 1 -- 172.21.15.144:0/2170294558 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400bcc0 con 0x7fde4c06b7a0 2023-05-11T07:37:21.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 -- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c06b7a0 msgr2=0x7fde4c06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 --2- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c06b7a0 0x7fde4c06bc00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).stop 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 -- 172.21.15.144:0/2170294558 shutdown_connections 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 --2- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c06b7a0 0x7fde4c06bc00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 --2- 172.21.15.144:0/2170294558 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06a2d0 0x7fde4c06a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 -- 172.21.15.144:0/2170294558 >> 172.21.15.144:0/2170294558 conn(0x7fde4c0cb7e0 msgr2=0x7fde4c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 -- 172.21.15.144:0/2170294558 shutdown_connections 2023-05-11T07:37:21.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.497+0000 7fde531ff700 1 -- 172.21.15.144:0/2170294558 wait complete. 2023-05-11T07:37:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.499+0000 7fde531ff700 1 Processor -- start 2023-05-11T07:37:21.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.499+0000 7fde531ff700 1 -- start start 2023-05-11T07:37:21.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06b7a0 0x7fde4c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c15a750 0x7fde4c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c5c80 con 0x7fde4c06a2d0 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c4be0 con 0x7fde4c15a750 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde531ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c4ec0 con 0x7fde4c06b7a0 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde50f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde50f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41850/0 (socket says 172.21.15.144:41850) 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde50f9b700 1 -- 172.21.15.144:0/953608768 learned_addr learned my addr 172.21.15.144:0/953608768 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:21.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde4bfff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06b7a0 0x7fde4c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde5179c700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c15a750 0x7fde4c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde50f9b700 1 -- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06b7a0 msgr2=0x7fde4c1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.500+0000 7fde50f9b700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06b7a0 0x7fde4c1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde50f9b700 1 -- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c15a750 msgr2=0x7fde4c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde50f9b700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c15a750 0x7fde4c0af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde50f9b700 1 -- 172.21.15.144:0/953608768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009b30 con 0x7fde4c06a2d0 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde50f9b700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c520 tx=0x7fde4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40005cb0 con 0x7fde4c06a2d0 2023-05-11T07:37:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c06c420 con 0x7fde4c06a2d0 2023-05-11T07:37:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c071160 con 0x7fde4c06a2d0 2023-05-11T07:37:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40001270 con 0x7fde4c06a2d0 2023-05-11T07:37:21.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.501+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400072d0 con 0x7fde4c06a2d0 2023-05-11T07:37:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.502+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c0052f0 con 0x7fde4c06a2d0 2023-05-11T07:37:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.503+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde40007430 con 0x7fde4c06a2d0 2023-05-11T07:37:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.504+0000 7fde497fa700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 0x7fde3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.504+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde40088870 con 0x7fde4c06a2d0 2023-05-11T07:37:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.505+0000 7fde4bfff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 0x7fde3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.505+0000 7fde4bfff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 0x7fde3006d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fde38009ad0 tx=0x7fde38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.508+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fde40053790 con 0x7fde4c06a2d0 2023-05-11T07:37:21.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.745+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde2c005b20 con 0x7fde4c06a2d0 2023-05-11T07:37:21.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.746+0000 7fde497fa700 1 -- 172.21.15.144:0/953608768 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fde40056db0 con 0x7fde4c06a2d0 2023-05-11T07:37:21.749 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/140341330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":140341330},{"type":"v1","addr":"172.21.15.144:6837","nonce":140341330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5003,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3680363199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":3680363199},{"type":"v1","addr":"172.21.15.145:6835","nonce":3680363199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/3789358729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3789358729},{"type":"v1","addr":"172.21.15.145:6834","nonce":3789358729}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:37:18.267969+0000","modified":"2023-05-11T07:37:21.285806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6836/2598222041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2598222041},{"type":"v1","addr":"172.21.15.144:6836","nonce":2598222041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-11T07:37:21.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 msgr2=0x7fde3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 0x7fde3006d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fde38009ad0 tx=0x7fde38008040 comp rx=0 tx=0).stop 2023-05-11T07:37:21.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 msgr2=0x7fde4c0ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c520 tx=0x7fde4000c8e0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 shutdown_connections 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fde3006ace0 0x7fde3006d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fde4c15a750 0x7fde4c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4c06a2d0 0x7fde4c0ade90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 --2- 172.21.15.144:0/953608768 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fde4c06b7a0 0x7fde4c1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 >> 172.21.15.144:0/953608768 conn(0x7fde4c0cb7e0 msgr2=0x7fde4c15ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 shutdown_connections 2023-05-11T07:37:21.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.748+0000 7fde531ff700 1 -- 172.21.15.144:0/953608768 wait complete. 2023-05-11T07:37:21.754 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2023-05-11T07:37:21.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T07:37:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.948+0000 7f4bd81ff700 1 Processor -- start 2023-05-11T07:37:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.948+0000 7f4bd81ff700 1 -- start start 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.949+0000 7f4bd81ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f4bd00c9730 0x7f4bd015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.949+0000 7f4bd81ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd015e1c0 con 0x7f4bd006a2d0 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.949+0000 7f4bd81ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd0159bc0 con 0x7f4bd01597f0 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.949+0000 7f4bd81ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00c9bd0 con 0x7f4bd00c9730 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd679c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4bd006a2d0 0x7f4bd006fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41604/0 (socket says 172.21.15.144:41604) 2023-05-11T07:37:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd679c700 1 -- 172.21.15.144:0/1397482842 learned_addr learned my addr 172.21.15.144:0/1397482842 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415828833 0 0) 0x7f4bd015e1c0 con 0x7f4bd006a2d0 2023-05-11T07:37:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1397482842 >> v2:172.21.15.145:3300/0 conn(0x7f4bd00c9730 0x7f4bd015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bbc0057c0 con 0x7f4bd006a2d0 2023-05-11T07:37:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196501041 0 0) 0x7f4bbc0057c0 con 0x7f4bd006a2d0 2023-05-11T07:37:21.956 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 >> v2:172.21.15.145:3300/0 conn(0x7f4bd00c9730 msgr2=0x7f4bd015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:21.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 --2- 172.21.15.144:0/1397482842 >> v2:172.21.15.145:3300/0 conn(0x7f4bd00c9730 0x7f4bd015dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 >> v1:172.21.15.145:6789/0 conn(0x7f4bd01597f0 legacy=0x7f4bd00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00c9e30 con 0x7f4bd006a2d0 2023-05-11T07:37:21.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f4bc8001670 con 0x7f4bd006a2d0 2023-05-11T07:37:21.957 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 >> v1:172.21.15.144:6789/0 conn(0x7f4bd006a2d0 legacy=0x7f4bd006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.950+0000 7f4bd4f99700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bbc006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd4f99700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bbc006a60 0x7f4bbc006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd4f99700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bbc007410 0x7f4bbc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c9bd0 con 0x7f4bbc005c10 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc00e290 con 0x7f4bbc006a60 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc00e450 con 0x7f4bbc007410 2023-05-11T07:37:21.958 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bbc006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bbc006a60 0x7f4bbc006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd679c700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bbc007410 0x7f4bbc00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bbc007410 msgr2=0x7f4bbc00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bbc007410 0x7f4bbc00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bbc006a60 msgr2=0x7f4bbc006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bbc006a60 0x7f4bbc006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1397482842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0057c0 con 0x7f4bbc005c10 2023-05-11T07:37:21.959 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd679c700 1 -- 172.21.15.144:0/1397482842 reap_dead start 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.951+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bbc006020 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc002150 tx=0x7f4bbc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc5e07efd159a8e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc001db0 con 0x7f4bbc005c10 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc003c20 con 0x7f4bbc005c10 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd4f99700 1 -- 172.21.15.144:0/1397482842 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00c930 con 0x7f4bbc005c10 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 msgr2=0x7f4bbc006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bbc006020 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc002150 tx=0x7f4bbc007a90 comp rx=0 tx=0).stop 2023-05-11T07:37:21.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1397482842 shutdown_connections 2023-05-11T07:37:21.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1397482842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bbc006020 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1397482842 >> 172.21.15.144:0/1397482842 conn(0x7f4bd00cb7e0 msgr2=0x7f4bd00cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:21.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1397482842 shutdown_connections 2023-05-11T07:37:21.961 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.952+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1397482842 wait complete. 2023-05-11T07:37:21.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.955+0000 7f4bd81ff700 1 Processor -- start 2023-05-11T07:37:21.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.955+0000 7f4bd81ff700 1 -- start start 2023-05-11T07:37:21.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 0x7f4bd006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 0x7f4bd006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd014e840 con 0x7f4bbc005c10 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0150c90 con 0x7f4bd00b48f0 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd81ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0150f70 con 0x7f4bd00b4480 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd5f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd5f9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41874/0 (socket says 172.21.15.144:41874) 2023-05-11T07:37:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.956+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1246034589 learned_addr learned my addr 172.21.15.144:0/1246034589 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 0x7f4bd006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd679c700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 0x7f4bd006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 msgr2=0x7f4bd006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 0x7f4bd006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 msgr2=0x7f4bd006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 0x7f4bd006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 -- 172.21.15.144:0/1246034589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00cccb0 con 0x7f4bbc005c10 2023-05-11T07:37:21.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 0x7f4bd006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd679c700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 0x7f4bd006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd5f9b700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc005040 tx=0x7f4bcc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00cdc0 con 0x7f4bbc005c10 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0050d0 con 0x7f4bbc005c10 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc005480 con 0x7f4bbc005c10 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.957+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00ca110 con 0x7f4bbc005c10 2023-05-11T07:37:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.958+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd00ccf90 con 0x7f4bbc005c10 2023-05-11T07:37:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.959+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd006f130 con 0x7f4bbc005c10 2023-05-11T07:37:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.960+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4bcc019040 con 0x7f4bbc005c10 2023-05-11T07:37:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.960+0000 7f4bc67fc700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 0x7f4bb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:21.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.961+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4bcc08a7c0 con 0x7f4bbc005c10 2023-05-11T07:37:21.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.961+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 0x7f4bb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:21.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.961+0000 7f4bd579a700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 0x7f4bb406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0151a20 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:21.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:21.965+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4bcc055720 con 0x7f4bbc005c10 2023-05-11T07:37:22.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.159+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bd0159bc0 con 0x7f4bbc005c10 2023-05-11T07:37:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.160+0000 7f4bc67fc700 1 -- 172.21.15.144:0/1246034589 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18536 (secure 0 0 0) 0x7f4bd0159bc0 con 0x7f4bbc005c10 2023-05-11T07:37:22.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:22.164 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":42,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","created":"2023-05-11T07:35:12.706870+0000","modified":"2023-05-11T07:37:19.270343+0000","last_up_change":"2023-05-11T07:35:25.996143+0000","last_in_change":"2023-05-11T07:35:16.007878+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T07:35:25.771103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T07:35:32.470059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T07:37:16.630101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T07:37:17.243357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"60ee9243-ae06-4e4e-8cde-64fcdc4a4651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6817","nonce":1768750950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6819","nonce":1768750950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6825","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6827","nonce":1768750950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6821","nonce":1768750950},{"type":"v1","addr":"172.21.15.144:6823","nonce":1768750950}]},"public_addr":"172.21.15.144:6817/1768750950","cluster_addr":"172.21.15.144:6819/1768750950","heartbeat_back_addr":"172.21.15.144:6827/1768750950","heartbeat_front_addr":"172.21.15.144:6823/1768750950","state":["exists","up"]},{"osd":1,"uuid":"1a6ccfee-d06b-4e0a-835b-2c1b5a20a890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6801","nonce":571896629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6803","nonce":571896629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6807","nonce":571896629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":571896629},{"type":"v1","addr":"172.21.15.144:6805","nonce":571896629}]},"public_addr":"172.21.15.144:6801/571896629","cluster_addr":"172.21.15.144:6803/571896629","heartbeat_back_addr":"172.21.15.144:6807/571896629","heartbeat_front_addr":"172.21.15.144:6805/571896629","state":["exists","up"]},{"osd":2,"uuid":"313743fd-9ef8-4880-a410-47b53adda1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6809","nonce":1362938709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6811","nonce":1362938709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6815","nonce":1362938709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1362938709},{"type":"v1","addr":"172.21.15.144:6813","nonce":1362938709}]},"public_addr":"172.21.15.144:6809/1362938709","cluster_addr":"172.21.15.144:6811/1362938709","heartbeat_back_addr":"172.21.15.144:6815/1362938709","heartbeat_front_addr":"172.21.15.144:6813/1362938709","state":["exists","up"]},{"osd":3,"uuid":"90651a93-f858-43bf-81ac-d50e100ac497","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6822","nonce":3116446647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6826","nonce":3116446647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6831","nonce":3116446647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":3116446647},{"type":"v1","addr":"172.21.15.144:6829","nonce":3116446647}]},"public_addr":"172.21.15.144:6822/3116446647","cluster_addr":"172.21.15.144:6826/3116446647","heartbeat_back_addr":"172.21.15.144:6831/3116446647","heartbeat_front_addr":"172.21.15.144:6829/3116446647","state":["exists","up"]},{"osd":4,"uuid":"f3ecad33-8ee1-4f6b-b97c-cf87fcbe7775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6801","nonce":2918131950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6803","nonce":2918131950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6807","nonce":2918131950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2918131950},{"type":"v1","addr":"172.21.15.145:6805","nonce":2918131950}]},"public_addr":"172.21.15.145:6801/2918131950","cluster_addr":"172.21.15.145:6803/2918131950","heartbeat_back_addr":"172.21.15.145:6807/2918131950","heartbeat_front_addr":"172.21.15.145:6805/2918131950","state":["exists","up"]},{"osd":5,"uuid":"f7d6ea3e-cf94-478b-bf85-ed6156acdf38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6817","nonce":1971378360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6819","nonce":1971378360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6823","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6825","nonce":1971378360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":1971378360},{"type":"v1","addr":"172.21.15.145:6821","nonce":1971378360}]},"public_addr":"172.21.15.145:6817/1971378360","cluster_addr":"172.21.15.145:6819/1971378360","heartbeat_back_addr":"172.21.15.145:6825/1971378360","heartbeat_front_addr":"172.21.15.145:6821/1971378360","state":["exists","up"]},{"osd":6,"uuid":"c7284965-f40c-490c-b741-ae0b59b1a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6809","nonce":344526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6811","nonce":344526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6815","nonce":344526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":344526761},{"type":"v1","addr":"172.21.15.145:6813","nonce":344526761}]},"public_addr":"172.21.15.145:6809/344526761","cluster_addr":"172.21.15.145:6811/344526761","heartbeat_back_addr":"172.21.15.145:6815/344526761","heartbeat_front_addr":"172.21.15.145:6813/344526761","state":["exists","up"]},{"osd":7,"uuid":"049753c2-dc12-439e-b556-92545c7e3da9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6824","nonce":3419647756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6827","nonce":3419647756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6831","nonce":3419647756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":3419647756},{"type":"v1","addr":"172.21.15.145:6829","nonce":3419647756}]},"public_addr":"172.21.15.145:6824/3419647756","cluster_addr":"172.21.15.145:6827/3419647756","heartbeat_back_addr":"172.21.15.145:6831/3419647756","heartbeat_front_addr":"172.21.15.145:6829/3419647756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.361768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.458510+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.575640+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.364791+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.256449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.592912+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.602307+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T07:35:21.381855+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T07:37:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.162+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 msgr2=0x7f4bb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.162+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 0x7f4bb406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0151a20 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2023-05-11T07:37:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.162+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 msgr2=0x7f4bd014d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.162+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc005040 tx=0x7f4bcc0014a0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 shutdown_connections 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4bb406ace0 0x7f4bb406d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4bd00b48f0 0x7f4bd006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bbc005c10 0x7f4bd014d590 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 --2- 172.21.15.144:0/1246034589 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f4bd00b4480 0x7f4bd006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 >> 172.21.15.144:0/1246034589 conn(0x7f4bd00cb7e0 msgr2=0x7f4bd0073830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 shutdown_connections 2023-05-11T07:37:22.168 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.163+0000 7f4bd81ff700 1 -- 172.21.15.144:0/1246034589 wait complete. 2023-05-11T07:37:22.183 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-11T07:37:22.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:37:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.366+0000 7f48475ff700 1 Processor -- start 2023-05-11T07:37:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.366+0000 7f48475ff700 1 -- start start 2023-05-11T07:37:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.367+0000 7f48475ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 0x7f4840071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.367+0000 7f48475ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f484006a2d0 0x7f484006a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.367+0000 7f48475ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4840071740 con 0x7f484006b7a0 2023-05-11T07:37:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.367+0000 7f48475ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484006cfe0 con 0x7f484006a2d0 2023-05-11T07:37:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.367+0000 7f48475ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484015ab20 con 0x7f484015a750 2023-05-11T07:37:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f484539b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 0x7f4840071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4844b9a700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f484006a2d0 0x7f484006a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4845b9c700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f484006b7a0 0x7f484006bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:39234/0 (socket says 172.21.15.144:39234) 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4845b9c700 1 -- 172.21.15.144:0/2423684805 learned_addr learned my addr 172.21.15.144:0/2423684805 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4844b9a700 1 -- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 msgr2=0x7f4840071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4844b9a700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 0x7f4840071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4844b9a700 1 -- 172.21.15.144:0/2423684805 >> v1:172.21.15.145:6789/0 conn(0x7f484006b7a0 legacy=0x7f484006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4844b9a700 1 -- 172.21.15.144:0/2423684805 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840071160 con 0x7f484006a2d0 2023-05-11T07:37:22.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f484539b700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 0x7f4840071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:22.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.368+0000 7f4837fff700 1 -- 172.21.15.144:0/2423684805 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322641245 0 0) 0x7f4840071740 con 0x7f484006b7a0 2023-05-11T07:37:22.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f4844b9a700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f484006a740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4830009840 tx=0x7f4830009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e392e1c1f1ff43a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f4837fff700 1 -- 172.21.15.144:0/2423684805 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830011830 con 0x7f484006a2d0 2023-05-11T07:37:22.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f4837fff700 1 -- 172.21.15.144:0/2423684805 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830011990 con 0x7f484006a2d0 2023-05-11T07:37:22.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f4837fff700 1 -- 172.21.15.144:0/2423684805 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830011d20 con 0x7f484006a2d0 2023-05-11T07:37:22.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 -- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 msgr2=0x7f484006a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.375 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f484006a740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4830009840 tx=0x7f4830009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:22.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 -- 172.21.15.144:0/2423684805 shutdown_connections 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484015a750 0x7f4840071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 --2- 172.21.15.144:0/2423684805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f484006a740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.369+0000 7f48475ff700 1 -- 172.21.15.144:0/2423684805 >> 172.21.15.144:0/2423684805 conn(0x7f48400cb7e0 msgr2=0x7f48400cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.370+0000 7f48475ff700 1 -- 172.21.15.144:0/2423684805 shutdown_connections 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.370+0000 7f48475ff700 1 -- 172.21.15.144:0/2423684805 wait complete. 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.371+0000 7f48475ff700 1 Processor -- start 2023-05-11T07:37:22.378 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.371+0000 7f48475ff700 1 -- start start 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f48401f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484006b7a0 0x7f4840153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400b4b00 con 0x7f484015a750 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401e2e20 con 0x7f484006a2d0 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.372+0000 7f48475ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484015b070 con 0x7f484006b7a0 2023-05-11T07:37:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41886/0 (socket says 172.21.15.144:41886) 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 -- 172.21.15.144:0/1437896510 learned_addr learned my addr 172.21.15.144:0/1437896510 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4844b9a700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484006b7a0 0x7f4840153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f484539b700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f48401f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 -- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484006b7a0 msgr2=0x7f4840153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484006b7a0 0x7f4840153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 -- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 msgr2=0x7f48401f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f48401f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 -- 172.21.15.144:0/1437896510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0094a0 con 0x7f484015a750 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.373+0000 7f4845b9c700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4838002230 tx=0x7f483800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.374+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800aac0 con 0x7f484015a750 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.374+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800ac40 con 0x7f484015a750 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.374+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380070d0 con 0x7f484015a750 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.374+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48300094a0 con 0x7f484015a750 2023-05-11T07:37:22.381 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.374+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48400713d0 con 0x7f484015a750 2023-05-11T07:37:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.375+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484006c420 con 0x7f484015a750 2023-05-11T07:37:22.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.376+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4838007250 con 0x7f484015a750 2023-05-11T07:37:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.376+0000 7f4835ffb700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.377+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4838089020 con 0x7f484015a750 2023-05-11T07:37:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.377+0000 7f484539b700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.377+0000 7f484539b700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 0x7f482406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f483c009cd0 tx=0x7f483c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.381+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4838053f90 con 0x7f484015a750 2023-05-11T07:37:22.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.569+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f484006c700 con 0x7f482406ace0 2023-05-11T07:37:22.582 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.578+0000 7f4835ffb700 1 -- 172.21.15.144:0/1437896510 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308278 (secure 0 0 0) 0x7f484006c700 con 0x7f482406ace0 2023-05-11T07:37:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.582+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 msgr2=0x7f482406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.582+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 0x7f482406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f483c009cd0 tx=0x7f483c009210 comp rx=0 tx=0).stop 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 msgr2=0x7f48401542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4838002230 tx=0x7f483800cf50 comp rx=0 tx=0).stop 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 shutdown_connections 2023-05-11T07:37:22.587 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f484015a750 0x7f48401542a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f484006a2d0 0x7f48401f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 --2- 172.21.15.144:0/1437896510 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f484006b7a0 0x7f4840153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 >> 172.21.15.144:0/1437896510 conn(0x7f48400cb7e0 msgr2=0x7f48400ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 shutdown_connections 2023-05-11T07:37:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.583+0000 7f48475ff700 1 -- 172.21.15.144:0/1437896510 wait complete. 2023-05-11T07:37:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:37:22.603 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-05-11T07:37:21.735896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71516,"kb_used_data":4956,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903204,"statfs":{"total":773094113280,"available":773020880896,"internally_reserved":0,"allocated":5074944,"data_stored":2891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.955814"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:18.291434+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:18.291148+0000","last_became_peered":"2023-05-11T07:37:18.291148+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:22.530712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992276+0000","last_change":"2023-05-11T07:37:18.301388+0000","last_active":"2023-05-11T07:37:19.992276+0000","last_peered":"2023-05-11T07:37:19.992276+0000","last_clean":"2023-05-11T07:37:19.992276+0000","last_became_active":"2023-05-11T07:37:18.301121+0000","last_became_peered":"2023-05-11T07:37:18.301121+0000","last_unstale":"2023-05-11T07:37:19.992276+0000","last_undegraded":"2023-05-11T07:37:19.992276+0000","last_fullsized":"2023-05-11T07:37:19.992276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:49:47.667555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282046+0000","last_change":"2023-05-11T07:37:18.292177+0000","last_active":"2023-05-11T07:37:19.282046+0000","last_peered":"2023-05-11T07:37:19.282046+0000","last_clean":"2023-05-11T07:37:19.282046+0000","last_became_active":"2023-05-11T07:37:18.291845+0000","last_became_peered":"2023-05-11T07:37:18.291845+0000","last_unstale":"2023-05-11T07:37:19.282046+0000","last_undegraded":"2023-05-11T07:37:19.282046+0000","last_fullsized":"2023-05-11T07:37:19.282046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:23.945011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991955+0000","last_change":"2023-05-11T07:37:18.301367+0000","last_active":"2023-05-11T07:37:19.991955+0000","last_peered":"2023-05-11T07:37:19.991955+0000","last_clean":"2023-05-11T07:37:19.991955+0000","last_became_active":"2023-05-11T07:37:18.301084+0000","last_became_peered":"2023-05-11T07:37:18.301084+0000","last_unstale":"2023-05-11T07:37:19.991955+0000","last_undegraded":"2023-05-11T07:37:19.991955+0000","last_fullsized":"2023-05-11T07:37:19.991955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985990+0000","last_change":"2023-05-11T07:37:18.294756+0000","last_active":"2023-05-11T07:37:19.985990+0000","last_peered":"2023-05-11T07:37:19.985990+0000","last_clean":"2023-05-11T07:37:19.985990+0000","last_became_active":"2023-05-11T07:37:18.294511+0000","last_became_peered":"2023-05-11T07:37:18.294511+0000","last_unstale":"2023-05-11T07:37:19.985990+0000","last_undegraded":"2023-05-11T07:37:19.985990+0000","last_fullsized":"2023-05-11T07:37:19.985990+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:05:29.224864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993012+0000","last_change":"2023-05-11T07:37:18.292016+0000","last_active":"2023-05-11T07:37:19.993012+0000","last_peered":"2023-05-11T07:37:19.993012+0000","last_clean":"2023-05-11T07:37:19.993012+0000","last_became_active":"2023-05-11T07:37:18.291768+0000","last_became_peered":"2023-05-11T07:37:18.291768+0000","last_unstale":"2023-05-11T07:37:19.993012+0000","last_undegraded":"2023-05-11T07:37:19.993012+0000","last_fullsized":"2023-05-11T07:37:19.993012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:42.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992369+0000","last_change":"2023-05-11T07:37:18.296188+0000","last_active":"2023-05-11T07:37:19.992369+0000","last_peered":"2023-05-11T07:37:19.992369+0000","last_clean":"2023-05-11T07:37:19.992369+0000","last_became_active":"2023-05-11T07:37:18.295883+0000","last_became_peered":"2023-05-11T07:37:18.295883+0000","last_unstale":"2023-05-11T07:37:19.992369+0000","last_undegraded":"2023-05-11T07:37:19.992369+0000","last_fullsized":"2023-05-11T07:37:19.992369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:11:59.401409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991859+0000","last_change":"2023-05-11T07:37:18.290472+0000","last_active":"2023-05-11T07:37:19.991859+0000","last_peered":"2023-05-11T07:37:19.991859+0000","last_clean":"2023-05-11T07:37:19.991859+0000","last_became_active":"2023-05-11T07:37:18.290200+0000","last_became_peered":"2023-05-11T07:37:18.290200+0000","last_unstale":"2023-05-11T07:37:19.991859+0000","last_undegraded":"2023-05-11T07:37:19.991859+0000","last_fullsized":"2023-05-11T07:37:19.991859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:04:09.879877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985989+0000","last_change":"2023-05-11T07:37:18.295459+0000","last_active":"2023-05-11T07:37:19.985989+0000","last_peered":"2023-05-11T07:37:19.985989+0000","last_clean":"2023-05-11T07:37:19.985989+0000","last_became_active":"2023-05-11T07:37:18.295061+0000","last_became_peered":"2023-05-11T07:37:18.295061+0000","last_unstale":"2023-05-11T07:37:19.985989+0000","last_undegraded":"2023-05-11T07:37:19.985989+0000","last_fullsized":"2023-05-11T07:37:19.985989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:34.937633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283239+0000","last_change":"2023-05-11T07:37:18.309208+0000","last_active":"2023-05-11T07:37:19.283239+0000","last_peered":"2023-05-11T07:37:19.283239+0000","last_clean":"2023-05-11T07:37:19.283239+0000","last_became_active":"2023-05-11T07:37:18.308913+0000","last_became_peered":"2023-05-11T07:37:18.308913+0000","last_unstale":"2023-05-11T07:37:19.283239+0000","last_undegraded":"2023-05-11T07:37:19.283239+0000","last_fullsized":"2023-05-11T07:37:19.283239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:00:43.186311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282224+0000","last_change":"2023-05-11T07:37:18.292799+0000","last_active":"2023-05-11T07:37:19.282224+0000","last_peered":"2023-05-11T07:37:19.282224+0000","last_clean":"2023-05-11T07:37:19.282224+0000","last_became_active":"2023-05-11T07:37:18.292476+0000","last_became_peered":"2023-05-11T07:37:18.292476+0000","last_unstale":"2023-05-11T07:37:19.282224+0000","last_undegraded":"2023-05-11T07:37:19.282224+0000","last_fullsized":"2023-05-11T07:37:19.282224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:22:36.881963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282065+0000","last_change":"2023-05-11T07:37:18.297272+0000","last_active":"2023-05-11T07:37:19.282065+0000","last_peered":"2023-05-11T07:37:19.282065+0000","last_clean":"2023-05-11T07:37:19.282065+0000","last_became_active":"2023-05-11T07:37:18.296933+0000","last_became_peered":"2023-05-11T07:37:18.296933+0000","last_unstale":"2023-05-11T07:37:19.282065+0000","last_undegraded":"2023-05-11T07:37:19.282065+0000","last_fullsized":"2023-05-11T07:37:19.282065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:01:15.986745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283687+0000","last_change":"2023-05-11T07:37:18.288933+0000","last_active":"2023-05-11T07:37:19.283687+0000","last_peered":"2023-05-11T07:37:19.283687+0000","last_clean":"2023-05-11T07:37:19.283687+0000","last_became_active":"2023-05-11T07:37:18.288605+0000","last_became_peered":"2023-05-11T07:37:18.288605+0000","last_unstale":"2023-05-11T07:37:19.283687+0000","last_undegraded":"2023-05-11T07:37:19.283687+0000","last_fullsized":"2023-05-11T07:37:19.283687+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:10:53.147958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992012+0000","last_change":"2023-05-11T07:37:18.304107+0000","last_active":"2023-05-11T07:37:19.992012+0000","last_peered":"2023-05-11T07:37:19.992012+0000","last_clean":"2023-05-11T07:37:19.992012+0000","last_became_active":"2023-05-11T07:37:18.303874+0000","last_became_peered":"2023-05-11T07:37:18.303874+0000","last_unstale":"2023-05-11T07:37:19.992012+0000","last_undegraded":"2023-05-11T07:37:19.992012+0000","last_fullsized":"2023-05-11T07:37:19.992012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:30.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986014+0000","last_change":"2023-05-11T07:37:18.296702+0000","last_active":"2023-05-11T07:37:19.986014+0000","last_peered":"2023-05-11T07:37:19.986014+0000","last_clean":"2023-05-11T07:37:19.986014+0000","last_became_active":"2023-05-11T07:37:18.296227+0000","last_became_peered":"2023-05-11T07:37:18.296227+0000","last_unstale":"2023-05-11T07:37:19.986014+0000","last_undegraded":"2023-05-11T07:37:19.986014+0000","last_fullsized":"2023-05-11T07:37:19.986014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:35:20.212233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283252+0000","last_change":"2023-05-11T07:37:18.287465+0000","last_active":"2023-05-11T07:37:19.283252+0000","last_peered":"2023-05-11T07:37:19.283252+0000","last_clean":"2023-05-11T07:37:19.283252+0000","last_became_active":"2023-05-11T07:37:18.286165+0000","last_became_peered":"2023-05-11T07:37:18.286165+0000","last_unstale":"2023-05-11T07:37:19.283252+0000","last_undegraded":"2023-05-11T07:37:19.283252+0000","last_fullsized":"2023-05-11T07:37:19.283252+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:45:47.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283293+0000","last_change":"2023-05-11T07:37:18.286561+0000","last_active":"2023-05-11T07:37:19.283293+0000","last_peered":"2023-05-11T07:37:19.283293+0000","last_clean":"2023-05-11T07:37:19.283293+0000","last_became_active":"2023-05-11T07:37:18.286216+0000","last_became_peered":"2023-05-11T07:37:18.286216+0000","last_unstale":"2023-05-11T07:37:19.283293+0000","last_undegraded":"2023-05-11T07:37:19.283293+0000","last_fullsized":"2023-05-11T07:37:19.283293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:27:51.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283989+0000","last_change":"2023-05-11T07:37:18.286834+0000","last_active":"2023-05-11T07:37:19.283989+0000","last_peered":"2023-05-11T07:37:19.283989+0000","last_clean":"2023-05-11T07:37:19.283989+0000","last_became_active":"2023-05-11T07:37:18.286568+0000","last_became_peered":"2023-05-11T07:37:18.286568+0000","last_unstale":"2023-05-11T07:37:19.283989+0000","last_undegraded":"2023-05-11T07:37:19.283989+0000","last_fullsized":"2023-05-11T07:37:19.283989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:46.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992099+0000","last_change":"2023-05-11T07:37:18.290513+0000","last_active":"2023-05-11T07:37:19.992099+0000","last_peered":"2023-05-11T07:37:19.992099+0000","last_clean":"2023-05-11T07:37:19.992099+0000","last_became_active":"2023-05-11T07:37:18.290222+0000","last_became_peered":"2023-05-11T07:37:18.290222+0000","last_unstale":"2023-05-11T07:37:19.992099+0000","last_undegraded":"2023-05-11T07:37:19.992099+0000","last_fullsized":"2023-05-11T07:37:19.992099+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:01.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282119+0000","last_change":"2023-05-11T07:37:18.289912+0000","last_active":"2023-05-11T07:37:19.282119+0000","last_peered":"2023-05-11T07:37:19.282119+0000","last_clean":"2023-05-11T07:37:19.282119+0000","last_became_active":"2023-05-11T07:37:18.289607+0000","last_became_peered":"2023-05-11T07:37:18.289607+0000","last_unstale":"2023-05-11T07:37:19.282119+0000","last_undegraded":"2023-05-11T07:37:19.282119+0000","last_fullsized":"2023-05-11T07:37:19.282119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:26:38.690549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992184+0000","last_change":"2023-05-11T07:37:18.296428+0000","last_active":"2023-05-11T07:37:19.992184+0000","last_peered":"2023-05-11T07:37:19.992184+0000","last_clean":"2023-05-11T07:37:19.992184+0000","last_became_active":"2023-05-11T07:37:18.296133+0000","last_became_peered":"2023-05-11T07:37:18.296133+0000","last_unstale":"2023-05-11T07:37:19.992184+0000","last_undegraded":"2023-05-11T07:37:19.992184+0000","last_fullsized":"2023-05-11T07:37:19.992184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:53:03.634364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283703+0000","last_change":"2023-05-11T07:37:18.286553+0000","last_active":"2023-05-11T07:37:19.283703+0000","last_peered":"2023-05-11T07:37:19.283703+0000","last_clean":"2023-05-11T07:37:19.283703+0000","last_became_active":"2023-05-11T07:37:18.286235+0000","last_became_peered":"2023-05-11T07:37:18.286235+0000","last_unstale":"2023-05-11T07:37:19.283703+0000","last_undegraded":"2023-05-11T07:37:19.283703+0000","last_fullsized":"2023-05-11T07:37:19.283703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:47:38.913921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281787+0000","last_change":"2023-05-11T07:37:18.291946+0000","last_active":"2023-05-11T07:37:19.281787+0000","last_peered":"2023-05-11T07:37:19.281787+0000","last_clean":"2023-05-11T07:37:19.281787+0000","last_became_active":"2023-05-11T07:37:18.291346+0000","last_became_peered":"2023-05-11T07:37:18.291346+0000","last_unstale":"2023-05-11T07:37:19.281787+0000","last_undegraded":"2023-05-11T07:37:19.281787+0000","last_fullsized":"2023-05-11T07:37:19.281787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:26:34.365278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985821+0000","last_change":"2023-05-11T07:37:18.298118+0000","last_active":"2023-05-11T07:37:19.985821+0000","last_peered":"2023-05-11T07:37:19.985821+0000","last_clean":"2023-05-11T07:37:19.985821+0000","last_became_active":"2023-05-11T07:37:18.297866+0000","last_became_peered":"2023-05-11T07:37:18.297866+0000","last_unstale":"2023-05-11T07:37:19.985821+0000","last_undegraded":"2023-05-11T07:37:19.985821+0000","last_fullsized":"2023-05-11T07:37:19.985821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991682+0000","last_change":"2023-05-11T07:37:18.291309+0000","last_active":"2023-05-11T07:37:19.991682+0000","last_peered":"2023-05-11T07:37:19.991682+0000","last_clean":"2023-05-11T07:37:19.991682+0000","last_became_active":"2023-05-11T07:37:18.290864+0000","last_became_peered":"2023-05-11T07:37:18.290864+0000","last_unstale":"2023-05-11T07:37:19.991682+0000","last_undegraded":"2023-05-11T07:37:19.991682+0000","last_fullsized":"2023-05-11T07:37:19.991682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:16.444730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993415+0000","last_change":"2023-05-11T07:37:18.292054+0000","last_active":"2023-05-11T07:37:19.993415+0000","last_peered":"2023-05-11T07:37:19.993415+0000","last_clean":"2023-05-11T07:37:19.993415+0000","last_became_active":"2023-05-11T07:37:18.291805+0000","last_became_peered":"2023-05-11T07:37:18.291805+0000","last_unstale":"2023-05-11T07:37:19.993415+0000","last_undegraded":"2023-05-11T07:37:19.993415+0000","last_fullsized":"2023-05-11T07:37:19.993415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:19.430601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986353+0000","last_change":"2023-05-11T07:37:17.813384+0000","last_active":"2023-05-11T07:37:19.986353+0000","last_peered":"2023-05-11T07:37:19.986353+0000","last_clean":"2023-05-11T07:37:19.986353+0000","last_became_active":"2023-05-11T07:37:17.813112+0000","last_became_peered":"2023-05-11T07:37:17.813112+0000","last_unstale":"2023-05-11T07:37:19.986353+0000","last_undegraded":"2023-05-11T07:37:19.986353+0000","last_fullsized":"2023-05-11T07:37:19.986353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283875+0000","last_change":"2023-05-11T07:37:18.294542+0000","last_active":"2023-05-11T07:37:19.283875+0000","last_peered":"2023-05-11T07:37:19.283875+0000","last_clean":"2023-05-11T07:37:19.283875+0000","last_became_active":"2023-05-11T07:37:18.294147+0000","last_became_peered":"2023-05-11T07:37:18.294147+0000","last_unstale":"2023-05-11T07:37:19.283875+0000","last_undegraded":"2023-05-11T07:37:19.283875+0000","last_fullsized":"2023-05-11T07:37:19.283875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:21:00.891302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282310+0000","last_change":"2023-05-11T07:37:17.803783+0000","last_active":"2023-05-11T07:37:19.282310+0000","last_peered":"2023-05-11T07:37:19.282310+0000","last_clean":"2023-05-11T07:37:19.282310+0000","last_became_active":"2023-05-11T07:37:17.803516+0000","last_became_peered":"2023-05-11T07:37:17.803516+0000","last_unstale":"2023-05-11T07:37:19.282310+0000","last_undegraded":"2023-05-11T07:37:19.282310+0000","last_fullsized":"2023-05-11T07:37:19.282310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:30:54.188343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992197+0000","last_change":"2023-05-11T07:37:18.292075+0000","last_active":"2023-05-11T07:37:19.992197+0000","last_peered":"2023-05-11T07:37:19.992197+0000","last_clean":"2023-05-11T07:37:19.992197+0000","last_became_active":"2023-05-11T07:37:18.291815+0000","last_became_peered":"2023-05-11T07:37:18.291815+0000","last_unstale":"2023-05-11T07:37:19.992197+0000","last_undegraded":"2023-05-11T07:37:19.992197+0000","last_fullsized":"2023-05-11T07:37:19.992197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:27.787504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993639+0000","last_change":"2023-05-11T07:37:17.803729+0000","last_active":"2023-05-11T07:37:19.993639+0000","last_peered":"2023-05-11T07:37:19.993639+0000","last_clean":"2023-05-11T07:37:19.993639+0000","last_became_active":"2023-05-11T07:37:17.803491+0000","last_became_peered":"2023-05-11T07:37:17.803491+0000","last_unstale":"2023-05-11T07:37:19.993639+0000","last_undegraded":"2023-05-11T07:37:19.993639+0000","last_fullsized":"2023-05-11T07:37:19.993639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:52.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993604+0000","last_change":"2023-05-11T07:37:18.289175+0000","last_active":"2023-05-11T07:37:19.993604+0000","last_peered":"2023-05-11T07:37:19.993604+0000","last_clean":"2023-05-11T07:37:19.993604+0000","last_became_active":"2023-05-11T07:37:18.287810+0000","last_became_peered":"2023-05-11T07:37:18.287810+0000","last_unstale":"2023-05-11T07:37:19.993604+0000","last_undegraded":"2023-05-11T07:37:19.993604+0000","last_fullsized":"2023-05-11T07:37:19.993604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:39.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:17.813722+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:17.813440+0000","last_became_peered":"2023-05-11T07:37:17.813440+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281890+0000","last_change":"2023-05-11T07:37:18.291751+0000","last_active":"2023-05-11T07:37:19.281890+0000","last_peered":"2023-05-11T07:37:19.281890+0000","last_clean":"2023-05-11T07:37:19.281890+0000","last_became_active":"2023-05-11T07:37:18.291049+0000","last_became_peered":"2023-05-11T07:37:18.291049+0000","last_unstale":"2023-05-11T07:37:19.281890+0000","last_undegraded":"2023-05-11T07:37:19.281890+0000","last_fullsized":"2023-05-11T07:37:19.281890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:24.836884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986327+0000","last_change":"2023-05-11T07:37:17.809016+0000","last_active":"2023-05-11T07:37:19.986327+0000","last_peered":"2023-05-11T07:37:19.986327+0000","last_clean":"2023-05-11T07:37:19.986327+0000","last_became_active":"2023-05-11T07:37:17.808761+0000","last_became_peered":"2023-05-11T07:37:17.808761+0000","last_unstale":"2023-05-11T07:37:19.986327+0000","last_undegraded":"2023-05-11T07:37:19.986327+0000","last_fullsized":"2023-05-11T07:37:19.986327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282053+0000","last_change":"2023-05-11T07:37:17.802629+0000","last_active":"2023-05-11T07:37:19.282053+0000","last_peered":"2023-05-11T07:37:19.282053+0000","last_clean":"2023-05-11T07:37:19.282053+0000","last_became_active":"2023-05-11T07:37:17.802309+0000","last_became_peered":"2023-05-11T07:37:17.802309+0000","last_unstale":"2023-05-11T07:37:19.282053+0000","last_undegraded":"2023-05-11T07:37:19.282053+0000","last_fullsized":"2023-05-11T07:37:19.282053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:37.107122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991960+0000","last_change":"2023-05-11T07:37:17.806893+0000","last_active":"2023-05-11T07:37:19.991960+0000","last_peered":"2023-05-11T07:37:19.991960+0000","last_clean":"2023-05-11T07:37:19.991960+0000","last_became_active":"2023-05-11T07:37:17.806550+0000","last_became_peered":"2023-05-11T07:37:17.806550+0000","last_unstale":"2023-05-11T07:37:19.991960+0000","last_undegraded":"2023-05-11T07:37:19.991960+0000","last_fullsized":"2023-05-11T07:37:19.991960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:21.524193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283429+0000","last_change":"2023-05-11T07:37:18.285399+0000","last_active":"2023-05-11T07:37:19.283429+0000","last_peered":"2023-05-11T07:37:19.283429+0000","last_clean":"2023-05-11T07:37:19.283429+0000","last_became_active":"2023-05-11T07:37:18.284955+0000","last_became_peered":"2023-05-11T07:37:18.284955+0000","last_unstale":"2023-05-11T07:37:19.283429+0000","last_undegraded":"2023-05-11T07:37:19.283429+0000","last_fullsized":"2023-05-11T07:37:19.283429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:24:56.109130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790686+0000","last_change":"2023-05-11T07:37:16.790686+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790686+0000","last_undegraded":"2023-05-11T07:37:16.790686+0000","last_fullsized":"2023-05-11T07:37:16.790686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282230+0000","last_change":"2023-05-11T07:37:18.296389+0000","last_active":"2023-05-11T07:37:19.282230+0000","last_peered":"2023-05-11T07:37:19.282230+0000","last_clean":"2023-05-11T07:37:19.282230+0000","last_became_active":"2023-05-11T07:37:18.296111+0000","last_became_peered":"2023-05-11T07:37:18.296111+0000","last_unstale":"2023-05-11T07:37:19.282230+0000","last_undegraded":"2023-05-11T07:37:19.282230+0000","last_fullsized":"2023-05-11T07:37:19.282230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:27:41.360370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282315+0000","last_change":"2023-05-11T07:37:17.801337+0000","last_active":"2023-05-11T07:37:19.282315+0000","last_peered":"2023-05-11T07:37:19.282315+0000","last_clean":"2023-05-11T07:37:19.282315+0000","last_became_active":"2023-05-11T07:37:17.800991+0000","last_became_peered":"2023-05-11T07:37:17.800991+0000","last_unstale":"2023-05-11T07:37:19.282315+0000","last_undegraded":"2023-05-11T07:37:19.282315+0000","last_fullsized":"2023-05-11T07:37:19.282315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:46.905451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993466+0000","last_change":"2023-05-11T07:37:18.295004+0000","last_active":"2023-05-11T07:37:19.993466+0000","last_peered":"2023-05-11T07:37:19.993466+0000","last_clean":"2023-05-11T07:37:19.993466+0000","last_became_active":"2023-05-11T07:37:18.294741+0000","last_became_peered":"2023-05-11T07:37:18.294741+0000","last_unstale":"2023-05-11T07:37:19.993466+0000","last_undegraded":"2023-05-11T07:37:19.993466+0000","last_fullsized":"2023-05-11T07:37:19.993466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:54.412110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790337+0000","last_change":"2023-05-11T07:37:16.790337+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790337+0000","last_undegraded":"2023-05-11T07:37:16.790337+0000","last_fullsized":"2023-05-11T07:37:16.790337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986228+0000","last_change":"2023-05-11T07:37:18.293624+0000","last_active":"2023-05-11T07:37:19.986228+0000","last_peered":"2023-05-11T07:37:19.986228+0000","last_clean":"2023-05-11T07:37:19.986228+0000","last_became_active":"2023-05-11T07:37:18.293346+0000","last_became_peered":"2023-05-11T07:37:18.293346+0000","last_unstale":"2023-05-11T07:37:19.986228+0000","last_undegraded":"2023-05-11T07:37:19.986228+0000","last_fullsized":"2023-05-11T07:37:19.986228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993508+0000","last_change":"2023-05-11T07:37:17.813482+0000","last_active":"2023-05-11T07:37:19.993508+0000","last_peered":"2023-05-11T07:37:19.993508+0000","last_clean":"2023-05-11T07:37:19.993508+0000","last_became_active":"2023-05-11T07:37:17.813163+0000","last_became_peered":"2023-05-11T07:37:17.813163+0000","last_unstale":"2023-05-11T07:37:19.993508+0000","last_undegraded":"2023-05-11T07:37:19.993508+0000","last_fullsized":"2023-05-11T07:37:19.993508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:16:44.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993281+0000","last_change":"2023-05-11T07:37:18.290528+0000","last_active":"2023-05-11T07:37:19.993281+0000","last_peered":"2023-05-11T07:37:19.993281+0000","last_clean":"2023-05-11T07:37:19.993281+0000","last_became_active":"2023-05-11T07:37:18.290251+0000","last_became_peered":"2023-05-11T07:37:18.290251+0000","last_unstale":"2023-05-11T07:37:19.993281+0000","last_undegraded":"2023-05-11T07:37:19.993281+0000","last_fullsized":"2023-05-11T07:37:19.993281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992148+0000","last_change":"2023-05-11T07:37:17.804935+0000","last_active":"2023-05-11T07:37:19.992148+0000","last_peered":"2023-05-11T07:37:19.992148+0000","last_clean":"2023-05-11T07:37:19.992148+0000","last_became_active":"2023-05-11T07:37:17.804595+0000","last_became_peered":"2023-05-11T07:37:17.804595+0000","last_unstale":"2023-05-11T07:37:19.992148+0000","last_undegraded":"2023-05-11T07:37:19.992148+0000","last_fullsized":"2023-05-11T07:37:19.992148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:23:20.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283296+0000","last_change":"2023-05-11T07:37:18.302703+0000","last_active":"2023-05-11T07:37:19.283296+0000","last_peered":"2023-05-11T07:37:19.283296+0000","last_clean":"2023-05-11T07:37:19.283296+0000","last_became_active":"2023-05-11T07:37:18.302276+0000","last_became_peered":"2023-05-11T07:37:18.302276+0000","last_unstale":"2023-05-11T07:37:19.283296+0000","last_undegraded":"2023-05-11T07:37:19.283296+0000","last_fullsized":"2023-05-11T07:37:19.283296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:53:03.341271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986180+0000","last_change":"2023-05-11T07:37:17.805056+0000","last_active":"2023-05-11T07:37:19.986180+0000","last_peered":"2023-05-11T07:37:19.986180+0000","last_clean":"2023-05-11T07:37:19.986180+0000","last_became_active":"2023-05-11T07:37:17.804788+0000","last_became_peered":"2023-05-11T07:37:17.804788+0000","last_unstale":"2023-05-11T07:37:19.986180+0000","last_undegraded":"2023-05-11T07:37:19.986180+0000","last_fullsized":"2023-05-11T07:37:19.986180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:55.002267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993056+0000","last_change":"2023-05-11T07:37:17.809230+0000","last_active":"2023-05-11T07:37:19.993056+0000","last_peered":"2023-05-11T07:37:19.993056+0000","last_clean":"2023-05-11T07:37:19.993056+0000","last_became_active":"2023-05-11T07:37:17.808956+0000","last_became_peered":"2023-05-11T07:37:17.808956+0000","last_unstale":"2023-05-11T07:37:19.993056+0000","last_undegraded":"2023-05-11T07:37:19.993056+0000","last_fullsized":"2023-05-11T07:37:19.993056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985829+0000","last_change":"2023-05-11T07:37:18.293684+0000","last_active":"2023-05-11T07:37:19.985829+0000","last_peered":"2023-05-11T07:37:19.985829+0000","last_clean":"2023-05-11T07:37:19.985829+0000","last_became_active":"2023-05-11T07:37:18.293412+0000","last_became_peered":"2023-05-11T07:37:18.293412+0000","last_unstale":"2023-05-11T07:37:19.985829+0000","last_undegraded":"2023-05-11T07:37:19.985829+0000","last_fullsized":"2023-05-11T07:37:19.985829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985944+0000","last_change":"2023-05-11T07:37:17.804908+0000","last_active":"2023-05-11T07:37:19.985944+0000","last_peered":"2023-05-11T07:37:19.985944+0000","last_clean":"2023-05-11T07:37:19.985944+0000","last_became_active":"2023-05-11T07:37:17.804649+0000","last_became_peered":"2023-05-11T07:37:17.804649+0000","last_unstale":"2023-05-11T07:37:19.985944+0000","last_undegraded":"2023-05-11T07:37:19.985944+0000","last_fullsized":"2023-05-11T07:37:19.985944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992957+0000","last_change":"2023-05-11T07:37:18.286709+0000","last_active":"2023-05-11T07:37:19.992957+0000","last_peered":"2023-05-11T07:37:19.992957+0000","last_clean":"2023-05-11T07:37:19.992957+0000","last_became_active":"2023-05-11T07:37:18.286345+0000","last_became_peered":"2023-05-11T07:37:18.286345+0000","last_unstale":"2023-05-11T07:37:19.992957+0000","last_undegraded":"2023-05-11T07:37:19.992957+0000","last_fullsized":"2023-05-11T07:37:19.992957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790303+0000","last_change":"2023-05-11T07:37:16.790303+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790303+0000","last_undegraded":"2023-05-11T07:37:16.790303+0000","last_fullsized":"2023-05-11T07:37:16.790303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991825+0000","last_change":"2023-05-11T07:37:18.294767+0000","last_active":"2023-05-11T07:37:19.991825+0000","last_peered":"2023-05-11T07:37:19.991825+0000","last_clean":"2023-05-11T07:37:19.991825+0000","last_became_active":"2023-05-11T07:37:18.294516+0000","last_became_peered":"2023-05-11T07:37:18.294516+0000","last_unstale":"2023-05-11T07:37:19.991825+0000","last_undegraded":"2023-05-11T07:37:19.991825+0000","last_fullsized":"2023-05-11T07:37:19.991825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:30:18.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991981+0000","last_change":"2023-05-11T07:37:17.802776+0000","last_active":"2023-05-11T07:37:19.991981+0000","last_peered":"2023-05-11T07:37:19.991981+0000","last_clean":"2023-05-11T07:37:19.991981+0000","last_became_active":"2023-05-11T07:37:17.802533+0000","last_became_peered":"2023-05-11T07:37:17.802533+0000","last_unstale":"2023-05-11T07:37:19.991981+0000","last_undegraded":"2023-05-11T07:37:19.991981+0000","last_fullsized":"2023-05-11T07:37:19.991981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:49:16.959783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282198+0000","last_change":"2023-05-11T07:37:17.801549+0000","last_active":"2023-05-11T07:37:19.282198+0000","last_peered":"2023-05-11T07:37:19.282198+0000","last_clean":"2023-05-11T07:37:19.282198+0000","last_became_active":"2023-05-11T07:37:17.801223+0000","last_became_peered":"2023-05-11T07:37:17.801223+0000","last_unstale":"2023-05-11T07:37:19.282198+0000","last_undegraded":"2023-05-11T07:37:19.282198+0000","last_fullsized":"2023-05-11T07:37:19.282198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:45.174857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283835+0000","last_change":"2023-05-11T07:37:18.289641+0000","last_active":"2023-05-11T07:37:19.283835+0000","last_peered":"2023-05-11T07:37:19.283835+0000","last_clean":"2023-05-11T07:37:19.283835+0000","last_became_active":"2023-05-11T07:37:18.289266+0000","last_became_peered":"2023-05-11T07:37:18.289266+0000","last_unstale":"2023-05-11T07:37:19.283835+0000","last_undegraded":"2023-05-11T07:37:19.283835+0000","last_fullsized":"2023-05-11T07:37:19.283835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:07:10.450228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992371+0000","last_change":"2023-05-11T07:37:17.806924+0000","last_active":"2023-05-11T07:37:19.992371+0000","last_peered":"2023-05-11T07:37:19.992371+0000","last_clean":"2023-05-11T07:37:19.992371+0000","last_became_active":"2023-05-11T07:37:17.806632+0000","last_became_peered":"2023-05-11T07:37:17.806632+0000","last_unstale":"2023-05-11T07:37:19.992371+0000","last_undegraded":"2023-05-11T07:37:19.992371+0000","last_fullsized":"2023-05-11T07:37:19.992371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:15.881529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283860+0000","last_change":"2023-05-11T07:37:18.287300+0000","last_active":"2023-05-11T07:37:19.283860+0000","last_peered":"2023-05-11T07:37:19.283860+0000","last_clean":"2023-05-11T07:37:19.283860+0000","last_became_active":"2023-05-11T07:37:18.286982+0000","last_became_peered":"2023-05-11T07:37:18.286982+0000","last_unstale":"2023-05-11T07:37:19.283860+0000","last_undegraded":"2023-05-11T07:37:19.283860+0000","last_fullsized":"2023-05-11T07:37:19.283860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:08:12.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986279+0000","last_change":"2023-05-11T07:37:17.811963+0000","last_active":"2023-05-11T07:37:19.986279+0000","last_peered":"2023-05-11T07:37:19.986279+0000","last_clean":"2023-05-11T07:37:19.986279+0000","last_became_active":"2023-05-11T07:37:17.811718+0000","last_became_peered":"2023-05-11T07:37:17.811718+0000","last_unstale":"2023-05-11T07:37:19.986279+0000","last_undegraded":"2023-05-11T07:37:19.986279+0000","last_fullsized":"2023-05-11T07:37:19.986279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:58:39.409698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986060+0000","last_change":"2023-05-11T07:37:18.294227+0000","last_active":"2023-05-11T07:37:19.986060+0000","last_peered":"2023-05-11T07:37:19.986060+0000","last_clean":"2023-05-11T07:37:19.986060+0000","last_became_active":"2023-05-11T07:37:18.293962+0000","last_became_peered":"2023-05-11T07:37:18.293962+0000","last_unstale":"2023-05-11T07:37:19.986060+0000","last_undegraded":"2023-05-11T07:37:19.986060+0000","last_fullsized":"2023-05-11T07:37:19.986060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:31:48.833972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986258+0000","last_change":"2023-05-11T07:37:17.809327+0000","last_active":"2023-05-11T07:37:19.986258+0000","last_peered":"2023-05-11T07:37:19.986258+0000","last_clean":"2023-05-11T07:37:19.986258+0000","last_became_active":"2023-05-11T07:37:17.808953+0000","last_became_peered":"2023-05-11T07:37:17.808953+0000","last_unstale":"2023-05-11T07:37:19.986258+0000","last_undegraded":"2023-05-11T07:37:19.986258+0000","last_fullsized":"2023-05-11T07:37:19.986258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:41.118642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993416+0000","last_change":"2023-05-11T07:37:18.293169+0000","last_active":"2023-05-11T07:37:19.993416+0000","last_peered":"2023-05-11T07:37:19.993416+0000","last_clean":"2023-05-11T07:37:19.993416+0000","last_became_active":"2023-05-11T07:37:18.292862+0000","last_became_peered":"2023-05-11T07:37:18.292862+0000","last_unstale":"2023-05-11T07:37:19.993416+0000","last_undegraded":"2023-05-11T07:37:19.993416+0000","last_fullsized":"2023-05-11T07:37:19.993416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:21.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991908+0000","last_change":"2023-05-11T07:37:17.808473+0000","last_active":"2023-05-11T07:37:19.991908+0000","last_peered":"2023-05-11T07:37:19.991908+0000","last_clean":"2023-05-11T07:37:19.991908+0000","last_became_active":"2023-05-11T07:37:17.808069+0000","last_became_peered":"2023-05-11T07:37:17.808069+0000","last_unstale":"2023-05-11T07:37:19.991908+0000","last_undegraded":"2023-05-11T07:37:19.991908+0000","last_fullsized":"2023-05-11T07:37:19.991908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991589+0000","last_change":"2023-05-11T07:37:18.289485+0000","last_active":"2023-05-11T07:37:19.991589+0000","last_peered":"2023-05-11T07:37:19.991589+0000","last_clean":"2023-05-11T07:37:19.991589+0000","last_became_active":"2023-05-11T07:37:18.289211+0000","last_became_peered":"2023-05-11T07:37:18.289211+0000","last_unstale":"2023-05-11T07:37:19.991589+0000","last_undegraded":"2023-05-11T07:37:19.991589+0000","last_fullsized":"2023-05-11T07:37:19.991589+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:00:01.334038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.789788+0000","last_change":"2023-05-11T07:37:16.789788+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.789788+0000","last_undegraded":"2023-05-11T07:37:16.789788+0000","last_fullsized":"2023-05-11T07:37:16.789788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992759+0000","last_change":"2023-05-11T07:37:17.809276+0000","last_active":"2023-05-11T07:37:19.992759+0000","last_peered":"2023-05-11T07:37:19.992759+0000","last_clean":"2023-05-11T07:37:19.992759+0000","last_became_active":"2023-05-11T07:37:17.809035+0000","last_became_peered":"2023-05-11T07:37:17.809035+0000","last_unstale":"2023-05-11T07:37:19.992759+0000","last_undegraded":"2023-05-11T07:37:19.992759+0000","last_fullsized":"2023-05-11T07:37:19.992759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:20.856372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281811+0000","last_change":"2023-05-11T07:37:18.292506+0000","last_active":"2023-05-11T07:37:19.281811+0000","last_peered":"2023-05-11T07:37:19.281811+0000","last_clean":"2023-05-11T07:37:19.281811+0000","last_became_active":"2023-05-11T07:37:18.292151+0000","last_became_peered":"2023-05-11T07:37:18.292151+0000","last_unstale":"2023-05-11T07:37:19.281811+0000","last_undegraded":"2023-05-11T07:37:19.281811+0000","last_fullsized":"2023-05-11T07:37:19.281811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:57:57.495757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790037+0000","last_change":"2023-05-11T07:37:16.790037+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790037+0000","last_undegraded":"2023-05-11T07:37:16.790037+0000","last_fullsized":"2023-05-11T07:37:16.790037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993411+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:37:19.993411+0000","last_peered":"2023-05-11T07:37:19.993411+0000","last_clean":"2023-05-11T07:37:19.993411+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:37:19.993411+0000","last_undegraded":"2023-05-11T07:37:19.993411+0000","last_fullsized":"2023-05-11T07:37:19.993411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:54.361555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283895+0000","last_change":"2023-05-11T07:37:18.302712+0000","last_active":"2023-05-11T07:37:19.283895+0000","last_peered":"2023-05-11T07:37:19.283895+0000","last_clean":"2023-05-11T07:37:19.283895+0000","last_became_active":"2023-05-11T07:37:18.302367+0000","last_became_peered":"2023-05-11T07:37:18.302367+0000","last_unstale":"2023-05-11T07:37:19.283895+0000","last_undegraded":"2023-05-11T07:37:19.283895+0000","last_fullsized":"2023-05-11T07:37:19.283895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:23.623043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.988486+0000","last_change":"2023-05-11T07:37:17.806226+0000","last_active":"2023-05-11T07:37:19.988486+0000","last_peered":"2023-05-11T07:37:19.988486+0000","last_clean":"2023-05-11T07:37:19.988486+0000","last_became_active":"2023-05-11T07:37:17.805937+0000","last_became_peered":"2023-05-11T07:37:17.805937+0000","last_unstale":"2023-05-11T07:37:19.988486+0000","last_undegraded":"2023-05-11T07:37:19.988486+0000","last_fullsized":"2023-05-11T07:37:19.988486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991966+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:37:19.991966+0000","last_peered":"2023-05-11T07:37:19.991966+0000","last_clean":"2023-05-11T07:37:19.991966+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:37:19.991966+0000","last_undegraded":"2023-05-11T07:37:19.991966+0000","last_fullsized":"2023-05-11T07:37:19.991966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:00.155128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993579+0000","last_change":"2023-05-11T07:37:17.812286+0000","last_active":"2023-05-11T07:37:19.993579+0000","last_peered":"2023-05-11T07:37:19.993579+0000","last_clean":"2023-05-11T07:37:19.993579+0000","last_became_active":"2023-05-11T07:37:17.811876+0000","last_became_peered":"2023-05-11T07:37:17.811876+0000","last_unstale":"2023-05-11T07:37:19.993579+0000","last_undegraded":"2023-05-11T07:37:19.993579+0000","last_fullsized":"2023-05-11T07:37:19.993579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:26.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991425+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:37:19.991425+0000","last_peered":"2023-05-11T07:37:19.991425+0000","last_clean":"2023-05-11T07:37:19.991425+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:37:19.991425+0000","last_undegraded":"2023-05-11T07:37:19.991425+0000","last_fullsized":"2023-05-11T07:37:19.991425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:52:30.578344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992392+0000","last_change":"2023-05-11T07:37:17.804167+0000","last_active":"2023-05-11T07:37:19.992392+0000","last_peered":"2023-05-11T07:37:19.992392+0000","last_clean":"2023-05-11T07:37:19.992392+0000","last_became_active":"2023-05-11T07:37:17.803797+0000","last_became_peered":"2023-05-11T07:37:17.803797+0000","last_unstale":"2023-05-11T07:37:19.992392+0000","last_undegraded":"2023-05-11T07:37:19.992392+0000","last_fullsized":"2023-05-11T07:37:19.992392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:27.503714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991965+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:37:19.991965+0000","last_peered":"2023-05-11T07:37:19.991965+0000","last_clean":"2023-05-11T07:37:19.991965+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:37:19.991965+0000","last_undegraded":"2023-05-11T07:37:19.991965+0000","last_fullsized":"2023-05-11T07:37:19.991965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:38:09.432242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992843+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:37:19.992843+0000","last_peered":"2023-05-11T07:37:19.992843+0000","last_clean":"2023-05-11T07:37:19.992843+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:37:19.992843+0000","last_undegraded":"2023-05-11T07:37:19.992843+0000","last_fullsized":"2023-05-11T07:37:19.992843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:04.224988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993367+0000","last_change":"2023-05-11T07:37:18.294585+0000","last_active":"2023-05-11T07:37:19.993367+0000","last_peered":"2023-05-11T07:37:19.993367+0000","last_clean":"2023-05-11T07:37:19.993367+0000","last_became_active":"2023-05-11T07:37:18.294299+0000","last_became_peered":"2023-05-11T07:37:18.294299+0000","last_unstale":"2023-05-11T07:37:19.993367+0000","last_undegraded":"2023-05-11T07:37:19.993367+0000","last_fullsized":"2023-05-11T07:37:19.993367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993477+0000","last_change":"2023-05-11T07:37:17.800828+0000","last_active":"2023-05-11T07:37:19.993477+0000","last_peered":"2023-05-11T07:37:19.993477+0000","last_clean":"2023-05-11T07:37:19.993477+0000","last_became_active":"2023-05-11T07:37:17.800524+0000","last_became_peered":"2023-05-11T07:37:17.800524+0000","last_unstale":"2023-05-11T07:37:19.993477+0000","last_undegraded":"2023-05-11T07:37:19.993477+0000","last_fullsized":"2023-05-11T07:37:19.993477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:35.326768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992929+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:37:19.992929+0000","last_peered":"2023-05-11T07:37:19.992929+0000","last_clean":"2023-05-11T07:37:19.992929+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:37:19.992929+0000","last_undegraded":"2023-05-11T07:37:19.992929+0000","last_fullsized":"2023-05-11T07:37:19.992929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:56:55.436349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991922+0000","last_change":"2023-05-11T07:37:18.290604+0000","last_active":"2023-05-11T07:37:19.991922+0000","last_peered":"2023-05-11T07:37:19.991922+0000","last_clean":"2023-05-11T07:37:19.991922+0000","last_became_active":"2023-05-11T07:37:18.290265+0000","last_became_peered":"2023-05-11T07:37:18.290265+0000","last_unstale":"2023-05-11T07:37:19.991922+0000","last_undegraded":"2023-05-11T07:37:19.991922+0000","last_fullsized":"2023-05-11T07:37:19.991922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993255+0000","last_change":"2023-05-11T07:37:17.803117+0000","last_active":"2023-05-11T07:37:19.993255+0000","last_peered":"2023-05-11T07:37:19.993255+0000","last_clean":"2023-05-11T07:37:19.993255+0000","last_became_active":"2023-05-11T07:37:17.802884+0000","last_became_peered":"2023-05-11T07:37:17.802884+0000","last_unstale":"2023-05-11T07:37:19.993255+0000","last_undegraded":"2023-05-11T07:37:19.993255+0000","last_fullsized":"2023-05-11T07:37:19.993255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:30.669761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993568+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:37:19.993568+0000","last_peered":"2023-05-11T07:37:19.993568+0000","last_clean":"2023-05-11T07:37:19.993568+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:37:19.993568+0000","last_undegraded":"2023-05-11T07:37:19.993568+0000","last_fullsized":"2023-05-11T07:37:19.993568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:18.654496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986054+0000","last_change":"2023-05-11T07:37:18.296544+0000","last_active":"2023-05-11T07:37:19.986054+0000","last_peered":"2023-05-11T07:37:19.986054+0000","last_clean":"2023-05-11T07:37:19.986054+0000","last_became_active":"2023-05-11T07:37:18.295758+0000","last_became_peered":"2023-05-11T07:37:18.295758+0000","last_unstale":"2023-05-11T07:37:19.986054+0000","last_undegraded":"2023-05-11T07:37:19.986054+0000","last_fullsized":"2023-05-11T07:37:19.986054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:34:51.857400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281928+0000","last_change":"2023-05-11T07:37:17.805120+0000","last_active":"2023-05-11T07:37:19.281928+0000","last_peered":"2023-05-11T07:37:19.281928+0000","last_clean":"2023-05-11T07:37:19.281928+0000","last_became_active":"2023-05-11T07:37:17.804834+0000","last_became_peered":"2023-05-11T07:37:17.804834+0000","last_unstale":"2023-05-11T07:37:19.281928+0000","last_undegraded":"2023-05-11T07:37:19.281928+0000","last_fullsized":"2023-05-11T07:37:19.281928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:10:26.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993536+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:37:19.993536+0000","last_peered":"2023-05-11T07:37:19.993536+0000","last_clean":"2023-05-11T07:37:19.993536+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:37:19.993536+0000","last_undegraded":"2023-05-11T07:37:19.993536+0000","last_fullsized":"2023-05-11T07:37:19.993536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:21:18.916469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986122+0000","last_change":"2023-05-11T07:37:18.292755+0000","last_active":"2023-05-11T07:37:19.986122+0000","last_peered":"2023-05-11T07:37:19.986122+0000","last_clean":"2023-05-11T07:37:19.986122+0000","last_became_active":"2023-05-11T07:37:18.292496+0000","last_became_peered":"2023-05-11T07:37:18.292496+0000","last_unstale":"2023-05-11T07:37:19.986122+0000","last_undegraded":"2023-05-11T07:37:19.986122+0000","last_fullsized":"2023-05-11T07:37:19.986122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:21.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993267+0000","last_change":"2023-05-11T07:37:17.813490+0000","last_active":"2023-05-11T07:37:19.993267+0000","last_peered":"2023-05-11T07:37:19.993267+0000","last_clean":"2023-05-11T07:37:19.993267+0000","last_became_active":"2023-05-11T07:37:17.813185+0000","last_became_peered":"2023-05-11T07:37:17.813185+0000","last_unstale":"2023-05-11T07:37:19.993267+0000","last_undegraded":"2023-05-11T07:37:19.993267+0000","last_fullsized":"2023-05-11T07:37:19.993267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.284047+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:37:19.284047+0000","last_peered":"2023-05-11T07:37:19.284047+0000","last_clean":"2023-05-11T07:37:19.284047+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:37:19.284047+0000","last_undegraded":"2023-05-11T07:37:19.284047+0000","last_fullsized":"2023-05-11T07:37:19.284047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:22.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362248,"statfs":{"total":96636764160,"available":96626941952,"internally_reserved":0,"allocated":1032192,"data_stored":781005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.736000000000001,"5min":17.736000000000001,"15min":17.736000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":18.178000000000001,"5min":18.178000000000001,"15min":18.178000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":17.706,"5min":17.706,"15min":17.706},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":18.143999999999998,"5min":18.143999999999998,"15min":18.143999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.765000000000001,"5min":17.765000000000001,"15min":17.765000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":17.917999999999999,"5min":17.917999999999999,"15min":17.917999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":17.602,"5min":17.602,"15min":17.602},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":17.992999999999999,"5min":17.992999999999999,"15min":17.992999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":17.558,"5min":17.558,"15min":17.558},"last":0.628}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":17.960999999999999,"5min":17.960999999999999,"15min":17.960999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":14.349,"5min":14.349,"15min":14.349},"last":0.72499999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.745}]},{"osd":5,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":491520,"data_stored":213101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.313}]},{"osd":1,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.439},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.497}]},{"osd":6,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8668,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363172,"statfs":{"total":96636764160,"available":96627888128,"internally_reserved":0,"allocated":479232,"data_stored":211585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.436},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":12.396000000000001,"5min":12.396000000000001,"15min":12.396000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":12.429,"5min":12.429,"15min":12.429},"last":0.504}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.752},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.919,"5min":11.919,"15min":11.919},"last":0.627},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":12.329000000000001,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":12.051,"5min":12.051,"15min":12.051},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":12.287000000000001,"5min":12.287000000000001,"15min":12.287000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":12.016999999999999,"5min":12.016999999999999,"15min":12.016999999999999},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":0.44}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.623},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.746}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":495616,"data_stored":219160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.432},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:37:22.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:37:22.827 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.824+0000 7f09f65ff700 1 Processor -- start 2023-05-11T07:37:22.828 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.824+0000 7f09f65ff700 1 -- start start 2023-05-11T07:37:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f09f015a750 0x7f09f0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09f006a2d0 0x7f09f006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f006cfe0 con 0x7f09f006a2d0 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f015ab20 con 0x7f09f015a750 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006ac90 con 0x7f09f006b7a0 2023-05-11T07:37:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09ef7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09f006a2d0 0x7f09f006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09ef7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09f006a2d0 0x7f09f006a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41900/0 (socket says 172.21.15.144:41900) 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09ef7fe700 1 -- 172.21.15.144:0/2758503717 learned_addr learned my addr 172.21.15.144:0/2758503717 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09f4b9c700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.825+0000 7f09effff700 1 --2- 172.21.15.144:0/2758503717 >> v2:172.21.15.145:3300/0 conn(0x7f09f015a750 0x7f09f0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 -- 172.21.15.144:0/2758503717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 msgr2=0x7f09f006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:22.831 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 -- 172.21.15.144:0/2758503717 >> v2:172.21.15.145:3300/0 conn(0x7f09f015a750 msgr2=0x7f09f0071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 --2- 172.21.15.144:0/2758503717 >> v2:172.21.15.145:3300/0 conn(0x7f09f015a750 0x7f09f0071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 -- 172.21.15.144:0/2758503717 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0071740 con 0x7f09f006a2d0 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09ef7fe700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f006a2d0 0x7f09f006a750 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f09f00cc8e0 tx=0x7f09e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bc6ed0c92f629a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09eeffd700 1 -- 172.21.15.144:0/2758503717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011830 con 0x7f09f006a2d0 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09eeffd700 1 -- 172.21.15.144:0/2758503717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4011990 con 0x7f09f006a2d0 2023-05-11T07:37:22.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.826+0000 7f09eeffd700 1 -- 172.21.15.144:0/2758503717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011d20 con 0x7f09f006a2d0 2023-05-11T07:37:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 -- 172.21.15.144:0/2758503717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f006a2d0 msgr2=0x7f09f006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f006a2d0 0x7f09f006a750 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f09f00cc8e0 tx=0x7f09e4009bd0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 -- 172.21.15.144:0/2758503717 shutdown_connections 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 --2- 172.21.15.144:0/2758503717 >> v2:172.21.15.145:3300/0 conn(0x7f09f015a750 0x7f09f0071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 --2- 172.21.15.144:0/2758503717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f006a2d0 0x7f09f006a750 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 -- 172.21.15.144:0/2758503717 >> 172.21.15.144:0/2758503717 conn(0x7f09f00cb7e0 msgr2=0x7f09f00cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:22.835 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 -- 172.21.15.144:0/2758503717 shutdown_connections 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.827+0000 7f09f65ff700 1 -- 172.21.15.144:0/2758503717 wait complete. 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.829+0000 7f09f65ff700 1 Processor -- start 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.829+0000 7f09f65ff700 1 -- start start 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09f006a2d0 0x7f09f0143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015db80 con 0x7f09f015a750 2023-05-11T07:37:22.836 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015bf60 con 0x7f09f006a2d0 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f65ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00cc150 con 0x7f09f006b7a0 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41908/0 (socket says 172.21.15.144:41908) 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 -- 172.21.15.144:0/1177515137 learned_addr learned my addr 172.21.15.144:0/1177515137 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09ef7fe700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09effff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09f006a2d0 0x7f09f0143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.837 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 -- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 msgr2=0x7f09f015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 -- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09f006a2d0 msgr2=0x7f09f0143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09f006a2d0 0x7f09f0143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.830+0000 7f09f4b9c700 1 -- 172.21.15.144:0/1177515137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e4009550 con 0x7f09f015a750 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09f4b9c700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eed0 tx=0x7f09e800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8010040 con 0x7f09f015a750 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800bc80 con 0x7f09f015a750 2023-05-11T07:37:22.838 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f006c420 con 0x7f09f015a750 2023-05-11T07:37:22.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8009e40 con 0x7f09f015a750 2023-05-11T07:37:22.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.831+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f0071160 con 0x7f09f015a750 2023-05-11T07:37:22.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.832+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f00713d0 con 0x7f09f015a750 2023-05-11T07:37:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.833+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09e8014400 con 0x7f09f015a750 2023-05-11T07:37:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.834+0000 7f09ecff9700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 0x7f09dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.834+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f09e8089990 con 0x7f09f015a750 2023-05-11T07:37:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.834+0000 7f09effff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 0x7f09dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:22.840 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.835+0000 7f09effff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 0x7f09dc06d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009be0 tx=0x7f09e0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:22.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:22.839+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f09e8054860 con 0x7f09f015a750 2023-05-11T07:37:23.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.027+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09f0144c10 con 0x7f09dc06ace0 2023-05-11T07:37:23.039 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.036+0000 7f09ecff9700 1 -- 172.21.15.144:0/1177515137 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308278 (secure 0 0 0) 0x7f09f0144c10 con 0x7f09dc06ace0 2023-05-11T07:37:23.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:23.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 msgr2=0x7f09dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 0x7f09dc06d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009be0 tx=0x7f09e0009210 comp rx=0 tx=0).stop 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 msgr2=0x7f09f015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f09e800eed0 tx=0x7f09e800b390 comp rx=0 tx=0).stop 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 shutdown_connections 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f09dc06ace0 0x7f09dc06d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.045 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f015a750 0x7f09f015b620 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09f006a2d0 0x7f09f0143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 --2- 172.21.15.144:0/1177515137 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f09f006b7a0 0x7f09f015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 >> 172.21.15.144:0/1177515137 conn(0x7f09f00cb7e0 msgr2=0x7f09f0159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 shutdown_connections 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.040+0000 7f09f65ff700 1 -- 172.21.15.144:0/1177515137 wait complete. 2023-05-11T07:37:23.046 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:37:23.061 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-05-11T07:37:21.735896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71516,"kb_used_data":4956,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903204,"statfs":{"total":773094113280,"available":773020880896,"internally_reserved":0,"allocated":5074944,"data_stored":2891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.955814"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:18.291434+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:18.291148+0000","last_became_peered":"2023-05-11T07:37:18.291148+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:22.530712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992276+0000","last_change":"2023-05-11T07:37:18.301388+0000","last_active":"2023-05-11T07:37:19.992276+0000","last_peered":"2023-05-11T07:37:19.992276+0000","last_clean":"2023-05-11T07:37:19.992276+0000","last_became_active":"2023-05-11T07:37:18.301121+0000","last_became_peered":"2023-05-11T07:37:18.301121+0000","last_unstale":"2023-05-11T07:37:19.992276+0000","last_undegraded":"2023-05-11T07:37:19.992276+0000","last_fullsized":"2023-05-11T07:37:19.992276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:49:47.667555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282046+0000","last_change":"2023-05-11T07:37:18.292177+0000","last_active":"2023-05-11T07:37:19.282046+0000","last_peered":"2023-05-11T07:37:19.282046+0000","last_clean":"2023-05-11T07:37:19.282046+0000","last_became_active":"2023-05-11T07:37:18.291845+0000","last_became_peered":"2023-05-11T07:37:18.291845+0000","last_unstale":"2023-05-11T07:37:19.282046+0000","last_undegraded":"2023-05-11T07:37:19.282046+0000","last_fullsized":"2023-05-11T07:37:19.282046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:23.945011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991955+0000","last_change":"2023-05-11T07:37:18.301367+0000","last_active":"2023-05-11T07:37:19.991955+0000","last_peered":"2023-05-11T07:37:19.991955+0000","last_clean":"2023-05-11T07:37:19.991955+0000","last_became_active":"2023-05-11T07:37:18.301084+0000","last_became_peered":"2023-05-11T07:37:18.301084+0000","last_unstale":"2023-05-11T07:37:19.991955+0000","last_undegraded":"2023-05-11T07:37:19.991955+0000","last_fullsized":"2023-05-11T07:37:19.991955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985990+0000","last_change":"2023-05-11T07:37:18.294756+0000","last_active":"2023-05-11T07:37:19.985990+0000","last_peered":"2023-05-11T07:37:19.985990+0000","last_clean":"2023-05-11T07:37:19.985990+0000","last_became_active":"2023-05-11T07:37:18.294511+0000","last_became_peered":"2023-05-11T07:37:18.294511+0000","last_unstale":"2023-05-11T07:37:19.985990+0000","last_undegraded":"2023-05-11T07:37:19.985990+0000","last_fullsized":"2023-05-11T07:37:19.985990+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:05:29.224864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993012+0000","last_change":"2023-05-11T07:37:18.292016+0000","last_active":"2023-05-11T07:37:19.993012+0000","last_peered":"2023-05-11T07:37:19.993012+0000","last_clean":"2023-05-11T07:37:19.993012+0000","last_became_active":"2023-05-11T07:37:18.291768+0000","last_became_peered":"2023-05-11T07:37:18.291768+0000","last_unstale":"2023-05-11T07:37:19.993012+0000","last_undegraded":"2023-05-11T07:37:19.993012+0000","last_fullsized":"2023-05-11T07:37:19.993012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:42.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992369+0000","last_change":"2023-05-11T07:37:18.296188+0000","last_active":"2023-05-11T07:37:19.992369+0000","last_peered":"2023-05-11T07:37:19.992369+0000","last_clean":"2023-05-11T07:37:19.992369+0000","last_became_active":"2023-05-11T07:37:18.295883+0000","last_became_peered":"2023-05-11T07:37:18.295883+0000","last_unstale":"2023-05-11T07:37:19.992369+0000","last_undegraded":"2023-05-11T07:37:19.992369+0000","last_fullsized":"2023-05-11T07:37:19.992369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:11:59.401409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991859+0000","last_change":"2023-05-11T07:37:18.290472+0000","last_active":"2023-05-11T07:37:19.991859+0000","last_peered":"2023-05-11T07:37:19.991859+0000","last_clean":"2023-05-11T07:37:19.991859+0000","last_became_active":"2023-05-11T07:37:18.290200+0000","last_became_peered":"2023-05-11T07:37:18.290200+0000","last_unstale":"2023-05-11T07:37:19.991859+0000","last_undegraded":"2023-05-11T07:37:19.991859+0000","last_fullsized":"2023-05-11T07:37:19.991859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:04:09.879877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985989+0000","last_change":"2023-05-11T07:37:18.295459+0000","last_active":"2023-05-11T07:37:19.985989+0000","last_peered":"2023-05-11T07:37:19.985989+0000","last_clean":"2023-05-11T07:37:19.985989+0000","last_became_active":"2023-05-11T07:37:18.295061+0000","last_became_peered":"2023-05-11T07:37:18.295061+0000","last_unstale":"2023-05-11T07:37:19.985989+0000","last_undegraded":"2023-05-11T07:37:19.985989+0000","last_fullsized":"2023-05-11T07:37:19.985989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:34.937633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283239+0000","last_change":"2023-05-11T07:37:18.309208+0000","last_active":"2023-05-11T07:37:19.283239+0000","last_peered":"2023-05-11T07:37:19.283239+0000","last_clean":"2023-05-11T07:37:19.283239+0000","last_became_active":"2023-05-11T07:37:18.308913+0000","last_became_peered":"2023-05-11T07:37:18.308913+0000","last_unstale":"2023-05-11T07:37:19.283239+0000","last_undegraded":"2023-05-11T07:37:19.283239+0000","last_fullsized":"2023-05-11T07:37:19.283239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:00:43.186311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282224+0000","last_change":"2023-05-11T07:37:18.292799+0000","last_active":"2023-05-11T07:37:19.282224+0000","last_peered":"2023-05-11T07:37:19.282224+0000","last_clean":"2023-05-11T07:37:19.282224+0000","last_became_active":"2023-05-11T07:37:18.292476+0000","last_became_peered":"2023-05-11T07:37:18.292476+0000","last_unstale":"2023-05-11T07:37:19.282224+0000","last_undegraded":"2023-05-11T07:37:19.282224+0000","last_fullsized":"2023-05-11T07:37:19.282224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:22:36.881963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282065+0000","last_change":"2023-05-11T07:37:18.297272+0000","last_active":"2023-05-11T07:37:19.282065+0000","last_peered":"2023-05-11T07:37:19.282065+0000","last_clean":"2023-05-11T07:37:19.282065+0000","last_became_active":"2023-05-11T07:37:18.296933+0000","last_became_peered":"2023-05-11T07:37:18.296933+0000","last_unstale":"2023-05-11T07:37:19.282065+0000","last_undegraded":"2023-05-11T07:37:19.282065+0000","last_fullsized":"2023-05-11T07:37:19.282065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:01:15.986745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283687+0000","last_change":"2023-05-11T07:37:18.288933+0000","last_active":"2023-05-11T07:37:19.283687+0000","last_peered":"2023-05-11T07:37:19.283687+0000","last_clean":"2023-05-11T07:37:19.283687+0000","last_became_active":"2023-05-11T07:37:18.288605+0000","last_became_peered":"2023-05-11T07:37:18.288605+0000","last_unstale":"2023-05-11T07:37:19.283687+0000","last_undegraded":"2023-05-11T07:37:19.283687+0000","last_fullsized":"2023-05-11T07:37:19.283687+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:10:53.147958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992012+0000","last_change":"2023-05-11T07:37:18.304107+0000","last_active":"2023-05-11T07:37:19.992012+0000","last_peered":"2023-05-11T07:37:19.992012+0000","last_clean":"2023-05-11T07:37:19.992012+0000","last_became_active":"2023-05-11T07:37:18.303874+0000","last_became_peered":"2023-05-11T07:37:18.303874+0000","last_unstale":"2023-05-11T07:37:19.992012+0000","last_undegraded":"2023-05-11T07:37:19.992012+0000","last_fullsized":"2023-05-11T07:37:19.992012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:30.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986014+0000","last_change":"2023-05-11T07:37:18.296702+0000","last_active":"2023-05-11T07:37:19.986014+0000","last_peered":"2023-05-11T07:37:19.986014+0000","last_clean":"2023-05-11T07:37:19.986014+0000","last_became_active":"2023-05-11T07:37:18.296227+0000","last_became_peered":"2023-05-11T07:37:18.296227+0000","last_unstale":"2023-05-11T07:37:19.986014+0000","last_undegraded":"2023-05-11T07:37:19.986014+0000","last_fullsized":"2023-05-11T07:37:19.986014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:35:20.212233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283252+0000","last_change":"2023-05-11T07:37:18.287465+0000","last_active":"2023-05-11T07:37:19.283252+0000","last_peered":"2023-05-11T07:37:19.283252+0000","last_clean":"2023-05-11T07:37:19.283252+0000","last_became_active":"2023-05-11T07:37:18.286165+0000","last_became_peered":"2023-05-11T07:37:18.286165+0000","last_unstale":"2023-05-11T07:37:19.283252+0000","last_undegraded":"2023-05-11T07:37:19.283252+0000","last_fullsized":"2023-05-11T07:37:19.283252+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:45:47.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283293+0000","last_change":"2023-05-11T07:37:18.286561+0000","last_active":"2023-05-11T07:37:19.283293+0000","last_peered":"2023-05-11T07:37:19.283293+0000","last_clean":"2023-05-11T07:37:19.283293+0000","last_became_active":"2023-05-11T07:37:18.286216+0000","last_became_peered":"2023-05-11T07:37:18.286216+0000","last_unstale":"2023-05-11T07:37:19.283293+0000","last_undegraded":"2023-05-11T07:37:19.283293+0000","last_fullsized":"2023-05-11T07:37:19.283293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:27:51.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283989+0000","last_change":"2023-05-11T07:37:18.286834+0000","last_active":"2023-05-11T07:37:19.283989+0000","last_peered":"2023-05-11T07:37:19.283989+0000","last_clean":"2023-05-11T07:37:19.283989+0000","last_became_active":"2023-05-11T07:37:18.286568+0000","last_became_peered":"2023-05-11T07:37:18.286568+0000","last_unstale":"2023-05-11T07:37:19.283989+0000","last_undegraded":"2023-05-11T07:37:19.283989+0000","last_fullsized":"2023-05-11T07:37:19.283989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:46.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992099+0000","last_change":"2023-05-11T07:37:18.290513+0000","last_active":"2023-05-11T07:37:19.992099+0000","last_peered":"2023-05-11T07:37:19.992099+0000","last_clean":"2023-05-11T07:37:19.992099+0000","last_became_active":"2023-05-11T07:37:18.290222+0000","last_became_peered":"2023-05-11T07:37:18.290222+0000","last_unstale":"2023-05-11T07:37:19.992099+0000","last_undegraded":"2023-05-11T07:37:19.992099+0000","last_fullsized":"2023-05-11T07:37:19.992099+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:01.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282119+0000","last_change":"2023-05-11T07:37:18.289912+0000","last_active":"2023-05-11T07:37:19.282119+0000","last_peered":"2023-05-11T07:37:19.282119+0000","last_clean":"2023-05-11T07:37:19.282119+0000","last_became_active":"2023-05-11T07:37:18.289607+0000","last_became_peered":"2023-05-11T07:37:18.289607+0000","last_unstale":"2023-05-11T07:37:19.282119+0000","last_undegraded":"2023-05-11T07:37:19.282119+0000","last_fullsized":"2023-05-11T07:37:19.282119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:26:38.690549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992184+0000","last_change":"2023-05-11T07:37:18.296428+0000","last_active":"2023-05-11T07:37:19.992184+0000","last_peered":"2023-05-11T07:37:19.992184+0000","last_clean":"2023-05-11T07:37:19.992184+0000","last_became_active":"2023-05-11T07:37:18.296133+0000","last_became_peered":"2023-05-11T07:37:18.296133+0000","last_unstale":"2023-05-11T07:37:19.992184+0000","last_undegraded":"2023-05-11T07:37:19.992184+0000","last_fullsized":"2023-05-11T07:37:19.992184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:53:03.634364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283703+0000","last_change":"2023-05-11T07:37:18.286553+0000","last_active":"2023-05-11T07:37:19.283703+0000","last_peered":"2023-05-11T07:37:19.283703+0000","last_clean":"2023-05-11T07:37:19.283703+0000","last_became_active":"2023-05-11T07:37:18.286235+0000","last_became_peered":"2023-05-11T07:37:18.286235+0000","last_unstale":"2023-05-11T07:37:19.283703+0000","last_undegraded":"2023-05-11T07:37:19.283703+0000","last_fullsized":"2023-05-11T07:37:19.283703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:47:38.913921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281787+0000","last_change":"2023-05-11T07:37:18.291946+0000","last_active":"2023-05-11T07:37:19.281787+0000","last_peered":"2023-05-11T07:37:19.281787+0000","last_clean":"2023-05-11T07:37:19.281787+0000","last_became_active":"2023-05-11T07:37:18.291346+0000","last_became_peered":"2023-05-11T07:37:18.291346+0000","last_unstale":"2023-05-11T07:37:19.281787+0000","last_undegraded":"2023-05-11T07:37:19.281787+0000","last_fullsized":"2023-05-11T07:37:19.281787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:26:34.365278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985821+0000","last_change":"2023-05-11T07:37:18.298118+0000","last_active":"2023-05-11T07:37:19.985821+0000","last_peered":"2023-05-11T07:37:19.985821+0000","last_clean":"2023-05-11T07:37:19.985821+0000","last_became_active":"2023-05-11T07:37:18.297866+0000","last_became_peered":"2023-05-11T07:37:18.297866+0000","last_unstale":"2023-05-11T07:37:19.985821+0000","last_undegraded":"2023-05-11T07:37:19.985821+0000","last_fullsized":"2023-05-11T07:37:19.985821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991682+0000","last_change":"2023-05-11T07:37:18.291309+0000","last_active":"2023-05-11T07:37:19.991682+0000","last_peered":"2023-05-11T07:37:19.991682+0000","last_clean":"2023-05-11T07:37:19.991682+0000","last_became_active":"2023-05-11T07:37:18.290864+0000","last_became_peered":"2023-05-11T07:37:18.290864+0000","last_unstale":"2023-05-11T07:37:19.991682+0000","last_undegraded":"2023-05-11T07:37:19.991682+0000","last_fullsized":"2023-05-11T07:37:19.991682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:16.444730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993415+0000","last_change":"2023-05-11T07:37:18.292054+0000","last_active":"2023-05-11T07:37:19.993415+0000","last_peered":"2023-05-11T07:37:19.993415+0000","last_clean":"2023-05-11T07:37:19.993415+0000","last_became_active":"2023-05-11T07:37:18.291805+0000","last_became_peered":"2023-05-11T07:37:18.291805+0000","last_unstale":"2023-05-11T07:37:19.993415+0000","last_undegraded":"2023-05-11T07:37:19.993415+0000","last_fullsized":"2023-05-11T07:37:19.993415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:19.430601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986353+0000","last_change":"2023-05-11T07:37:17.813384+0000","last_active":"2023-05-11T07:37:19.986353+0000","last_peered":"2023-05-11T07:37:19.986353+0000","last_clean":"2023-05-11T07:37:19.986353+0000","last_became_active":"2023-05-11T07:37:17.813112+0000","last_became_peered":"2023-05-11T07:37:17.813112+0000","last_unstale":"2023-05-11T07:37:19.986353+0000","last_undegraded":"2023-05-11T07:37:19.986353+0000","last_fullsized":"2023-05-11T07:37:19.986353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283875+0000","last_change":"2023-05-11T07:37:18.294542+0000","last_active":"2023-05-11T07:37:19.283875+0000","last_peered":"2023-05-11T07:37:19.283875+0000","last_clean":"2023-05-11T07:37:19.283875+0000","last_became_active":"2023-05-11T07:37:18.294147+0000","last_became_peered":"2023-05-11T07:37:18.294147+0000","last_unstale":"2023-05-11T07:37:19.283875+0000","last_undegraded":"2023-05-11T07:37:19.283875+0000","last_fullsized":"2023-05-11T07:37:19.283875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:21:00.891302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282310+0000","last_change":"2023-05-11T07:37:17.803783+0000","last_active":"2023-05-11T07:37:19.282310+0000","last_peered":"2023-05-11T07:37:19.282310+0000","last_clean":"2023-05-11T07:37:19.282310+0000","last_became_active":"2023-05-11T07:37:17.803516+0000","last_became_peered":"2023-05-11T07:37:17.803516+0000","last_unstale":"2023-05-11T07:37:19.282310+0000","last_undegraded":"2023-05-11T07:37:19.282310+0000","last_fullsized":"2023-05-11T07:37:19.282310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:30:54.188343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992197+0000","last_change":"2023-05-11T07:37:18.292075+0000","last_active":"2023-05-11T07:37:19.992197+0000","last_peered":"2023-05-11T07:37:19.992197+0000","last_clean":"2023-05-11T07:37:19.992197+0000","last_became_active":"2023-05-11T07:37:18.291815+0000","last_became_peered":"2023-05-11T07:37:18.291815+0000","last_unstale":"2023-05-11T07:37:19.992197+0000","last_undegraded":"2023-05-11T07:37:19.992197+0000","last_fullsized":"2023-05-11T07:37:19.992197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:27.787504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993639+0000","last_change":"2023-05-11T07:37:17.803729+0000","last_active":"2023-05-11T07:37:19.993639+0000","last_peered":"2023-05-11T07:37:19.993639+0000","last_clean":"2023-05-11T07:37:19.993639+0000","last_became_active":"2023-05-11T07:37:17.803491+0000","last_became_peered":"2023-05-11T07:37:17.803491+0000","last_unstale":"2023-05-11T07:37:19.993639+0000","last_undegraded":"2023-05-11T07:37:19.993639+0000","last_fullsized":"2023-05-11T07:37:19.993639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:52.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993604+0000","last_change":"2023-05-11T07:37:18.289175+0000","last_active":"2023-05-11T07:37:19.993604+0000","last_peered":"2023-05-11T07:37:19.993604+0000","last_clean":"2023-05-11T07:37:19.993604+0000","last_became_active":"2023-05-11T07:37:18.287810+0000","last_became_peered":"2023-05-11T07:37:18.287810+0000","last_unstale":"2023-05-11T07:37:19.993604+0000","last_undegraded":"2023-05-11T07:37:19.993604+0000","last_fullsized":"2023-05-11T07:37:19.993604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:39.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:17.813722+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:17.813440+0000","last_became_peered":"2023-05-11T07:37:17.813440+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281890+0000","last_change":"2023-05-11T07:37:18.291751+0000","last_active":"2023-05-11T07:37:19.281890+0000","last_peered":"2023-05-11T07:37:19.281890+0000","last_clean":"2023-05-11T07:37:19.281890+0000","last_became_active":"2023-05-11T07:37:18.291049+0000","last_became_peered":"2023-05-11T07:37:18.291049+0000","last_unstale":"2023-05-11T07:37:19.281890+0000","last_undegraded":"2023-05-11T07:37:19.281890+0000","last_fullsized":"2023-05-11T07:37:19.281890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:24.836884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986327+0000","last_change":"2023-05-11T07:37:17.809016+0000","last_active":"2023-05-11T07:37:19.986327+0000","last_peered":"2023-05-11T07:37:19.986327+0000","last_clean":"2023-05-11T07:37:19.986327+0000","last_became_active":"2023-05-11T07:37:17.808761+0000","last_became_peered":"2023-05-11T07:37:17.808761+0000","last_unstale":"2023-05-11T07:37:19.986327+0000","last_undegraded":"2023-05-11T07:37:19.986327+0000","last_fullsized":"2023-05-11T07:37:19.986327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282053+0000","last_change":"2023-05-11T07:37:17.802629+0000","last_active":"2023-05-11T07:37:19.282053+0000","last_peered":"2023-05-11T07:37:19.282053+0000","last_clean":"2023-05-11T07:37:19.282053+0000","last_became_active":"2023-05-11T07:37:17.802309+0000","last_became_peered":"2023-05-11T07:37:17.802309+0000","last_unstale":"2023-05-11T07:37:19.282053+0000","last_undegraded":"2023-05-11T07:37:19.282053+0000","last_fullsized":"2023-05-11T07:37:19.282053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:37.107122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991960+0000","last_change":"2023-05-11T07:37:17.806893+0000","last_active":"2023-05-11T07:37:19.991960+0000","last_peered":"2023-05-11T07:37:19.991960+0000","last_clean":"2023-05-11T07:37:19.991960+0000","last_became_active":"2023-05-11T07:37:17.806550+0000","last_became_peered":"2023-05-11T07:37:17.806550+0000","last_unstale":"2023-05-11T07:37:19.991960+0000","last_undegraded":"2023-05-11T07:37:19.991960+0000","last_fullsized":"2023-05-11T07:37:19.991960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:21.524193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283429+0000","last_change":"2023-05-11T07:37:18.285399+0000","last_active":"2023-05-11T07:37:19.283429+0000","last_peered":"2023-05-11T07:37:19.283429+0000","last_clean":"2023-05-11T07:37:19.283429+0000","last_became_active":"2023-05-11T07:37:18.284955+0000","last_became_peered":"2023-05-11T07:37:18.284955+0000","last_unstale":"2023-05-11T07:37:19.283429+0000","last_undegraded":"2023-05-11T07:37:19.283429+0000","last_fullsized":"2023-05-11T07:37:19.283429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:24:56.109130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790686+0000","last_change":"2023-05-11T07:37:16.790686+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790686+0000","last_undegraded":"2023-05-11T07:37:16.790686+0000","last_fullsized":"2023-05-11T07:37:16.790686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282230+0000","last_change":"2023-05-11T07:37:18.296389+0000","last_active":"2023-05-11T07:37:19.282230+0000","last_peered":"2023-05-11T07:37:19.282230+0000","last_clean":"2023-05-11T07:37:19.282230+0000","last_became_active":"2023-05-11T07:37:18.296111+0000","last_became_peered":"2023-05-11T07:37:18.296111+0000","last_unstale":"2023-05-11T07:37:19.282230+0000","last_undegraded":"2023-05-11T07:37:19.282230+0000","last_fullsized":"2023-05-11T07:37:19.282230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:27:41.360370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282315+0000","last_change":"2023-05-11T07:37:17.801337+0000","last_active":"2023-05-11T07:37:19.282315+0000","last_peered":"2023-05-11T07:37:19.282315+0000","last_clean":"2023-05-11T07:37:19.282315+0000","last_became_active":"2023-05-11T07:37:17.800991+0000","last_became_peered":"2023-05-11T07:37:17.800991+0000","last_unstale":"2023-05-11T07:37:19.282315+0000","last_undegraded":"2023-05-11T07:37:19.282315+0000","last_fullsized":"2023-05-11T07:37:19.282315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:46.905451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993466+0000","last_change":"2023-05-11T07:37:18.295004+0000","last_active":"2023-05-11T07:37:19.993466+0000","last_peered":"2023-05-11T07:37:19.993466+0000","last_clean":"2023-05-11T07:37:19.993466+0000","last_became_active":"2023-05-11T07:37:18.294741+0000","last_became_peered":"2023-05-11T07:37:18.294741+0000","last_unstale":"2023-05-11T07:37:19.993466+0000","last_undegraded":"2023-05-11T07:37:19.993466+0000","last_fullsized":"2023-05-11T07:37:19.993466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:54.412110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790337+0000","last_change":"2023-05-11T07:37:16.790337+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790337+0000","last_undegraded":"2023-05-11T07:37:16.790337+0000","last_fullsized":"2023-05-11T07:37:16.790337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986228+0000","last_change":"2023-05-11T07:37:18.293624+0000","last_active":"2023-05-11T07:37:19.986228+0000","last_peered":"2023-05-11T07:37:19.986228+0000","last_clean":"2023-05-11T07:37:19.986228+0000","last_became_active":"2023-05-11T07:37:18.293346+0000","last_became_peered":"2023-05-11T07:37:18.293346+0000","last_unstale":"2023-05-11T07:37:19.986228+0000","last_undegraded":"2023-05-11T07:37:19.986228+0000","last_fullsized":"2023-05-11T07:37:19.986228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993508+0000","last_change":"2023-05-11T07:37:17.813482+0000","last_active":"2023-05-11T07:37:19.993508+0000","last_peered":"2023-05-11T07:37:19.993508+0000","last_clean":"2023-05-11T07:37:19.993508+0000","last_became_active":"2023-05-11T07:37:17.813163+0000","last_became_peered":"2023-05-11T07:37:17.813163+0000","last_unstale":"2023-05-11T07:37:19.993508+0000","last_undegraded":"2023-05-11T07:37:19.993508+0000","last_fullsized":"2023-05-11T07:37:19.993508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:16:44.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993281+0000","last_change":"2023-05-11T07:37:18.290528+0000","last_active":"2023-05-11T07:37:19.993281+0000","last_peered":"2023-05-11T07:37:19.993281+0000","last_clean":"2023-05-11T07:37:19.993281+0000","last_became_active":"2023-05-11T07:37:18.290251+0000","last_became_peered":"2023-05-11T07:37:18.290251+0000","last_unstale":"2023-05-11T07:37:19.993281+0000","last_undegraded":"2023-05-11T07:37:19.993281+0000","last_fullsized":"2023-05-11T07:37:19.993281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992148+0000","last_change":"2023-05-11T07:37:17.804935+0000","last_active":"2023-05-11T07:37:19.992148+0000","last_peered":"2023-05-11T07:37:19.992148+0000","last_clean":"2023-05-11T07:37:19.992148+0000","last_became_active":"2023-05-11T07:37:17.804595+0000","last_became_peered":"2023-05-11T07:37:17.804595+0000","last_unstale":"2023-05-11T07:37:19.992148+0000","last_undegraded":"2023-05-11T07:37:19.992148+0000","last_fullsized":"2023-05-11T07:37:19.992148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:23:20.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283296+0000","last_change":"2023-05-11T07:37:18.302703+0000","last_active":"2023-05-11T07:37:19.283296+0000","last_peered":"2023-05-11T07:37:19.283296+0000","last_clean":"2023-05-11T07:37:19.283296+0000","last_became_active":"2023-05-11T07:37:18.302276+0000","last_became_peered":"2023-05-11T07:37:18.302276+0000","last_unstale":"2023-05-11T07:37:19.283296+0000","last_undegraded":"2023-05-11T07:37:19.283296+0000","last_fullsized":"2023-05-11T07:37:19.283296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:53:03.341271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986180+0000","last_change":"2023-05-11T07:37:17.805056+0000","last_active":"2023-05-11T07:37:19.986180+0000","last_peered":"2023-05-11T07:37:19.986180+0000","last_clean":"2023-05-11T07:37:19.986180+0000","last_became_active":"2023-05-11T07:37:17.804788+0000","last_became_peered":"2023-05-11T07:37:17.804788+0000","last_unstale":"2023-05-11T07:37:19.986180+0000","last_undegraded":"2023-05-11T07:37:19.986180+0000","last_fullsized":"2023-05-11T07:37:19.986180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:55.002267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993056+0000","last_change":"2023-05-11T07:37:17.809230+0000","last_active":"2023-05-11T07:37:19.993056+0000","last_peered":"2023-05-11T07:37:19.993056+0000","last_clean":"2023-05-11T07:37:19.993056+0000","last_became_active":"2023-05-11T07:37:17.808956+0000","last_became_peered":"2023-05-11T07:37:17.808956+0000","last_unstale":"2023-05-11T07:37:19.993056+0000","last_undegraded":"2023-05-11T07:37:19.993056+0000","last_fullsized":"2023-05-11T07:37:19.993056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985829+0000","last_change":"2023-05-11T07:37:18.293684+0000","last_active":"2023-05-11T07:37:19.985829+0000","last_peered":"2023-05-11T07:37:19.985829+0000","last_clean":"2023-05-11T07:37:19.985829+0000","last_became_active":"2023-05-11T07:37:18.293412+0000","last_became_peered":"2023-05-11T07:37:18.293412+0000","last_unstale":"2023-05-11T07:37:19.985829+0000","last_undegraded":"2023-05-11T07:37:19.985829+0000","last_fullsized":"2023-05-11T07:37:19.985829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985944+0000","last_change":"2023-05-11T07:37:17.804908+0000","last_active":"2023-05-11T07:37:19.985944+0000","last_peered":"2023-05-11T07:37:19.985944+0000","last_clean":"2023-05-11T07:37:19.985944+0000","last_became_active":"2023-05-11T07:37:17.804649+0000","last_became_peered":"2023-05-11T07:37:17.804649+0000","last_unstale":"2023-05-11T07:37:19.985944+0000","last_undegraded":"2023-05-11T07:37:19.985944+0000","last_fullsized":"2023-05-11T07:37:19.985944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992957+0000","last_change":"2023-05-11T07:37:18.286709+0000","last_active":"2023-05-11T07:37:19.992957+0000","last_peered":"2023-05-11T07:37:19.992957+0000","last_clean":"2023-05-11T07:37:19.992957+0000","last_became_active":"2023-05-11T07:37:18.286345+0000","last_became_peered":"2023-05-11T07:37:18.286345+0000","last_unstale":"2023-05-11T07:37:19.992957+0000","last_undegraded":"2023-05-11T07:37:19.992957+0000","last_fullsized":"2023-05-11T07:37:19.992957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790303+0000","last_change":"2023-05-11T07:37:16.790303+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790303+0000","last_undegraded":"2023-05-11T07:37:16.790303+0000","last_fullsized":"2023-05-11T07:37:16.790303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991825+0000","last_change":"2023-05-11T07:37:18.294767+0000","last_active":"2023-05-11T07:37:19.991825+0000","last_peered":"2023-05-11T07:37:19.991825+0000","last_clean":"2023-05-11T07:37:19.991825+0000","last_became_active":"2023-05-11T07:37:18.294516+0000","last_became_peered":"2023-05-11T07:37:18.294516+0000","last_unstale":"2023-05-11T07:37:19.991825+0000","last_undegraded":"2023-05-11T07:37:19.991825+0000","last_fullsized":"2023-05-11T07:37:19.991825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:30:18.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991981+0000","last_change":"2023-05-11T07:37:17.802776+0000","last_active":"2023-05-11T07:37:19.991981+0000","last_peered":"2023-05-11T07:37:19.991981+0000","last_clean":"2023-05-11T07:37:19.991981+0000","last_became_active":"2023-05-11T07:37:17.802533+0000","last_became_peered":"2023-05-11T07:37:17.802533+0000","last_unstale":"2023-05-11T07:37:19.991981+0000","last_undegraded":"2023-05-11T07:37:19.991981+0000","last_fullsized":"2023-05-11T07:37:19.991981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:49:16.959783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282198+0000","last_change":"2023-05-11T07:37:17.801549+0000","last_active":"2023-05-11T07:37:19.282198+0000","last_peered":"2023-05-11T07:37:19.282198+0000","last_clean":"2023-05-11T07:37:19.282198+0000","last_became_active":"2023-05-11T07:37:17.801223+0000","last_became_peered":"2023-05-11T07:37:17.801223+0000","last_unstale":"2023-05-11T07:37:19.282198+0000","last_undegraded":"2023-05-11T07:37:19.282198+0000","last_fullsized":"2023-05-11T07:37:19.282198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:45.174857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283835+0000","last_change":"2023-05-11T07:37:18.289641+0000","last_active":"2023-05-11T07:37:19.283835+0000","last_peered":"2023-05-11T07:37:19.283835+0000","last_clean":"2023-05-11T07:37:19.283835+0000","last_became_active":"2023-05-11T07:37:18.289266+0000","last_became_peered":"2023-05-11T07:37:18.289266+0000","last_unstale":"2023-05-11T07:37:19.283835+0000","last_undegraded":"2023-05-11T07:37:19.283835+0000","last_fullsized":"2023-05-11T07:37:19.283835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:07:10.450228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992371+0000","last_change":"2023-05-11T07:37:17.806924+0000","last_active":"2023-05-11T07:37:19.992371+0000","last_peered":"2023-05-11T07:37:19.992371+0000","last_clean":"2023-05-11T07:37:19.992371+0000","last_became_active":"2023-05-11T07:37:17.806632+0000","last_became_peered":"2023-05-11T07:37:17.806632+0000","last_unstale":"2023-05-11T07:37:19.992371+0000","last_undegraded":"2023-05-11T07:37:19.992371+0000","last_fullsized":"2023-05-11T07:37:19.992371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:15.881529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283860+0000","last_change":"2023-05-11T07:37:18.287300+0000","last_active":"2023-05-11T07:37:19.283860+0000","last_peered":"2023-05-11T07:37:19.283860+0000","last_clean":"2023-05-11T07:37:19.283860+0000","last_became_active":"2023-05-11T07:37:18.286982+0000","last_became_peered":"2023-05-11T07:37:18.286982+0000","last_unstale":"2023-05-11T07:37:19.283860+0000","last_undegraded":"2023-05-11T07:37:19.283860+0000","last_fullsized":"2023-05-11T07:37:19.283860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:08:12.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986279+0000","last_change":"2023-05-11T07:37:17.811963+0000","last_active":"2023-05-11T07:37:19.986279+0000","last_peered":"2023-05-11T07:37:19.986279+0000","last_clean":"2023-05-11T07:37:19.986279+0000","last_became_active":"2023-05-11T07:37:17.811718+0000","last_became_peered":"2023-05-11T07:37:17.811718+0000","last_unstale":"2023-05-11T07:37:19.986279+0000","last_undegraded":"2023-05-11T07:37:19.986279+0000","last_fullsized":"2023-05-11T07:37:19.986279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:58:39.409698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986060+0000","last_change":"2023-05-11T07:37:18.294227+0000","last_active":"2023-05-11T07:37:19.986060+0000","last_peered":"2023-05-11T07:37:19.986060+0000","last_clean":"2023-05-11T07:37:19.986060+0000","last_became_active":"2023-05-11T07:37:18.293962+0000","last_became_peered":"2023-05-11T07:37:18.293962+0000","last_unstale":"2023-05-11T07:37:19.986060+0000","last_undegraded":"2023-05-11T07:37:19.986060+0000","last_fullsized":"2023-05-11T07:37:19.986060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:31:48.833972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986258+0000","last_change":"2023-05-11T07:37:17.809327+0000","last_active":"2023-05-11T07:37:19.986258+0000","last_peered":"2023-05-11T07:37:19.986258+0000","last_clean":"2023-05-11T07:37:19.986258+0000","last_became_active":"2023-05-11T07:37:17.808953+0000","last_became_peered":"2023-05-11T07:37:17.808953+0000","last_unstale":"2023-05-11T07:37:19.986258+0000","last_undegraded":"2023-05-11T07:37:19.986258+0000","last_fullsized":"2023-05-11T07:37:19.986258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:41.118642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993416+0000","last_change":"2023-05-11T07:37:18.293169+0000","last_active":"2023-05-11T07:37:19.993416+0000","last_peered":"2023-05-11T07:37:19.993416+0000","last_clean":"2023-05-11T07:37:19.993416+0000","last_became_active":"2023-05-11T07:37:18.292862+0000","last_became_peered":"2023-05-11T07:37:18.292862+0000","last_unstale":"2023-05-11T07:37:19.993416+0000","last_undegraded":"2023-05-11T07:37:19.993416+0000","last_fullsized":"2023-05-11T07:37:19.993416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:21.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991908+0000","last_change":"2023-05-11T07:37:17.808473+0000","last_active":"2023-05-11T07:37:19.991908+0000","last_peered":"2023-05-11T07:37:19.991908+0000","last_clean":"2023-05-11T07:37:19.991908+0000","last_became_active":"2023-05-11T07:37:17.808069+0000","last_became_peered":"2023-05-11T07:37:17.808069+0000","last_unstale":"2023-05-11T07:37:19.991908+0000","last_undegraded":"2023-05-11T07:37:19.991908+0000","last_fullsized":"2023-05-11T07:37:19.991908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991589+0000","last_change":"2023-05-11T07:37:18.289485+0000","last_active":"2023-05-11T07:37:19.991589+0000","last_peered":"2023-05-11T07:37:19.991589+0000","last_clean":"2023-05-11T07:37:19.991589+0000","last_became_active":"2023-05-11T07:37:18.289211+0000","last_became_peered":"2023-05-11T07:37:18.289211+0000","last_unstale":"2023-05-11T07:37:19.991589+0000","last_undegraded":"2023-05-11T07:37:19.991589+0000","last_fullsized":"2023-05-11T07:37:19.991589+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:00:01.334038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.789788+0000","last_change":"2023-05-11T07:37:16.789788+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.789788+0000","last_undegraded":"2023-05-11T07:37:16.789788+0000","last_fullsized":"2023-05-11T07:37:16.789788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992759+0000","last_change":"2023-05-11T07:37:17.809276+0000","last_active":"2023-05-11T07:37:19.992759+0000","last_peered":"2023-05-11T07:37:19.992759+0000","last_clean":"2023-05-11T07:37:19.992759+0000","last_became_active":"2023-05-11T07:37:17.809035+0000","last_became_peered":"2023-05-11T07:37:17.809035+0000","last_unstale":"2023-05-11T07:37:19.992759+0000","last_undegraded":"2023-05-11T07:37:19.992759+0000","last_fullsized":"2023-05-11T07:37:19.992759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:20.856372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281811+0000","last_change":"2023-05-11T07:37:18.292506+0000","last_active":"2023-05-11T07:37:19.281811+0000","last_peered":"2023-05-11T07:37:19.281811+0000","last_clean":"2023-05-11T07:37:19.281811+0000","last_became_active":"2023-05-11T07:37:18.292151+0000","last_became_peered":"2023-05-11T07:37:18.292151+0000","last_unstale":"2023-05-11T07:37:19.281811+0000","last_undegraded":"2023-05-11T07:37:19.281811+0000","last_fullsized":"2023-05-11T07:37:19.281811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:57:57.495757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790037+0000","last_change":"2023-05-11T07:37:16.790037+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790037+0000","last_undegraded":"2023-05-11T07:37:16.790037+0000","last_fullsized":"2023-05-11T07:37:16.790037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993411+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:37:19.993411+0000","last_peered":"2023-05-11T07:37:19.993411+0000","last_clean":"2023-05-11T07:37:19.993411+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:37:19.993411+0000","last_undegraded":"2023-05-11T07:37:19.993411+0000","last_fullsized":"2023-05-11T07:37:19.993411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:54.361555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283895+0000","last_change":"2023-05-11T07:37:18.302712+0000","last_active":"2023-05-11T07:37:19.283895+0000","last_peered":"2023-05-11T07:37:19.283895+0000","last_clean":"2023-05-11T07:37:19.283895+0000","last_became_active":"2023-05-11T07:37:18.302367+0000","last_became_peered":"2023-05-11T07:37:18.302367+0000","last_unstale":"2023-05-11T07:37:19.283895+0000","last_undegraded":"2023-05-11T07:37:19.283895+0000","last_fullsized":"2023-05-11T07:37:19.283895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:23.623043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.988486+0000","last_change":"2023-05-11T07:37:17.806226+0000","last_active":"2023-05-11T07:37:19.988486+0000","last_peered":"2023-05-11T07:37:19.988486+0000","last_clean":"2023-05-11T07:37:19.988486+0000","last_became_active":"2023-05-11T07:37:17.805937+0000","last_became_peered":"2023-05-11T07:37:17.805937+0000","last_unstale":"2023-05-11T07:37:19.988486+0000","last_undegraded":"2023-05-11T07:37:19.988486+0000","last_fullsized":"2023-05-11T07:37:19.988486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991966+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:37:19.991966+0000","last_peered":"2023-05-11T07:37:19.991966+0000","last_clean":"2023-05-11T07:37:19.991966+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:37:19.991966+0000","last_undegraded":"2023-05-11T07:37:19.991966+0000","last_fullsized":"2023-05-11T07:37:19.991966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:00.155128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993579+0000","last_change":"2023-05-11T07:37:17.812286+0000","last_active":"2023-05-11T07:37:19.993579+0000","last_peered":"2023-05-11T07:37:19.993579+0000","last_clean":"2023-05-11T07:37:19.993579+0000","last_became_active":"2023-05-11T07:37:17.811876+0000","last_became_peered":"2023-05-11T07:37:17.811876+0000","last_unstale":"2023-05-11T07:37:19.993579+0000","last_undegraded":"2023-05-11T07:37:19.993579+0000","last_fullsized":"2023-05-11T07:37:19.993579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:26.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991425+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:37:19.991425+0000","last_peered":"2023-05-11T07:37:19.991425+0000","last_clean":"2023-05-11T07:37:19.991425+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:37:19.991425+0000","last_undegraded":"2023-05-11T07:37:19.991425+0000","last_fullsized":"2023-05-11T07:37:19.991425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:52:30.578344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992392+0000","last_change":"2023-05-11T07:37:17.804167+0000","last_active":"2023-05-11T07:37:19.992392+0000","last_peered":"2023-05-11T07:37:19.992392+0000","last_clean":"2023-05-11T07:37:19.992392+0000","last_became_active":"2023-05-11T07:37:17.803797+0000","last_became_peered":"2023-05-11T07:37:17.803797+0000","last_unstale":"2023-05-11T07:37:19.992392+0000","last_undegraded":"2023-05-11T07:37:19.992392+0000","last_fullsized":"2023-05-11T07:37:19.992392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:27.503714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991965+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:37:19.991965+0000","last_peered":"2023-05-11T07:37:19.991965+0000","last_clean":"2023-05-11T07:37:19.991965+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:37:19.991965+0000","last_undegraded":"2023-05-11T07:37:19.991965+0000","last_fullsized":"2023-05-11T07:37:19.991965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:38:09.432242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992843+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:37:19.992843+0000","last_peered":"2023-05-11T07:37:19.992843+0000","last_clean":"2023-05-11T07:37:19.992843+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:37:19.992843+0000","last_undegraded":"2023-05-11T07:37:19.992843+0000","last_fullsized":"2023-05-11T07:37:19.992843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:04.224988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993367+0000","last_change":"2023-05-11T07:37:18.294585+0000","last_active":"2023-05-11T07:37:19.993367+0000","last_peered":"2023-05-11T07:37:19.993367+0000","last_clean":"2023-05-11T07:37:19.993367+0000","last_became_active":"2023-05-11T07:37:18.294299+0000","last_became_peered":"2023-05-11T07:37:18.294299+0000","last_unstale":"2023-05-11T07:37:19.993367+0000","last_undegraded":"2023-05-11T07:37:19.993367+0000","last_fullsized":"2023-05-11T07:37:19.993367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993477+0000","last_change":"2023-05-11T07:37:17.800828+0000","last_active":"2023-05-11T07:37:19.993477+0000","last_peered":"2023-05-11T07:37:19.993477+0000","last_clean":"2023-05-11T07:37:19.993477+0000","last_became_active":"2023-05-11T07:37:17.800524+0000","last_became_peered":"2023-05-11T07:37:17.800524+0000","last_unstale":"2023-05-11T07:37:19.993477+0000","last_undegraded":"2023-05-11T07:37:19.993477+0000","last_fullsized":"2023-05-11T07:37:19.993477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:35.326768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992929+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:37:19.992929+0000","last_peered":"2023-05-11T07:37:19.992929+0000","last_clean":"2023-05-11T07:37:19.992929+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:37:19.992929+0000","last_undegraded":"2023-05-11T07:37:19.992929+0000","last_fullsized":"2023-05-11T07:37:19.992929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:56:55.436349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991922+0000","last_change":"2023-05-11T07:37:18.290604+0000","last_active":"2023-05-11T07:37:19.991922+0000","last_peered":"2023-05-11T07:37:19.991922+0000","last_clean":"2023-05-11T07:37:19.991922+0000","last_became_active":"2023-05-11T07:37:18.290265+0000","last_became_peered":"2023-05-11T07:37:18.290265+0000","last_unstale":"2023-05-11T07:37:19.991922+0000","last_undegraded":"2023-05-11T07:37:19.991922+0000","last_fullsized":"2023-05-11T07:37:19.991922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993255+0000","last_change":"2023-05-11T07:37:17.803117+0000","last_active":"2023-05-11T07:37:19.993255+0000","last_peered":"2023-05-11T07:37:19.993255+0000","last_clean":"2023-05-11T07:37:19.993255+0000","last_became_active":"2023-05-11T07:37:17.802884+0000","last_became_peered":"2023-05-11T07:37:17.802884+0000","last_unstale":"2023-05-11T07:37:19.993255+0000","last_undegraded":"2023-05-11T07:37:19.993255+0000","last_fullsized":"2023-05-11T07:37:19.993255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:30.669761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993568+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:37:19.993568+0000","last_peered":"2023-05-11T07:37:19.993568+0000","last_clean":"2023-05-11T07:37:19.993568+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:37:19.993568+0000","last_undegraded":"2023-05-11T07:37:19.993568+0000","last_fullsized":"2023-05-11T07:37:19.993568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:18.654496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986054+0000","last_change":"2023-05-11T07:37:18.296544+0000","last_active":"2023-05-11T07:37:19.986054+0000","last_peered":"2023-05-11T07:37:19.986054+0000","last_clean":"2023-05-11T07:37:19.986054+0000","last_became_active":"2023-05-11T07:37:18.295758+0000","last_became_peered":"2023-05-11T07:37:18.295758+0000","last_unstale":"2023-05-11T07:37:19.986054+0000","last_undegraded":"2023-05-11T07:37:19.986054+0000","last_fullsized":"2023-05-11T07:37:19.986054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:34:51.857400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281928+0000","last_change":"2023-05-11T07:37:17.805120+0000","last_active":"2023-05-11T07:37:19.281928+0000","last_peered":"2023-05-11T07:37:19.281928+0000","last_clean":"2023-05-11T07:37:19.281928+0000","last_became_active":"2023-05-11T07:37:17.804834+0000","last_became_peered":"2023-05-11T07:37:17.804834+0000","last_unstale":"2023-05-11T07:37:19.281928+0000","last_undegraded":"2023-05-11T07:37:19.281928+0000","last_fullsized":"2023-05-11T07:37:19.281928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:10:26.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993536+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:37:19.993536+0000","last_peered":"2023-05-11T07:37:19.993536+0000","last_clean":"2023-05-11T07:37:19.993536+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:37:19.993536+0000","last_undegraded":"2023-05-11T07:37:19.993536+0000","last_fullsized":"2023-05-11T07:37:19.993536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:21:18.916469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986122+0000","last_change":"2023-05-11T07:37:18.292755+0000","last_active":"2023-05-11T07:37:19.986122+0000","last_peered":"2023-05-11T07:37:19.986122+0000","last_clean":"2023-05-11T07:37:19.986122+0000","last_became_active":"2023-05-11T07:37:18.292496+0000","last_became_peered":"2023-05-11T07:37:18.292496+0000","last_unstale":"2023-05-11T07:37:19.986122+0000","last_undegraded":"2023-05-11T07:37:19.986122+0000","last_fullsized":"2023-05-11T07:37:19.986122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:21.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993267+0000","last_change":"2023-05-11T07:37:17.813490+0000","last_active":"2023-05-11T07:37:19.993267+0000","last_peered":"2023-05-11T07:37:19.993267+0000","last_clean":"2023-05-11T07:37:19.993267+0000","last_became_active":"2023-05-11T07:37:17.813185+0000","last_became_peered":"2023-05-11T07:37:17.813185+0000","last_unstale":"2023-05-11T07:37:19.993267+0000","last_undegraded":"2023-05-11T07:37:19.993267+0000","last_fullsized":"2023-05-11T07:37:19.993267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.284047+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:37:19.284047+0000","last_peered":"2023-05-11T07:37:19.284047+0000","last_clean":"2023-05-11T07:37:19.284047+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:37:19.284047+0000","last_undegraded":"2023-05-11T07:37:19.284047+0000","last_fullsized":"2023-05-11T07:37:19.284047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:22.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362248,"statfs":{"total":96636764160,"available":96626941952,"internally_reserved":0,"allocated":1032192,"data_stored":781005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.736000000000001,"5min":17.736000000000001,"15min":17.736000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":18.178000000000001,"5min":18.178000000000001,"15min":18.178000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":17.706,"5min":17.706,"15min":17.706},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":18.143999999999998,"5min":18.143999999999998,"15min":18.143999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.765000000000001,"5min":17.765000000000001,"15min":17.765000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":17.917999999999999,"5min":17.917999999999999,"15min":17.917999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":17.602,"5min":17.602,"15min":17.602},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":17.992999999999999,"5min":17.992999999999999,"15min":17.992999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":17.558,"5min":17.558,"15min":17.558},"last":0.628}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":17.960999999999999,"5min":17.960999999999999,"15min":17.960999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":14.349,"5min":14.349,"15min":14.349},"last":0.72499999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.745}]},{"osd":5,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":491520,"data_stored":213101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.313}]},{"osd":1,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.439},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.497}]},{"osd":6,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8668,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363172,"statfs":{"total":96636764160,"available":96627888128,"internally_reserved":0,"allocated":479232,"data_stored":211585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.436},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":12.396000000000001,"5min":12.396000000000001,"15min":12.396000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":12.429,"5min":12.429,"15min":12.429},"last":0.504}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.752},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.919,"5min":11.919,"15min":11.919},"last":0.627},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":12.329000000000001,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":12.051,"5min":12.051,"15min":12.051},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":12.287000000000001,"5min":12.287000000000001,"15min":12.287000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":12.016999999999999,"5min":12.016999999999999,"15min":12.016999999999999},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":0.44}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.623},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.746}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":495616,"data_stored":219160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.432},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:37:23.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:37:23.285 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.282+0000 7f152b7ff700 1 Processor -- start 2023-05-11T07:37:23.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.282+0000 7f152b7ff700 1 -- start start 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152b7ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f15240b52a0 0x7f15240d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152b7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240d02c0 0x7f15240d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152b7ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152415cef0 con 0x7f15240b87e0 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152b7ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240b5a80 con 0x7f15240b52a0 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152b7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240cdf70 con 0x7f15240d02c0 2023-05-11T07:37:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f1528d9a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f15240b52a0 0x7f15240d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152959b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f15240b87e0 0x7f15240b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41616/0 (socket says 172.21.15.144:41616) 2023-05-11T07:37:23.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.283+0000 7f152959b700 1 -- 172.21.15.144:0/1850980255 learned_addr learned my addr 172.21.15.144:0/1850980255 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:23.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1529d9c700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240d02c0 0x7f15240d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1528d9a700 1 -- 172.21.15.144:0/1850980255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240d02c0 msgr2=0x7f15240d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:23.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1528d9a700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240d02c0 0x7f15240d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1528d9a700 1 -- 172.21.15.144:0/1850980255 >> v1:172.21.15.144:6789/0 conn(0x7f15240b87e0 legacy=0x7f15240b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1528d9a700 1 -- 172.21.15.144:0/1850980255 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240cd760 con 0x7f15240b52a0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f151bfff700 1 -- 172.21.15.144:0/1850980255 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666799733 0 0) 0x7f1520001110 con 0x7f15240b87e0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f1528d9a700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240b52a0 0x7f15240d2090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1514009840 tx=0x7f1514009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150c7c38f92d6ab8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f151bfff700 1 -- 172.21.15.144:0/1850980255 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011830 con 0x7f15240b52a0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f151bfff700 1 -- 172.21.15.144:0/1850980255 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514011990 con 0x7f15240b52a0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.284+0000 7f151bfff700 1 -- 172.21.15.144:0/1850980255 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011d20 con 0x7f15240b52a0 2023-05-11T07:37:23.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 -- 172.21.15.144:0/1850980255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240b52a0 msgr2=0x7f15240d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240b52a0 0x7f15240d2090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1514009840 tx=0x7f1514009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 -- 172.21.15.144:0/1850980255 shutdown_connections 2023-05-11T07:37:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240d02c0 0x7f15240d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 --2- 172.21.15.144:0/1850980255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240b52a0 0x7f15240d2090 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 -- 172.21.15.144:0/1850980255 >> 172.21.15.144:0/1850980255 conn(0x7f152406acf0 msgr2=0x7f152406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:23.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 -- 172.21.15.144:0/1850980255 shutdown_connections 2023-05-11T07:37:23.293 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.285+0000 7f152b7ff700 1 -- 172.21.15.144:0/1850980255 wait complete. 2023-05-11T07:37:23.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.287+0000 7f152b7ff700 1 Processor -- start 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.287+0000 7f152b7ff700 1 -- start start 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240b52a0 0x7f1524159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15240b87e0 0x7f15240c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240ca830 con 0x7f15240d02c0 2023-05-11T07:37:23.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152415a010 con 0x7f15240b87e0 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.288+0000 7f152b7ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240c9b40 con 0x7f15240b52a0 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f152959b700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240b52a0 0x7f1524159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41938/0 (socket says 172.21.15.144:41938) 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 -- 172.21.15.144:0/3627322795 learned_addr learned my addr 172.21.15.144:0/3627322795 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1528d9a700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15240b87e0 0x7f15240c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 -- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240b52a0 msgr2=0x7f1524159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240b52a0 0x7f1524159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 -- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15240b87e0 msgr2=0x7f15240c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15240b87e0 0x7f15240c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 -- 172.21.15.144:0/3627322795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140094a0 con 0x7f15240d02c0 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.289+0000 7f1529d9c700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f151c00efc0 tx=0x7f151c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.290+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00cad0 con 0x7f15240d02c0 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.290+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00f040 con 0x7f15240d02c0 2023-05-11T07:37:23.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.290+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15240cd9b0 con 0x7f15240d02c0 2023-05-11T07:37:23.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.290+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ce70 con 0x7f15240d02c0 2023-05-11T07:37:23.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.290+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15240d2d30 con 0x7f15240d02c0 2023-05-11T07:37:23.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.291+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240cdc90 con 0x7f15240d02c0 2023-05-11T07:37:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.292+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f151c014480 con 0x7f15240d02c0 2023-05-11T07:37:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.292+0000 7f1519ffb700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 0x7f150806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.293+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f151c089df0 con 0x7f15240d02c0 2023-05-11T07:37:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.293+0000 7f152959b700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 0x7f150806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.299 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.293+0000 7f152959b700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 0x7f150806d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1520000f60 tx=0x7f1520007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.300 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.297+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f151c054d70 con 0x7f15240d02c0 2023-05-11T07:37:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.486+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f152408b830 con 0x7f150806ace0 2023-05-11T07:37:23.498 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.495+0000 7f1519ffb700 1 -- 172.21.15.144:0/3627322795 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308278 (secure 0 0 0) 0x7f152408b830 con 0x7f150806ace0 2023-05-11T07:37:23.501 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 msgr2=0x7f150806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 0x7f150806d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1520000f60 tx=0x7f1520007c20 comp rx=0 tx=0).stop 2023-05-11T07:37:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 msgr2=0x7f15241f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f151c00efc0 tx=0x7f151c00c0c0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 shutdown_connections 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f150806ace0 0x7f150806d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f15240b52a0 0x7f1524159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15240d02c0 0x7f15241f2cb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 --2- 172.21.15.144:0/3627322795 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15240b87e0 0x7f15240c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 >> 172.21.15.144:0/3627322795 conn(0x7f152406acf0 msgr2=0x7f15240b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:23.504 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 shutdown_connections 2023-05-11T07:37:23.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.499+0000 7f152b7ff700 1 -- 172.21.15.144:0/3627322795 wait complete. 2023-05-11T07:37:23.505 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:37:23.521 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-05-11T07:37:21.735896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71516,"kb_used_data":4956,"kb_used_omap":0,"kb_used_meta":66496,"kb_avail":754903204,"statfs":{"total":773094113280,"available":773020880896,"internally_reserved":0,"allocated":5074944,"data_stored":2891533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68091904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.955814"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:18.291434+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:18.291148+0000","last_became_peered":"2023-05-11T07:37:18.291148+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:22.530712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992276+0000","last_change":"2023-05-11T07:37:18.301388+0000","last_active":"2023-05-11T07:37:19.992276+0000","last_peered":"2023-05-11T07:37:19.992276+0000","last_clean":"2023-05-11T07:37:19.992276+0000","last_became_active":"2023-05-11T07:37:18.301121+0000","last_became_peered":"2023-05-11T07:37:18.301121+0000","last_unstale":"2023-05-11T07:37:19.992276+0000","last_undegraded":"2023-05-11T07:37:19.992276+0000","last_fullsized":"2023-05-11T07:37:19.992276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:49:47.667555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282046+0000","last_change":"2023-05-11T07:37:18.292177+0000","last_active":"2023-05-11T07:37:19.282046+0000","last_peered":"2023-05-11T07:37:19.282046+0000","last_clean":"2023-05-11T07:37:19.282046+0000","last_became_active":"2023-05-11T07:37:18.291845+0000","last_became_peered":"2023-05-11T07:37:18.291845+0000","last_unstale":"2023-05-11T07:37:19.282046+0000","last_undegraded":"2023-05-11T07:37:19.282046+0000","last_fullsized":"2023-05-11T07:37:19.282046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:23.945011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991955+0000","last_change":"2023-05-11T07:37:18.301367+0000","last_active":"2023-05-11T07:37:19.991955+0000","last_peered":"2023-05-11T07:37:19.991955+0000","last_clean":"2023-05-11T07:37:19.991955+0000","last_became_active":"2023-05-11T07:37:18.301084+0000","last_became_peered":"2023-05-11T07:37:18.301084+0000","last_unstale":"2023-05-11T07:37:19.991955+0000","last_undegraded":"2023-05-11T07:37:19.991955+0000","last_fullsized":"2023-05-11T07:37:19.991955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985990+0000","last_change":"2023-05-11T07:37:18.294756+0000","last_active":"2023-05-11T07:37:19.985990+0000","last_peered":"2023-05-11T07:37:19.985990+0000","last_clean":"2023-05-11T07:37:19.985990+0000","last_became_active":"2023-05-11T07:37:18.294511+0000","last_became_peered":"2023-05-11T07:37:18.294511+0000","last_unstale":"2023-05-11T07:37:19.985990+0000","last_undegraded":"2023-05-11T07:37:19.985990+0000","last_fullsized":"2023-05-11T07:37:19.985990+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:05:29.224864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993012+0000","last_change":"2023-05-11T07:37:18.292016+0000","last_active":"2023-05-11T07:37:19.993012+0000","last_peered":"2023-05-11T07:37:19.993012+0000","last_clean":"2023-05-11T07:37:19.993012+0000","last_became_active":"2023-05-11T07:37:18.291768+0000","last_became_peered":"2023-05-11T07:37:18.291768+0000","last_unstale":"2023-05-11T07:37:19.993012+0000","last_undegraded":"2023-05-11T07:37:19.993012+0000","last_fullsized":"2023-05-11T07:37:19.993012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:42.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992369+0000","last_change":"2023-05-11T07:37:18.296188+0000","last_active":"2023-05-11T07:37:19.992369+0000","last_peered":"2023-05-11T07:37:19.992369+0000","last_clean":"2023-05-11T07:37:19.992369+0000","last_became_active":"2023-05-11T07:37:18.295883+0000","last_became_peered":"2023-05-11T07:37:18.295883+0000","last_unstale":"2023-05-11T07:37:19.992369+0000","last_undegraded":"2023-05-11T07:37:19.992369+0000","last_fullsized":"2023-05-11T07:37:19.992369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:11:59.401409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991859+0000","last_change":"2023-05-11T07:37:18.290472+0000","last_active":"2023-05-11T07:37:19.991859+0000","last_peered":"2023-05-11T07:37:19.991859+0000","last_clean":"2023-05-11T07:37:19.991859+0000","last_became_active":"2023-05-11T07:37:18.290200+0000","last_became_peered":"2023-05-11T07:37:18.290200+0000","last_unstale":"2023-05-11T07:37:19.991859+0000","last_undegraded":"2023-05-11T07:37:19.991859+0000","last_fullsized":"2023-05-11T07:37:19.991859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:04:09.879877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985989+0000","last_change":"2023-05-11T07:37:18.295459+0000","last_active":"2023-05-11T07:37:19.985989+0000","last_peered":"2023-05-11T07:37:19.985989+0000","last_clean":"2023-05-11T07:37:19.985989+0000","last_became_active":"2023-05-11T07:37:18.295061+0000","last_became_peered":"2023-05-11T07:37:18.295061+0000","last_unstale":"2023-05-11T07:37:19.985989+0000","last_undegraded":"2023-05-11T07:37:19.985989+0000","last_fullsized":"2023-05-11T07:37:19.985989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:34.937633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283239+0000","last_change":"2023-05-11T07:37:18.309208+0000","last_active":"2023-05-11T07:37:19.283239+0000","last_peered":"2023-05-11T07:37:19.283239+0000","last_clean":"2023-05-11T07:37:19.283239+0000","last_became_active":"2023-05-11T07:37:18.308913+0000","last_became_peered":"2023-05-11T07:37:18.308913+0000","last_unstale":"2023-05-11T07:37:19.283239+0000","last_undegraded":"2023-05-11T07:37:19.283239+0000","last_fullsized":"2023-05-11T07:37:19.283239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:00:43.186311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282224+0000","last_change":"2023-05-11T07:37:18.292799+0000","last_active":"2023-05-11T07:37:19.282224+0000","last_peered":"2023-05-11T07:37:19.282224+0000","last_clean":"2023-05-11T07:37:19.282224+0000","last_became_active":"2023-05-11T07:37:18.292476+0000","last_became_peered":"2023-05-11T07:37:18.292476+0000","last_unstale":"2023-05-11T07:37:19.282224+0000","last_undegraded":"2023-05-11T07:37:19.282224+0000","last_fullsized":"2023-05-11T07:37:19.282224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:22:36.881963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282065+0000","last_change":"2023-05-11T07:37:18.297272+0000","last_active":"2023-05-11T07:37:19.282065+0000","last_peered":"2023-05-11T07:37:19.282065+0000","last_clean":"2023-05-11T07:37:19.282065+0000","last_became_active":"2023-05-11T07:37:18.296933+0000","last_became_peered":"2023-05-11T07:37:18.296933+0000","last_unstale":"2023-05-11T07:37:19.282065+0000","last_undegraded":"2023-05-11T07:37:19.282065+0000","last_fullsized":"2023-05-11T07:37:19.282065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:01:15.986745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283687+0000","last_change":"2023-05-11T07:37:18.288933+0000","last_active":"2023-05-11T07:37:19.283687+0000","last_peered":"2023-05-11T07:37:19.283687+0000","last_clean":"2023-05-11T07:37:19.283687+0000","last_became_active":"2023-05-11T07:37:18.288605+0000","last_became_peered":"2023-05-11T07:37:18.288605+0000","last_unstale":"2023-05-11T07:37:19.283687+0000","last_undegraded":"2023-05-11T07:37:19.283687+0000","last_fullsized":"2023-05-11T07:37:19.283687+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:10:53.147958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992012+0000","last_change":"2023-05-11T07:37:18.304107+0000","last_active":"2023-05-11T07:37:19.992012+0000","last_peered":"2023-05-11T07:37:19.992012+0000","last_clean":"2023-05-11T07:37:19.992012+0000","last_became_active":"2023-05-11T07:37:18.303874+0000","last_became_peered":"2023-05-11T07:37:18.303874+0000","last_unstale":"2023-05-11T07:37:19.992012+0000","last_undegraded":"2023-05-11T07:37:19.992012+0000","last_fullsized":"2023-05-11T07:37:19.992012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:30.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986014+0000","last_change":"2023-05-11T07:37:18.296702+0000","last_active":"2023-05-11T07:37:19.986014+0000","last_peered":"2023-05-11T07:37:19.986014+0000","last_clean":"2023-05-11T07:37:19.986014+0000","last_became_active":"2023-05-11T07:37:18.296227+0000","last_became_peered":"2023-05-11T07:37:18.296227+0000","last_unstale":"2023-05-11T07:37:19.986014+0000","last_undegraded":"2023-05-11T07:37:19.986014+0000","last_fullsized":"2023-05-11T07:37:19.986014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:35:20.212233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283252+0000","last_change":"2023-05-11T07:37:18.287465+0000","last_active":"2023-05-11T07:37:19.283252+0000","last_peered":"2023-05-11T07:37:19.283252+0000","last_clean":"2023-05-11T07:37:19.283252+0000","last_became_active":"2023-05-11T07:37:18.286165+0000","last_became_peered":"2023-05-11T07:37:18.286165+0000","last_unstale":"2023-05-11T07:37:19.283252+0000","last_undegraded":"2023-05-11T07:37:19.283252+0000","last_fullsized":"2023-05-11T07:37:19.283252+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:45:47.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283293+0000","last_change":"2023-05-11T07:37:18.286561+0000","last_active":"2023-05-11T07:37:19.283293+0000","last_peered":"2023-05-11T07:37:19.283293+0000","last_clean":"2023-05-11T07:37:19.283293+0000","last_became_active":"2023-05-11T07:37:18.286216+0000","last_became_peered":"2023-05-11T07:37:18.286216+0000","last_unstale":"2023-05-11T07:37:19.283293+0000","last_undegraded":"2023-05-11T07:37:19.283293+0000","last_fullsized":"2023-05-11T07:37:19.283293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:27:51.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283989+0000","last_change":"2023-05-11T07:37:18.286834+0000","last_active":"2023-05-11T07:37:19.283989+0000","last_peered":"2023-05-11T07:37:19.283989+0000","last_clean":"2023-05-11T07:37:19.283989+0000","last_became_active":"2023-05-11T07:37:18.286568+0000","last_became_peered":"2023-05-11T07:37:18.286568+0000","last_unstale":"2023-05-11T07:37:19.283989+0000","last_undegraded":"2023-05-11T07:37:19.283989+0000","last_fullsized":"2023-05-11T07:37:19.283989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:46.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992099+0000","last_change":"2023-05-11T07:37:18.290513+0000","last_active":"2023-05-11T07:37:19.992099+0000","last_peered":"2023-05-11T07:37:19.992099+0000","last_clean":"2023-05-11T07:37:19.992099+0000","last_became_active":"2023-05-11T07:37:18.290222+0000","last_became_peered":"2023-05-11T07:37:18.290222+0000","last_unstale":"2023-05-11T07:37:19.992099+0000","last_undegraded":"2023-05-11T07:37:19.992099+0000","last_fullsized":"2023-05-11T07:37:19.992099+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:01.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282119+0000","last_change":"2023-05-11T07:37:18.289912+0000","last_active":"2023-05-11T07:37:19.282119+0000","last_peered":"2023-05-11T07:37:19.282119+0000","last_clean":"2023-05-11T07:37:19.282119+0000","last_became_active":"2023-05-11T07:37:18.289607+0000","last_became_peered":"2023-05-11T07:37:18.289607+0000","last_unstale":"2023-05-11T07:37:19.282119+0000","last_undegraded":"2023-05-11T07:37:19.282119+0000","last_fullsized":"2023-05-11T07:37:19.282119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:26:38.690549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992184+0000","last_change":"2023-05-11T07:37:18.296428+0000","last_active":"2023-05-11T07:37:19.992184+0000","last_peered":"2023-05-11T07:37:19.992184+0000","last_clean":"2023-05-11T07:37:19.992184+0000","last_became_active":"2023-05-11T07:37:18.296133+0000","last_became_peered":"2023-05-11T07:37:18.296133+0000","last_unstale":"2023-05-11T07:37:19.992184+0000","last_undegraded":"2023-05-11T07:37:19.992184+0000","last_fullsized":"2023-05-11T07:37:19.992184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:53:03.634364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283703+0000","last_change":"2023-05-11T07:37:18.286553+0000","last_active":"2023-05-11T07:37:19.283703+0000","last_peered":"2023-05-11T07:37:19.283703+0000","last_clean":"2023-05-11T07:37:19.283703+0000","last_became_active":"2023-05-11T07:37:18.286235+0000","last_became_peered":"2023-05-11T07:37:18.286235+0000","last_unstale":"2023-05-11T07:37:19.283703+0000","last_undegraded":"2023-05-11T07:37:19.283703+0000","last_fullsized":"2023-05-11T07:37:19.283703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:47:38.913921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281787+0000","last_change":"2023-05-11T07:37:18.291946+0000","last_active":"2023-05-11T07:37:19.281787+0000","last_peered":"2023-05-11T07:37:19.281787+0000","last_clean":"2023-05-11T07:37:19.281787+0000","last_became_active":"2023-05-11T07:37:18.291346+0000","last_became_peered":"2023-05-11T07:37:18.291346+0000","last_unstale":"2023-05-11T07:37:19.281787+0000","last_undegraded":"2023-05-11T07:37:19.281787+0000","last_fullsized":"2023-05-11T07:37:19.281787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:26:34.365278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985821+0000","last_change":"2023-05-11T07:37:18.298118+0000","last_active":"2023-05-11T07:37:19.985821+0000","last_peered":"2023-05-11T07:37:19.985821+0000","last_clean":"2023-05-11T07:37:19.985821+0000","last_became_active":"2023-05-11T07:37:18.297866+0000","last_became_peered":"2023-05-11T07:37:18.297866+0000","last_unstale":"2023-05-11T07:37:19.985821+0000","last_undegraded":"2023-05-11T07:37:19.985821+0000","last_fullsized":"2023-05-11T07:37:19.985821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991682+0000","last_change":"2023-05-11T07:37:18.291309+0000","last_active":"2023-05-11T07:37:19.991682+0000","last_peered":"2023-05-11T07:37:19.991682+0000","last_clean":"2023-05-11T07:37:19.991682+0000","last_became_active":"2023-05-11T07:37:18.290864+0000","last_became_peered":"2023-05-11T07:37:18.290864+0000","last_unstale":"2023-05-11T07:37:19.991682+0000","last_undegraded":"2023-05-11T07:37:19.991682+0000","last_fullsized":"2023-05-11T07:37:19.991682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:16.444730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993415+0000","last_change":"2023-05-11T07:37:18.292054+0000","last_active":"2023-05-11T07:37:19.993415+0000","last_peered":"2023-05-11T07:37:19.993415+0000","last_clean":"2023-05-11T07:37:19.993415+0000","last_became_active":"2023-05-11T07:37:18.291805+0000","last_became_peered":"2023-05-11T07:37:18.291805+0000","last_unstale":"2023-05-11T07:37:19.993415+0000","last_undegraded":"2023-05-11T07:37:19.993415+0000","last_fullsized":"2023-05-11T07:37:19.993415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:19.430601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986353+0000","last_change":"2023-05-11T07:37:17.813384+0000","last_active":"2023-05-11T07:37:19.986353+0000","last_peered":"2023-05-11T07:37:19.986353+0000","last_clean":"2023-05-11T07:37:19.986353+0000","last_became_active":"2023-05-11T07:37:17.813112+0000","last_became_peered":"2023-05-11T07:37:17.813112+0000","last_unstale":"2023-05-11T07:37:19.986353+0000","last_undegraded":"2023-05-11T07:37:19.986353+0000","last_fullsized":"2023-05-11T07:37:19.986353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283875+0000","last_change":"2023-05-11T07:37:18.294542+0000","last_active":"2023-05-11T07:37:19.283875+0000","last_peered":"2023-05-11T07:37:19.283875+0000","last_clean":"2023-05-11T07:37:19.283875+0000","last_became_active":"2023-05-11T07:37:18.294147+0000","last_became_peered":"2023-05-11T07:37:18.294147+0000","last_unstale":"2023-05-11T07:37:19.283875+0000","last_undegraded":"2023-05-11T07:37:19.283875+0000","last_fullsized":"2023-05-11T07:37:19.283875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:21:00.891302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282310+0000","last_change":"2023-05-11T07:37:17.803783+0000","last_active":"2023-05-11T07:37:19.282310+0000","last_peered":"2023-05-11T07:37:19.282310+0000","last_clean":"2023-05-11T07:37:19.282310+0000","last_became_active":"2023-05-11T07:37:17.803516+0000","last_became_peered":"2023-05-11T07:37:17.803516+0000","last_unstale":"2023-05-11T07:37:19.282310+0000","last_undegraded":"2023-05-11T07:37:19.282310+0000","last_fullsized":"2023-05-11T07:37:19.282310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:30:54.188343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992197+0000","last_change":"2023-05-11T07:37:18.292075+0000","last_active":"2023-05-11T07:37:19.992197+0000","last_peered":"2023-05-11T07:37:19.992197+0000","last_clean":"2023-05-11T07:37:19.992197+0000","last_became_active":"2023-05-11T07:37:18.291815+0000","last_became_peered":"2023-05-11T07:37:18.291815+0000","last_unstale":"2023-05-11T07:37:19.992197+0000","last_undegraded":"2023-05-11T07:37:19.992197+0000","last_fullsized":"2023-05-11T07:37:19.992197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:27.787504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993639+0000","last_change":"2023-05-11T07:37:17.803729+0000","last_active":"2023-05-11T07:37:19.993639+0000","last_peered":"2023-05-11T07:37:19.993639+0000","last_clean":"2023-05-11T07:37:19.993639+0000","last_became_active":"2023-05-11T07:37:17.803491+0000","last_became_peered":"2023-05-11T07:37:17.803491+0000","last_unstale":"2023-05-11T07:37:19.993639+0000","last_undegraded":"2023-05-11T07:37:19.993639+0000","last_fullsized":"2023-05-11T07:37:19.993639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:52.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993604+0000","last_change":"2023-05-11T07:37:18.289175+0000","last_active":"2023-05-11T07:37:19.993604+0000","last_peered":"2023-05-11T07:37:19.993604+0000","last_clean":"2023-05-11T07:37:19.993604+0000","last_became_active":"2023-05-11T07:37:18.287810+0000","last_became_peered":"2023-05-11T07:37:18.287810+0000","last_unstale":"2023-05-11T07:37:19.993604+0000","last_undegraded":"2023-05-11T07:37:19.993604+0000","last_fullsized":"2023-05-11T07:37:19.993604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:39.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:17.813722+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:17.813440+0000","last_became_peered":"2023-05-11T07:37:17.813440+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281890+0000","last_change":"2023-05-11T07:37:18.291751+0000","last_active":"2023-05-11T07:37:19.281890+0000","last_peered":"2023-05-11T07:37:19.281890+0000","last_clean":"2023-05-11T07:37:19.281890+0000","last_became_active":"2023-05-11T07:37:18.291049+0000","last_became_peered":"2023-05-11T07:37:18.291049+0000","last_unstale":"2023-05-11T07:37:19.281890+0000","last_undegraded":"2023-05-11T07:37:19.281890+0000","last_fullsized":"2023-05-11T07:37:19.281890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:24.836884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986327+0000","last_change":"2023-05-11T07:37:17.809016+0000","last_active":"2023-05-11T07:37:19.986327+0000","last_peered":"2023-05-11T07:37:19.986327+0000","last_clean":"2023-05-11T07:37:19.986327+0000","last_became_active":"2023-05-11T07:37:17.808761+0000","last_became_peered":"2023-05-11T07:37:17.808761+0000","last_unstale":"2023-05-11T07:37:19.986327+0000","last_undegraded":"2023-05-11T07:37:19.986327+0000","last_fullsized":"2023-05-11T07:37:19.986327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282053+0000","last_change":"2023-05-11T07:37:17.802629+0000","last_active":"2023-05-11T07:37:19.282053+0000","last_peered":"2023-05-11T07:37:19.282053+0000","last_clean":"2023-05-11T07:37:19.282053+0000","last_became_active":"2023-05-11T07:37:17.802309+0000","last_became_peered":"2023-05-11T07:37:17.802309+0000","last_unstale":"2023-05-11T07:37:19.282053+0000","last_undegraded":"2023-05-11T07:37:19.282053+0000","last_fullsized":"2023-05-11T07:37:19.282053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:37.107122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991960+0000","last_change":"2023-05-11T07:37:17.806893+0000","last_active":"2023-05-11T07:37:19.991960+0000","last_peered":"2023-05-11T07:37:19.991960+0000","last_clean":"2023-05-11T07:37:19.991960+0000","last_became_active":"2023-05-11T07:37:17.806550+0000","last_became_peered":"2023-05-11T07:37:17.806550+0000","last_unstale":"2023-05-11T07:37:19.991960+0000","last_undegraded":"2023-05-11T07:37:19.991960+0000","last_fullsized":"2023-05-11T07:37:19.991960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:21.524193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283429+0000","last_change":"2023-05-11T07:37:18.285399+0000","last_active":"2023-05-11T07:37:19.283429+0000","last_peered":"2023-05-11T07:37:19.283429+0000","last_clean":"2023-05-11T07:37:19.283429+0000","last_became_active":"2023-05-11T07:37:18.284955+0000","last_became_peered":"2023-05-11T07:37:18.284955+0000","last_unstale":"2023-05-11T07:37:19.283429+0000","last_undegraded":"2023-05-11T07:37:19.283429+0000","last_fullsized":"2023-05-11T07:37:19.283429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:24:56.109130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790686+0000","last_change":"2023-05-11T07:37:16.790686+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790686+0000","last_undegraded":"2023-05-11T07:37:16.790686+0000","last_fullsized":"2023-05-11T07:37:16.790686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282230+0000","last_change":"2023-05-11T07:37:18.296389+0000","last_active":"2023-05-11T07:37:19.282230+0000","last_peered":"2023-05-11T07:37:19.282230+0000","last_clean":"2023-05-11T07:37:19.282230+0000","last_became_active":"2023-05-11T07:37:18.296111+0000","last_became_peered":"2023-05-11T07:37:18.296111+0000","last_unstale":"2023-05-11T07:37:19.282230+0000","last_undegraded":"2023-05-11T07:37:19.282230+0000","last_fullsized":"2023-05-11T07:37:19.282230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:27:41.360370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282315+0000","last_change":"2023-05-11T07:37:17.801337+0000","last_active":"2023-05-11T07:37:19.282315+0000","last_peered":"2023-05-11T07:37:19.282315+0000","last_clean":"2023-05-11T07:37:19.282315+0000","last_became_active":"2023-05-11T07:37:17.800991+0000","last_became_peered":"2023-05-11T07:37:17.800991+0000","last_unstale":"2023-05-11T07:37:19.282315+0000","last_undegraded":"2023-05-11T07:37:19.282315+0000","last_fullsized":"2023-05-11T07:37:19.282315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:46.905451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993466+0000","last_change":"2023-05-11T07:37:18.295004+0000","last_active":"2023-05-11T07:37:19.993466+0000","last_peered":"2023-05-11T07:37:19.993466+0000","last_clean":"2023-05-11T07:37:19.993466+0000","last_became_active":"2023-05-11T07:37:18.294741+0000","last_became_peered":"2023-05-11T07:37:18.294741+0000","last_unstale":"2023-05-11T07:37:19.993466+0000","last_undegraded":"2023-05-11T07:37:19.993466+0000","last_fullsized":"2023-05-11T07:37:19.993466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:54.412110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790337+0000","last_change":"2023-05-11T07:37:16.790337+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790337+0000","last_undegraded":"2023-05-11T07:37:16.790337+0000","last_fullsized":"2023-05-11T07:37:16.790337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986228+0000","last_change":"2023-05-11T07:37:18.293624+0000","last_active":"2023-05-11T07:37:19.986228+0000","last_peered":"2023-05-11T07:37:19.986228+0000","last_clean":"2023-05-11T07:37:19.986228+0000","last_became_active":"2023-05-11T07:37:18.293346+0000","last_became_peered":"2023-05-11T07:37:18.293346+0000","last_unstale":"2023-05-11T07:37:19.986228+0000","last_undegraded":"2023-05-11T07:37:19.986228+0000","last_fullsized":"2023-05-11T07:37:19.986228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993508+0000","last_change":"2023-05-11T07:37:17.813482+0000","last_active":"2023-05-11T07:37:19.993508+0000","last_peered":"2023-05-11T07:37:19.993508+0000","last_clean":"2023-05-11T07:37:19.993508+0000","last_became_active":"2023-05-11T07:37:17.813163+0000","last_became_peered":"2023-05-11T07:37:17.813163+0000","last_unstale":"2023-05-11T07:37:19.993508+0000","last_undegraded":"2023-05-11T07:37:19.993508+0000","last_fullsized":"2023-05-11T07:37:19.993508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:16:44.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993281+0000","last_change":"2023-05-11T07:37:18.290528+0000","last_active":"2023-05-11T07:37:19.993281+0000","last_peered":"2023-05-11T07:37:19.993281+0000","last_clean":"2023-05-11T07:37:19.993281+0000","last_became_active":"2023-05-11T07:37:18.290251+0000","last_became_peered":"2023-05-11T07:37:18.290251+0000","last_unstale":"2023-05-11T07:37:19.993281+0000","last_undegraded":"2023-05-11T07:37:19.993281+0000","last_fullsized":"2023-05-11T07:37:19.993281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992148+0000","last_change":"2023-05-11T07:37:17.804935+0000","last_active":"2023-05-11T07:37:19.992148+0000","last_peered":"2023-05-11T07:37:19.992148+0000","last_clean":"2023-05-11T07:37:19.992148+0000","last_became_active":"2023-05-11T07:37:17.804595+0000","last_became_peered":"2023-05-11T07:37:17.804595+0000","last_unstale":"2023-05-11T07:37:19.992148+0000","last_undegraded":"2023-05-11T07:37:19.992148+0000","last_fullsized":"2023-05-11T07:37:19.992148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:23:20.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283296+0000","last_change":"2023-05-11T07:37:18.302703+0000","last_active":"2023-05-11T07:37:19.283296+0000","last_peered":"2023-05-11T07:37:19.283296+0000","last_clean":"2023-05-11T07:37:19.283296+0000","last_became_active":"2023-05-11T07:37:18.302276+0000","last_became_peered":"2023-05-11T07:37:18.302276+0000","last_unstale":"2023-05-11T07:37:19.283296+0000","last_undegraded":"2023-05-11T07:37:19.283296+0000","last_fullsized":"2023-05-11T07:37:19.283296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:53:03.341271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986180+0000","last_change":"2023-05-11T07:37:17.805056+0000","last_active":"2023-05-11T07:37:19.986180+0000","last_peered":"2023-05-11T07:37:19.986180+0000","last_clean":"2023-05-11T07:37:19.986180+0000","last_became_active":"2023-05-11T07:37:17.804788+0000","last_became_peered":"2023-05-11T07:37:17.804788+0000","last_unstale":"2023-05-11T07:37:19.986180+0000","last_undegraded":"2023-05-11T07:37:19.986180+0000","last_fullsized":"2023-05-11T07:37:19.986180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:55.002267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993056+0000","last_change":"2023-05-11T07:37:17.809230+0000","last_active":"2023-05-11T07:37:19.993056+0000","last_peered":"2023-05-11T07:37:19.993056+0000","last_clean":"2023-05-11T07:37:19.993056+0000","last_became_active":"2023-05-11T07:37:17.808956+0000","last_became_peered":"2023-05-11T07:37:17.808956+0000","last_unstale":"2023-05-11T07:37:19.993056+0000","last_undegraded":"2023-05-11T07:37:19.993056+0000","last_fullsized":"2023-05-11T07:37:19.993056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985829+0000","last_change":"2023-05-11T07:37:18.293684+0000","last_active":"2023-05-11T07:37:19.985829+0000","last_peered":"2023-05-11T07:37:19.985829+0000","last_clean":"2023-05-11T07:37:19.985829+0000","last_became_active":"2023-05-11T07:37:18.293412+0000","last_became_peered":"2023-05-11T07:37:18.293412+0000","last_unstale":"2023-05-11T07:37:19.985829+0000","last_undegraded":"2023-05-11T07:37:19.985829+0000","last_fullsized":"2023-05-11T07:37:19.985829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985944+0000","last_change":"2023-05-11T07:37:17.804908+0000","last_active":"2023-05-11T07:37:19.985944+0000","last_peered":"2023-05-11T07:37:19.985944+0000","last_clean":"2023-05-11T07:37:19.985944+0000","last_became_active":"2023-05-11T07:37:17.804649+0000","last_became_peered":"2023-05-11T07:37:17.804649+0000","last_unstale":"2023-05-11T07:37:19.985944+0000","last_undegraded":"2023-05-11T07:37:19.985944+0000","last_fullsized":"2023-05-11T07:37:19.985944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992957+0000","last_change":"2023-05-11T07:37:18.286709+0000","last_active":"2023-05-11T07:37:19.992957+0000","last_peered":"2023-05-11T07:37:19.992957+0000","last_clean":"2023-05-11T07:37:19.992957+0000","last_became_active":"2023-05-11T07:37:18.286345+0000","last_became_peered":"2023-05-11T07:37:18.286345+0000","last_unstale":"2023-05-11T07:37:19.992957+0000","last_undegraded":"2023-05-11T07:37:19.992957+0000","last_fullsized":"2023-05-11T07:37:19.992957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790303+0000","last_change":"2023-05-11T07:37:16.790303+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790303+0000","last_undegraded":"2023-05-11T07:37:16.790303+0000","last_fullsized":"2023-05-11T07:37:16.790303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991825+0000","last_change":"2023-05-11T07:37:18.294767+0000","last_active":"2023-05-11T07:37:19.991825+0000","last_peered":"2023-05-11T07:37:19.991825+0000","last_clean":"2023-05-11T07:37:19.991825+0000","last_became_active":"2023-05-11T07:37:18.294516+0000","last_became_peered":"2023-05-11T07:37:18.294516+0000","last_unstale":"2023-05-11T07:37:19.991825+0000","last_undegraded":"2023-05-11T07:37:19.991825+0000","last_fullsized":"2023-05-11T07:37:19.991825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:30:18.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991981+0000","last_change":"2023-05-11T07:37:17.802776+0000","last_active":"2023-05-11T07:37:19.991981+0000","last_peered":"2023-05-11T07:37:19.991981+0000","last_clean":"2023-05-11T07:37:19.991981+0000","last_became_active":"2023-05-11T07:37:17.802533+0000","last_became_peered":"2023-05-11T07:37:17.802533+0000","last_unstale":"2023-05-11T07:37:19.991981+0000","last_undegraded":"2023-05-11T07:37:19.991981+0000","last_fullsized":"2023-05-11T07:37:19.991981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:49:16.959783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282198+0000","last_change":"2023-05-11T07:37:17.801549+0000","last_active":"2023-05-11T07:37:19.282198+0000","last_peered":"2023-05-11T07:37:19.282198+0000","last_clean":"2023-05-11T07:37:19.282198+0000","last_became_active":"2023-05-11T07:37:17.801223+0000","last_became_peered":"2023-05-11T07:37:17.801223+0000","last_unstale":"2023-05-11T07:37:19.282198+0000","last_undegraded":"2023-05-11T07:37:19.282198+0000","last_fullsized":"2023-05-11T07:37:19.282198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:45.174857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283835+0000","last_change":"2023-05-11T07:37:18.289641+0000","last_active":"2023-05-11T07:37:19.283835+0000","last_peered":"2023-05-11T07:37:19.283835+0000","last_clean":"2023-05-11T07:37:19.283835+0000","last_became_active":"2023-05-11T07:37:18.289266+0000","last_became_peered":"2023-05-11T07:37:18.289266+0000","last_unstale":"2023-05-11T07:37:19.283835+0000","last_undegraded":"2023-05-11T07:37:19.283835+0000","last_fullsized":"2023-05-11T07:37:19.283835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:07:10.450228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992371+0000","last_change":"2023-05-11T07:37:17.806924+0000","last_active":"2023-05-11T07:37:19.992371+0000","last_peered":"2023-05-11T07:37:19.992371+0000","last_clean":"2023-05-11T07:37:19.992371+0000","last_became_active":"2023-05-11T07:37:17.806632+0000","last_became_peered":"2023-05-11T07:37:17.806632+0000","last_unstale":"2023-05-11T07:37:19.992371+0000","last_undegraded":"2023-05-11T07:37:19.992371+0000","last_fullsized":"2023-05-11T07:37:19.992371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:15.881529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283860+0000","last_change":"2023-05-11T07:37:18.287300+0000","last_active":"2023-05-11T07:37:19.283860+0000","last_peered":"2023-05-11T07:37:19.283860+0000","last_clean":"2023-05-11T07:37:19.283860+0000","last_became_active":"2023-05-11T07:37:18.286982+0000","last_became_peered":"2023-05-11T07:37:18.286982+0000","last_unstale":"2023-05-11T07:37:19.283860+0000","last_undegraded":"2023-05-11T07:37:19.283860+0000","last_fullsized":"2023-05-11T07:37:19.283860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:08:12.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986279+0000","last_change":"2023-05-11T07:37:17.811963+0000","last_active":"2023-05-11T07:37:19.986279+0000","last_peered":"2023-05-11T07:37:19.986279+0000","last_clean":"2023-05-11T07:37:19.986279+0000","last_became_active":"2023-05-11T07:37:17.811718+0000","last_became_peered":"2023-05-11T07:37:17.811718+0000","last_unstale":"2023-05-11T07:37:19.986279+0000","last_undegraded":"2023-05-11T07:37:19.986279+0000","last_fullsized":"2023-05-11T07:37:19.986279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:58:39.409698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986060+0000","last_change":"2023-05-11T07:37:18.294227+0000","last_active":"2023-05-11T07:37:19.986060+0000","last_peered":"2023-05-11T07:37:19.986060+0000","last_clean":"2023-05-11T07:37:19.986060+0000","last_became_active":"2023-05-11T07:37:18.293962+0000","last_became_peered":"2023-05-11T07:37:18.293962+0000","last_unstale":"2023-05-11T07:37:19.986060+0000","last_undegraded":"2023-05-11T07:37:19.986060+0000","last_fullsized":"2023-05-11T07:37:19.986060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:31:48.833972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986258+0000","last_change":"2023-05-11T07:37:17.809327+0000","last_active":"2023-05-11T07:37:19.986258+0000","last_peered":"2023-05-11T07:37:19.986258+0000","last_clean":"2023-05-11T07:37:19.986258+0000","last_became_active":"2023-05-11T07:37:17.808953+0000","last_became_peered":"2023-05-11T07:37:17.808953+0000","last_unstale":"2023-05-11T07:37:19.986258+0000","last_undegraded":"2023-05-11T07:37:19.986258+0000","last_fullsized":"2023-05-11T07:37:19.986258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:41.118642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993416+0000","last_change":"2023-05-11T07:37:18.293169+0000","last_active":"2023-05-11T07:37:19.993416+0000","last_peered":"2023-05-11T07:37:19.993416+0000","last_clean":"2023-05-11T07:37:19.993416+0000","last_became_active":"2023-05-11T07:37:18.292862+0000","last_became_peered":"2023-05-11T07:37:18.292862+0000","last_unstale":"2023-05-11T07:37:19.993416+0000","last_undegraded":"2023-05-11T07:37:19.993416+0000","last_fullsized":"2023-05-11T07:37:19.993416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:21.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991908+0000","last_change":"2023-05-11T07:37:17.808473+0000","last_active":"2023-05-11T07:37:19.991908+0000","last_peered":"2023-05-11T07:37:19.991908+0000","last_clean":"2023-05-11T07:37:19.991908+0000","last_became_active":"2023-05-11T07:37:17.808069+0000","last_became_peered":"2023-05-11T07:37:17.808069+0000","last_unstale":"2023-05-11T07:37:19.991908+0000","last_undegraded":"2023-05-11T07:37:19.991908+0000","last_fullsized":"2023-05-11T07:37:19.991908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991589+0000","last_change":"2023-05-11T07:37:18.289485+0000","last_active":"2023-05-11T07:37:19.991589+0000","last_peered":"2023-05-11T07:37:19.991589+0000","last_clean":"2023-05-11T07:37:19.991589+0000","last_became_active":"2023-05-11T07:37:18.289211+0000","last_became_peered":"2023-05-11T07:37:18.289211+0000","last_unstale":"2023-05-11T07:37:19.991589+0000","last_undegraded":"2023-05-11T07:37:19.991589+0000","last_fullsized":"2023-05-11T07:37:19.991589+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:00:01.334038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.789788+0000","last_change":"2023-05-11T07:37:16.789788+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.789788+0000","last_undegraded":"2023-05-11T07:37:16.789788+0000","last_fullsized":"2023-05-11T07:37:16.789788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992759+0000","last_change":"2023-05-11T07:37:17.809276+0000","last_active":"2023-05-11T07:37:19.992759+0000","last_peered":"2023-05-11T07:37:19.992759+0000","last_clean":"2023-05-11T07:37:19.992759+0000","last_became_active":"2023-05-11T07:37:17.809035+0000","last_became_peered":"2023-05-11T07:37:17.809035+0000","last_unstale":"2023-05-11T07:37:19.992759+0000","last_undegraded":"2023-05-11T07:37:19.992759+0000","last_fullsized":"2023-05-11T07:37:19.992759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:20.856372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281811+0000","last_change":"2023-05-11T07:37:18.292506+0000","last_active":"2023-05-11T07:37:19.281811+0000","last_peered":"2023-05-11T07:37:19.281811+0000","last_clean":"2023-05-11T07:37:19.281811+0000","last_became_active":"2023-05-11T07:37:18.292151+0000","last_became_peered":"2023-05-11T07:37:18.292151+0000","last_unstale":"2023-05-11T07:37:19.281811+0000","last_undegraded":"2023-05-11T07:37:19.281811+0000","last_fullsized":"2023-05-11T07:37:19.281811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:57:57.495757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T07:37:16.790037+0000","last_change":"2023-05-11T07:37:16.790037+0000","last_active":"2023-05-11T07:37:16.773422+0000","last_peered":"2023-05-11T07:37:16.773422+0000","last_clean":"2023-05-11T07:37:16.773422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:16.790037+0000","last_undegraded":"2023-05-11T07:37:16.790037+0000","last_fullsized":"2023-05-11T07:37:16.790037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993411+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:37:19.993411+0000","last_peered":"2023-05-11T07:37:19.993411+0000","last_clean":"2023-05-11T07:37:19.993411+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:37:19.993411+0000","last_undegraded":"2023-05-11T07:37:19.993411+0000","last_fullsized":"2023-05-11T07:37:19.993411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:54.361555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283895+0000","last_change":"2023-05-11T07:37:18.302712+0000","last_active":"2023-05-11T07:37:19.283895+0000","last_peered":"2023-05-11T07:37:19.283895+0000","last_clean":"2023-05-11T07:37:19.283895+0000","last_became_active":"2023-05-11T07:37:18.302367+0000","last_became_peered":"2023-05-11T07:37:18.302367+0000","last_unstale":"2023-05-11T07:37:19.283895+0000","last_undegraded":"2023-05-11T07:37:19.283895+0000","last_fullsized":"2023-05-11T07:37:19.283895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:23.623043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.988486+0000","last_change":"2023-05-11T07:37:17.806226+0000","last_active":"2023-05-11T07:37:19.988486+0000","last_peered":"2023-05-11T07:37:19.988486+0000","last_clean":"2023-05-11T07:37:19.988486+0000","last_became_active":"2023-05-11T07:37:17.805937+0000","last_became_peered":"2023-05-11T07:37:17.805937+0000","last_unstale":"2023-05-11T07:37:19.988486+0000","last_undegraded":"2023-05-11T07:37:19.988486+0000","last_fullsized":"2023-05-11T07:37:19.988486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991966+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:37:19.991966+0000","last_peered":"2023-05-11T07:37:19.991966+0000","last_clean":"2023-05-11T07:37:19.991966+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:37:19.991966+0000","last_undegraded":"2023-05-11T07:37:19.991966+0000","last_fullsized":"2023-05-11T07:37:19.991966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:00.155128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993579+0000","last_change":"2023-05-11T07:37:17.812286+0000","last_active":"2023-05-11T07:37:19.993579+0000","last_peered":"2023-05-11T07:37:19.993579+0000","last_clean":"2023-05-11T07:37:19.993579+0000","last_became_active":"2023-05-11T07:37:17.811876+0000","last_became_peered":"2023-05-11T07:37:17.811876+0000","last_unstale":"2023-05-11T07:37:19.993579+0000","last_undegraded":"2023-05-11T07:37:19.993579+0000","last_fullsized":"2023-05-11T07:37:19.993579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:26.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991425+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:37:19.991425+0000","last_peered":"2023-05-11T07:37:19.991425+0000","last_clean":"2023-05-11T07:37:19.991425+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:37:19.991425+0000","last_undegraded":"2023-05-11T07:37:19.991425+0000","last_fullsized":"2023-05-11T07:37:19.991425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:52:30.578344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T07:37:17.779942+0000","last_change":"2023-05-11T07:37:17.779942+0000","last_active":"2023-05-11T07:37:17.779942+0000","last_peered":"2023-05-11T07:37:17.779942+0000","last_clean":"2023-05-11T07:37:17.779942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T07:37:17.779942+0000","last_undegraded":"2023-05-11T07:37:17.779942+0000","last_fullsized":"2023-05-11T07:37:17.779942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992392+0000","last_change":"2023-05-11T07:37:17.804167+0000","last_active":"2023-05-11T07:37:19.992392+0000","last_peered":"2023-05-11T07:37:19.992392+0000","last_clean":"2023-05-11T07:37:19.992392+0000","last_became_active":"2023-05-11T07:37:17.803797+0000","last_became_peered":"2023-05-11T07:37:17.803797+0000","last_unstale":"2023-05-11T07:37:19.992392+0000","last_undegraded":"2023-05-11T07:37:19.992392+0000","last_fullsized":"2023-05-11T07:37:19.992392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:27.503714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991965+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:37:19.991965+0000","last_peered":"2023-05-11T07:37:19.991965+0000","last_clean":"2023-05-11T07:37:19.991965+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:37:19.991965+0000","last_undegraded":"2023-05-11T07:37:19.991965+0000","last_fullsized":"2023-05-11T07:37:19.991965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:38:09.432242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992843+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:37:19.992843+0000","last_peered":"2023-05-11T07:37:19.992843+0000","last_clean":"2023-05-11T07:37:19.992843+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:37:19.992843+0000","last_undegraded":"2023-05-11T07:37:19.992843+0000","last_fullsized":"2023-05-11T07:37:19.992843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:04.224988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993367+0000","last_change":"2023-05-11T07:37:18.294585+0000","last_active":"2023-05-11T07:37:19.993367+0000","last_peered":"2023-05-11T07:37:19.993367+0000","last_clean":"2023-05-11T07:37:19.993367+0000","last_became_active":"2023-05-11T07:37:18.294299+0000","last_became_peered":"2023-05-11T07:37:18.294299+0000","last_unstale":"2023-05-11T07:37:19.993367+0000","last_undegraded":"2023-05-11T07:37:19.993367+0000","last_fullsized":"2023-05-11T07:37:19.993367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993477+0000","last_change":"2023-05-11T07:37:17.800828+0000","last_active":"2023-05-11T07:37:19.993477+0000","last_peered":"2023-05-11T07:37:19.993477+0000","last_clean":"2023-05-11T07:37:19.993477+0000","last_became_active":"2023-05-11T07:37:17.800524+0000","last_became_peered":"2023-05-11T07:37:17.800524+0000","last_unstale":"2023-05-11T07:37:19.993477+0000","last_undegraded":"2023-05-11T07:37:19.993477+0000","last_fullsized":"2023-05-11T07:37:19.993477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:35.326768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992929+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:37:19.992929+0000","last_peered":"2023-05-11T07:37:19.992929+0000","last_clean":"2023-05-11T07:37:19.992929+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:37:19.992929+0000","last_undegraded":"2023-05-11T07:37:19.992929+0000","last_fullsized":"2023-05-11T07:37:19.992929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:56:55.436349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991922+0000","last_change":"2023-05-11T07:37:18.290604+0000","last_active":"2023-05-11T07:37:19.991922+0000","last_peered":"2023-05-11T07:37:19.991922+0000","last_clean":"2023-05-11T07:37:19.991922+0000","last_became_active":"2023-05-11T07:37:18.290265+0000","last_became_peered":"2023-05-11T07:37:18.290265+0000","last_unstale":"2023-05-11T07:37:19.991922+0000","last_undegraded":"2023-05-11T07:37:19.991922+0000","last_fullsized":"2023-05-11T07:37:19.991922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993255+0000","last_change":"2023-05-11T07:37:17.803117+0000","last_active":"2023-05-11T07:37:19.993255+0000","last_peered":"2023-05-11T07:37:19.993255+0000","last_clean":"2023-05-11T07:37:19.993255+0000","last_became_active":"2023-05-11T07:37:17.802884+0000","last_became_peered":"2023-05-11T07:37:17.802884+0000","last_unstale":"2023-05-11T07:37:19.993255+0000","last_undegraded":"2023-05-11T07:37:19.993255+0000","last_fullsized":"2023-05-11T07:37:19.993255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:30.669761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993568+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:37:19.993568+0000","last_peered":"2023-05-11T07:37:19.993568+0000","last_clean":"2023-05-11T07:37:19.993568+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:37:19.993568+0000","last_undegraded":"2023-05-11T07:37:19.993568+0000","last_fullsized":"2023-05-11T07:37:19.993568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:18.654496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986054+0000","last_change":"2023-05-11T07:37:18.296544+0000","last_active":"2023-05-11T07:37:19.986054+0000","last_peered":"2023-05-11T07:37:19.986054+0000","last_clean":"2023-05-11T07:37:19.986054+0000","last_became_active":"2023-05-11T07:37:18.295758+0000","last_became_peered":"2023-05-11T07:37:18.295758+0000","last_unstale":"2023-05-11T07:37:19.986054+0000","last_undegraded":"2023-05-11T07:37:19.986054+0000","last_fullsized":"2023-05-11T07:37:19.986054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:34:51.857400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281928+0000","last_change":"2023-05-11T07:37:17.805120+0000","last_active":"2023-05-11T07:37:19.281928+0000","last_peered":"2023-05-11T07:37:19.281928+0000","last_clean":"2023-05-11T07:37:19.281928+0000","last_became_active":"2023-05-11T07:37:17.804834+0000","last_became_peered":"2023-05-11T07:37:17.804834+0000","last_unstale":"2023-05-11T07:37:19.281928+0000","last_undegraded":"2023-05-11T07:37:19.281928+0000","last_fullsized":"2023-05-11T07:37:19.281928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:10:26.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993536+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:37:19.993536+0000","last_peered":"2023-05-11T07:37:19.993536+0000","last_clean":"2023-05-11T07:37:19.993536+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:37:19.993536+0000","last_undegraded":"2023-05-11T07:37:19.993536+0000","last_fullsized":"2023-05-11T07:37:19.993536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:21:18.916469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986122+0000","last_change":"2023-05-11T07:37:18.292755+0000","last_active":"2023-05-11T07:37:19.986122+0000","last_peered":"2023-05-11T07:37:19.986122+0000","last_clean":"2023-05-11T07:37:19.986122+0000","last_became_active":"2023-05-11T07:37:18.292496+0000","last_became_peered":"2023-05-11T07:37:18.292496+0000","last_unstale":"2023-05-11T07:37:19.986122+0000","last_undegraded":"2023-05-11T07:37:19.986122+0000","last_fullsized":"2023-05-11T07:37:19.986122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:21.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993267+0000","last_change":"2023-05-11T07:37:17.813490+0000","last_active":"2023-05-11T07:37:19.993267+0000","last_peered":"2023-05-11T07:37:19.993267+0000","last_clean":"2023-05-11T07:37:19.993267+0000","last_became_active":"2023-05-11T07:37:17.813185+0000","last_became_peered":"2023-05-11T07:37:17.813185+0000","last_unstale":"2023-05-11T07:37:19.993267+0000","last_undegraded":"2023-05-11T07:37:19.993267+0000","last_fullsized":"2023-05-11T07:37:19.993267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.284047+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:37:19.284047+0000","last_peered":"2023-05-11T07:37:19.284047+0000","last_clean":"2023-05-11T07:37:19.284047+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:37:19.284047+0000","last_undegraded":"2023-05-11T07:37:19.284047+0000","last_fullsized":"2023-05-11T07:37:19.284047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:22.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9592,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362248,"statfs":{"total":96636764160,"available":96626941952,"internally_reserved":0,"allocated":1032192,"data_stored":781005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.736000000000001,"5min":17.736000000000001,"15min":17.736000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":18.178000000000001,"5min":18.178000000000001,"15min":18.178000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":17.706,"5min":17.706,"15min":17.706},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":18.143999999999998,"5min":18.143999999999998,"15min":18.143999999999998},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.765000000000001,"5min":17.765000000000001,"15min":17.765000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":17.917999999999999,"5min":17.917999999999999,"15min":17.917999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":17.602,"5min":17.602,"15min":17.602},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":17.992999999999999,"5min":17.992999999999999,"15min":17.992999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":17.558,"5min":17.558,"15min":17.558},"last":0.628}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":17.960999999999999,"5min":17.960999999999999,"15min":17.960999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":14.349,"5min":14.349,"15min":14.349},"last":0.72499999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.745}]},{"osd":5,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":491520,"data_stored":213101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.313}]},{"osd":1,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.439},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.497}]},{"osd":6,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8668,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363172,"statfs":{"total":96636764160,"available":96627888128,"internally_reserved":0,"allocated":479232,"data_stored":211585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.436},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":12.396000000000001,"5min":12.396000000000001,"15min":12.396000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":12.429,"5min":12.429,"15min":12.429},"last":0.504}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.752},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.919,"5min":11.919,"15min":11.919},"last":0.627},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":12.329000000000001,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":12.051,"5min":12.051,"15min":12.051},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":12.287000000000001,"5min":12.287000000000001,"15min":12.287000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":12.016999999999999,"5min":12.016999999999999,"15min":12.016999999999999},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":0.44}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.623},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.746}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":495616,"data_stored":219160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.432},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:37:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-05-11T07:37:23.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-05-11T07:37:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-05-11T07:37:23.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-05-11T07:37:23.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-05-11T07:37:23.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-05-11T07:37:23.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-05-11T07:37:23.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-05-11T07:37:23.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-05-11T07:37:23.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-05-11T07:37:23.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T07:37:16.790686+0000', 'last_change': '2023-05-11T07:37:16.790686+0000', 'last_active': '2023-05-11T07:37:16.773422+0000', 'last_peered': '2023-05-11T07:37:16.773422+0000', 'last_clean': '2023-05-11T07:37:16.773422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:16.790686+0000', 'last_undegraded': '2023-05-11T07:37:16.790686+0000', 'last_fullsized': '2023-05-11T07:37:16.790686+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T07:37:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-05-11T07:37:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T07:37:16.790337+0000', 'last_change': '2023-05-11T07:37:16.790337+0000', 'last_active': '2023-05-11T07:37:16.773422+0000', 'last_peered': '2023-05-11T07:37:16.773422+0000', 'last_clean': '2023-05-11T07:37:16.773422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:16.790337+0000', 'last_undegraded': '2023-05-11T07:37:16.790337+0000', 'last_fullsized': '2023-05-11T07:37:16.790337+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T07:37:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-05-11T07:37:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-05-11T07:37:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T07:37:16.790303+0000', 'last_change': '2023-05-11T07:37:16.790303+0000', 'last_active': '2023-05-11T07:37:16.773422+0000', 'last_peered': '2023-05-11T07:37:16.773422+0000', 'last_clean': '2023-05-11T07:37:16.773422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:16.790303+0000', 'last_undegraded': '2023-05-11T07:37:16.790303+0000', 'last_fullsized': '2023-05-11T07:37:16.790303+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T07:37:23.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-05-11T07:37:23.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-05-11T07:37:23.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T07:37:16.789788+0000', 'last_change': '2023-05-11T07:37:16.789788+0000', 'last_active': '2023-05-11T07:37:16.773422+0000', 'last_peered': '2023-05-11T07:37:16.773422+0000', 'last_clean': '2023-05-11T07:37:16.773422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:16.789788+0000', 'last_undegraded': '2023-05-11T07:37:16.789788+0000', 'last_fullsized': '2023-05-11T07:37:16.789788+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T07:37:23.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-05-11T07:37:23.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-05-11T07:37:23.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T07:37:16.790037+0000', 'last_change': '2023-05-11T07:37:16.790037+0000', 'last_active': '2023-05-11T07:37:16.773422+0000', 'last_peered': '2023-05-11T07:37:16.773422+0000', 'last_clean': '2023-05-11T07:37:16.773422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:16.790037+0000', 'last_undegraded': '2023-05-11T07:37:16.790037+0000', 'last_fullsized': '2023-05-11T07:37:16.790037+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:16.773422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T07:37:23.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-05-11T07:37:23.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-05-11T07:37:23.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T07:37:17.779942+0000', 'last_change': '2023-05-11T07:37:17.779942+0000', 'last_active': '2023-05-11T07:37:17.779942+0000', 'last_peered': '2023-05-11T07:37:17.779942+0000', 'last_clean': '2023-05-11T07:37:17.779942+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T07:37:17.779942+0000', 'last_undegraded': '2023-05-11T07:37:17.779942+0000', 'last_fullsized': '2023-05-11T07:37:17.779942+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'last_clean_scrub_stamp': '2023-05-11T07:37:17.779942+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T07:37:23.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-11T07:37:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.740+0000 7f7504fff700 1 Processor -- start 2023-05-11T07:37:23.744 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.740+0000 7f7504fff700 1 -- start start 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f7504fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f75000b87e0 0x7f75000b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f7504fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f75000d27a0 0x7f75000b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f7504fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750015cef0 con 0x7f75000d02c0 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f7504fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000b5a80 con 0x7f75000d27a0 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f7504fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000cdf70 con 0x7f75000b87e0 2023-05-11T07:37:23.745 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f74fdd9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f75000d02c0 0x7f75000d2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41632/0 (socket says 172.21.15.144:41632) 2023-05-11T07:37:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f74fdd9b700 1 -- 172.21.15.144:0/1417501337 learned_addr learned my addr 172.21.15.144:0/1417501337 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.741+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1417501337 >> v2:172.21.15.144:3300/0 conn(0x7f75000d27a0 0x7f75000b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fe59c700 1 --2- 172.21.15.144:0/1417501337 >> v2:172.21.15.145:3300/0 conn(0x7f75000b87e0 0x7f75000b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fd59a700 1 -- 172.21.15.144:0/1417501337 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338045965 0 0) 0x7f74f4001110 con 0x7f75000d02c0 2023-05-11T07:37:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fd59a700 1 -- 172.21.15.144:0/1417501337 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e80035b0 con 0x7f75000d02c0 2023-05-11T07:37:23.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fed9d700 1 -- 172.21.15.144:0/1417501337 >> v2:172.21.15.145:3300/0 conn(0x7f75000b87e0 msgr2=0x7f75000b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1417501337 >> v2:172.21.15.145:3300/0 conn(0x7f75000b87e0 0x7f75000b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fed9d700 1 -- 172.21.15.144:0/1417501337 >> v1:172.21.15.144:6789/0 conn(0x7f75000d02c0 legacy=0x7f75000d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fed9d700 1 -- 172.21.15.144:0/1417501337 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000cd760 con 0x7f75000d27a0 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1417501337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000b50d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f75000b5cb0 tx=0x7f74f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a6f5acbdfbf7d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fd59a700 1 -- 172.21.15.144:0/1417501337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800e070 con 0x7f75000d27a0 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fd59a700 1 -- 172.21.15.144:0/1417501337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f800bb20 con 0x7f75000d27a0 2023-05-11T07:37:23.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.742+0000 7f74fd59a700 1 -- 172.21.15.144:0/1417501337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8012430 con 0x7f75000d27a0 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 -- 172.21.15.144:0/1417501337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 msgr2=0x7f75000b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 --2- 172.21.15.144:0/1417501337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000b50d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f75000b5cb0 tx=0x7f74f800b330 comp rx=0 tx=0).stop 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 -- 172.21.15.144:0/1417501337 shutdown_connections 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 --2- 172.21.15.144:0/1417501337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000b50d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 --2- 172.21.15.144:0/1417501337 >> v2:172.21.15.145:3300/0 conn(0x7f75000b87e0 0x7f75000b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 -- 172.21.15.144:0/1417501337 >> 172.21.15.144:0/1417501337 conn(0x7f750006acf0 msgr2=0x7f750006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 -- 172.21.15.144:0/1417501337 shutdown_connections 2023-05-11T07:37:23.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.743+0000 7f7504fff700 1 -- 172.21.15.144:0/1417501337 wait complete. 2023-05-11T07:37:23.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.745+0000 7f7504fff700 1 Processor -- start 2023-05-11T07:37:23.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.745+0000 7f7504fff700 1 -- start start 2023-05-11T07:37:23.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75000b87e0 0x7f75001513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75000d02c0 0x7f75000cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500157c40 con 0x7f75000d27a0 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500156d50 con 0x7f75000d02c0 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f7504fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7500157030 con 0x7f75000b87e0 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41954/0 (socket says 172.21.15.144:41954) 2023-05-11T07:37:23.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fed9d700 1 -- 172.21.15.144:0/1883989261 learned_addr learned my addr 172.21.15.144:0/1883989261 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fdd9b700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75000d02c0 0x7f75000cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fe59c700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75000b87e0 0x7f75001513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fed9d700 1 -- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75000b87e0 msgr2=0x7f75001513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.746+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75000b87e0 0x7f75001513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74fed9d700 1 -- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75000d02c0 msgr2=0x7f75000cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75000d02c0 0x7f75000cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74fed9d700 1 -- 172.21.15.144:0/1883989261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8009a70 con 0x7f75000d27a0 2023-05-11T07:37:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74fed9d700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f74f8014040 tx=0x7f74f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8012430 con 0x7f75000d27a0 2023-05-11T07:37:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8020070 con 0x7f75000d27a0 2023-05-11T07:37:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75000cd9b0 con 0x7f75000d27a0 2023-05-11T07:37:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8004280 con 0x7f75000d27a0 2023-05-11T07:37:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.747+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75000d2d30 con 0x7f75000d27a0 2023-05-11T07:37:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.748+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000cdc90 con 0x7f75000d27a0 2023-05-11T07:37:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.749+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74f80043e0 con 0x7f75000d27a0 2023-05-11T07:37:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.750+0000 7f74eeffd700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.750+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f74f8022070 con 0x7f75000d27a0 2023-05-11T07:37:23.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.750+0000 7f74fe59c700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:23.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.751+0000 7f74fe59c700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 0x7f74e006d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009b70 tx=0x7f74f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:23.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:23.754+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74f8056250 con 0x7f75000d27a0 2023-05-11T07:37:24.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.027+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f750008b830 con 0x7f75000d27a0 2023-05-11T07:37:24.031 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.028+0000 7f74eeffd700 1 -- 172.21.15.144:0/1883989261 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7f74f8059870 con 0x7f75000d27a0 2023-05-11T07:37:24.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:24.032 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"424d6242-b269-485d-aca8-83f4424787ea","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":131,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":8,"num_up_osds":8,"osd_up_since":1683790525,"num_in_osds":8,"osd_in_since":1683790516,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"unknown","count":14},{"state_name":"creating+peering","count":5}],"num_pgs":105,"num_pools":4,"num_objects":20,"data_bytes":592730,"bytes_used":73232384,"bytes_avail":773020880896,"bytes_total":773094113280,"unknown_pgs_ratio":0.13333334028720856,"inactive_pgs_ratio":0.0476190485060215,"write_bytes_sec":2892,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5370}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-05-11T07:36:45.728346+0000","services":{}},"progress_events":{}} 2023-05-11T07:37:24.033 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 msgr2=0x7f74e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 0x7f74e006d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009b70 tx=0x7f74f0008040 comp rx=0 tx=0).stop 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 msgr2=0x7f75000ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f74f8014040 tx=0x7f74f8004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 shutdown_connections 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.034 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f75000b87e0 0x7f75001513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75000d27a0 0x7f75000ccdb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.035 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 --2- 172.21.15.144:0/1883989261 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75000d02c0 0x7f75000cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.036 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 >> 172.21.15.144:0/1883989261 conn(0x7f750006acf0 msgr2=0x7f75000b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:24.036 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 shutdown_connections 2023-05-11T07:37:24.036 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.030+0000 7f7504fff700 1 -- 172.21.15.144:0/1883989261 wait complete. 2023-05-11T07:37:24.050 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-11T07:37:24.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:37:24.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.232+0000 7fb3c8bff700 1 Processor -- start 2023-05-11T07:37:24.235 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.232+0000 7fb3c8bff700 1 -- start start 2023-05-11T07:37:24.236 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c8bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c40c9730 0x7fb3c415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c8bff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3c406a2d0 0x7fb3c406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c8bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c415e1c0 con 0x7fb3c41597f0 2023-05-11T07:37:24.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c8bff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c406ac90 con 0x7fb3c406a2d0 2023-05-11T07:37:24.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c8bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4159bc0 con 0x7fb3c40c9730 2023-05-11T07:37:24.237 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c2d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb3c406a2d0 0x7fb3c406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb3c41597f0 0x7fb3c40cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41644/0 (socket says 172.21.15.144:41644) 2023-05-11T07:37:24.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c259c700 1 -- 172.21.15.144:0/3046498897 learned_addr learned my addr 172.21.15.144:0/3046498897 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:24.238 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.233+0000 7fb3c1d9b700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c40c9730 0x7fb3c415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/3046498897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c40c9730 msgr2=0x7fb3c415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:24.239 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c2d9d700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c40c9730 0x7fb3c415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/3046498897 >> v1:172.21.15.144:6789/0 conn(0x7fb3c41597f0 legacy=0x7fb3c40cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/3046498897 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40c9ba0 con 0x7fb3c406a2d0 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c159a700 1 -- 172.21.15.144:0/3046498897 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098436115 0 0) 0x7fb3c415e1c0 con 0x7fb3c41597f0 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c2d9d700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c406a2d0 0x7fb3c406a750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009d90 tx=0x7fb3bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faefc6e93c2dbc6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c159a700 1 -- 172.21.15.144:0/3046498897 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00e070 con 0x7fb3c406a2d0 2023-05-11T07:37:24.240 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c159a700 1 -- 172.21.15.144:0/3046498897 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00bb20 con 0x7fb3c406a2d0 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.234+0000 7fb3c159a700 1 -- 172.21.15.144:0/3046498897 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc012430 con 0x7fb3c406a2d0 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 -- 172.21.15.144:0/3046498897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c406a2d0 msgr2=0x7fb3c406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c406a2d0 0x7fb3c406a750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009d90 tx=0x7fb3bc00b330 comp rx=0 tx=0).stop 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 -- 172.21.15.144:0/3046498897 shutdown_connections 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c406a2d0 0x7fb3c406a750 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/3046498897 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c40c9730 0x7fb3c415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.241 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 -- 172.21.15.144:0/3046498897 >> 172.21.15.144:0/3046498897 conn(0x7fb3c40cb7e0 msgr2=0x7fb3c40cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:24.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 -- 172.21.15.144:0/3046498897 shutdown_connections 2023-05-11T07:37:24.242 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.235+0000 7fb3c8bff700 1 -- 172.21.15.144:0/3046498897 wait complete. 2023-05-11T07:37:24.243 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 Processor -- start 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 -- start start 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c406a2d0 0x7fb3c41f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3c40c9730 0x7fb3c415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.237+0000 7fb3c8bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41f36a0 con 0x7fb3c41597f0 2023-05-11T07:37:24.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c8bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41f29f0 con 0x7fb3c40c9730 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c8bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415ac90 con 0x7fb3c406a2d0 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41970/0 (socket says 172.21.15.144:41970) 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/2888926208 learned_addr learned my addr 172.21.15.144:0/2888926208 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c259c700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c406a2d0 0x7fb3c41f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c1d9b700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3c40c9730 0x7fb3c415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c406a2d0 msgr2=0x7fb3c41f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c406a2d0 0x7fb3c41f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3c40c9730 msgr2=0x7fb3c415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3c40c9730 0x7fb3c415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 -- 172.21.15.144:0/2888926208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc009a70 con 0x7fb3c41597f0 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.238+0000 7fb3c2d9d700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc014040 tx=0x7fb3bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.239+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc012430 con 0x7fb3c41597f0 2023-05-11T07:37:24.246 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.239+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc020070 con 0x7fb3c41597f0 2023-05-11T07:37:24.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.239+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc004280 con 0x7fb3c41597f0 2023-05-11T07:37:24.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.239+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40ca110 con 0x7fb3c41597f0 2023-05-11T07:37:24.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.239+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c40c9e30 con 0x7fb3c41597f0 2023-05-11T07:37:24.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.240+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c415b0c0 con 0x7fb3c41597f0 2023-05-11T07:37:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.241+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3bc0043e0 con 0x7fb3c41597f0 2023-05-11T07:37:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.242+0000 7fb3b2ffd700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 0x7fb3a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.242+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb3bc022070 con 0x7fb3c41597f0 2023-05-11T07:37:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.242+0000 7fb3c259c700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 0x7fb3a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.242+0000 7fb3c259c700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 0x7fb3a406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4007fd0 tx=0x7fb3b4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:24.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.246+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb3bc0bd2d0 con 0x7fb3c41597f0 2023-05-11T07:37:24.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.436+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3c40cccb0 con 0x7fb3a406ace0 2023-05-11T07:37:24.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.444+0000 7fb3b2ffd700 1 -- 172.21.15.144:0/2888926208 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310518 (secure 0 0 0) 0x7fb3c40cccb0 con 0x7fb3a406ace0 2023-05-11T07:37:24.451 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 msgr2=0x7fb3a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 0x7fb3a406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4007fd0 tx=0x7fb3b4007de0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 msgr2=0x7fb3c415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc014040 tx=0x7fb3bc004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.453 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 shutdown_connections 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fb3a406ace0 0x7fb3a406d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fb3c406a2d0 0x7fb3c41f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3c41597f0 0x7fb3c415a660 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 --2- 172.21.15.144:0/2888926208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3c40c9730 0x7fb3c415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 >> 172.21.15.144:0/2888926208 conn(0x7fb3c40cb7e0 msgr2=0x7fb3c40cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 shutdown_connections 2023-05-11T07:37:24.455 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:24.449+0000 7fb3c8bff700 1 -- 172.21.15.144:0/2888926208 wait complete. 2023-05-11T07:37:24.455 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:37:24.471 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-05-11T07:37:23.736523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71760,"kb_used_data":5008,"kb_used_omap":0,"kb_used_meta":66688,"kb_avail":754902960,"statfs":{"total":773094113280,"available":773020631040,"internally_reserved":0,"allocated":5128192,"data_stored":2919418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68288512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001608"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:18.291434+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:18.291148+0000","last_became_peered":"2023-05-11T07:37:18.291148+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:22.530712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992276+0000","last_change":"2023-05-11T07:37:18.301388+0000","last_active":"2023-05-11T07:37:19.992276+0000","last_peered":"2023-05-11T07:37:19.992276+0000","last_clean":"2023-05-11T07:37:19.992276+0000","last_became_active":"2023-05-11T07:37:18.301121+0000","last_became_peered":"2023-05-11T07:37:18.301121+0000","last_unstale":"2023-05-11T07:37:19.992276+0000","last_undegraded":"2023-05-11T07:37:19.992276+0000","last_fullsized":"2023-05-11T07:37:19.992276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:49:47.667555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282046+0000","last_change":"2023-05-11T07:37:18.292177+0000","last_active":"2023-05-11T07:37:19.282046+0000","last_peered":"2023-05-11T07:37:19.282046+0000","last_clean":"2023-05-11T07:37:19.282046+0000","last_became_active":"2023-05-11T07:37:18.291845+0000","last_became_peered":"2023-05-11T07:37:18.291845+0000","last_unstale":"2023-05-11T07:37:19.282046+0000","last_undegraded":"2023-05-11T07:37:19.282046+0000","last_fullsized":"2023-05-11T07:37:19.282046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:23.945011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992624+0000","last_change":"2023-05-11T07:37:18.302708+0000","last_active":"2023-05-11T07:37:19.992624+0000","last_peered":"2023-05-11T07:37:19.992624+0000","last_clean":"2023-05-11T07:37:19.992624+0000","last_became_active":"2023-05-11T07:37:18.302418+0000","last_became_peered":"2023-05-11T07:37:18.302418+0000","last_unstale":"2023-05-11T07:37:19.992624+0000","last_undegraded":"2023-05-11T07:37:19.992624+0000","last_fullsized":"2023-05-11T07:37:19.992624+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:16:40.908200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991955+0000","last_change":"2023-05-11T07:37:18.301367+0000","last_active":"2023-05-11T07:37:19.991955+0000","last_peered":"2023-05-11T07:37:19.991955+0000","last_clean":"2023-05-11T07:37:19.991955+0000","last_became_active":"2023-05-11T07:37:18.301084+0000","last_became_peered":"2023-05-11T07:37:18.301084+0000","last_unstale":"2023-05-11T07:37:19.991955+0000","last_undegraded":"2023-05-11T07:37:19.991955+0000","last_fullsized":"2023-05-11T07:37:19.991955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985990+0000","last_change":"2023-05-11T07:37:18.294756+0000","last_active":"2023-05-11T07:37:19.985990+0000","last_peered":"2023-05-11T07:37:19.985990+0000","last_clean":"2023-05-11T07:37:19.985990+0000","last_became_active":"2023-05-11T07:37:18.294511+0000","last_became_peered":"2023-05-11T07:37:18.294511+0000","last_unstale":"2023-05-11T07:37:19.985990+0000","last_undegraded":"2023-05-11T07:37:19.985990+0000","last_fullsized":"2023-05-11T07:37:19.985990+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:05:29.224864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993012+0000","last_change":"2023-05-11T07:37:18.292016+0000","last_active":"2023-05-11T07:37:19.993012+0000","last_peered":"2023-05-11T07:37:19.993012+0000","last_clean":"2023-05-11T07:37:19.993012+0000","last_became_active":"2023-05-11T07:37:18.291768+0000","last_became_peered":"2023-05-11T07:37:18.291768+0000","last_unstale":"2023-05-11T07:37:19.993012+0000","last_undegraded":"2023-05-11T07:37:19.993012+0000","last_fullsized":"2023-05-11T07:37:19.993012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:42.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991762+0000","last_change":"2023-05-11T07:37:18.303167+0000","last_active":"2023-05-11T07:37:19.991762+0000","last_peered":"2023-05-11T07:37:19.991762+0000","last_clean":"2023-05-11T07:37:19.991762+0000","last_became_active":"2023-05-11T07:37:18.302509+0000","last_became_peered":"2023-05-11T07:37:18.302509+0000","last_unstale":"2023-05-11T07:37:19.991762+0000","last_undegraded":"2023-05-11T07:37:19.991762+0000","last_fullsized":"2023-05-11T07:37:19.991762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:41:42.609012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992609+0000","last_change":"2023-05-11T07:37:18.299381+0000","last_active":"2023-05-11T07:37:19.992609+0000","last_peered":"2023-05-11T07:37:19.992609+0000","last_clean":"2023-05-11T07:37:19.992609+0000","last_became_active":"2023-05-11T07:37:18.299121+0000","last_became_peered":"2023-05-11T07:37:18.299121+0000","last_unstale":"2023-05-11T07:37:19.992609+0000","last_undegraded":"2023-05-11T07:37:19.992609+0000","last_fullsized":"2023-05-11T07:37:19.992609+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:27:58.862280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992809+0000","last_change":"2023-05-11T07:37:18.304312+0000","last_active":"2023-05-11T07:37:19.992809+0000","last_peered":"2023-05-11T07:37:19.992809+0000","last_clean":"2023-05-11T07:37:19.992809+0000","last_became_active":"2023-05-11T07:37:18.303884+0000","last_became_peered":"2023-05-11T07:37:18.303884+0000","last_unstale":"2023-05-11T07:37:19.992809+0000","last_undegraded":"2023-05-11T07:37:19.992809+0000","last_fullsized":"2023-05-11T07:37:19.992809+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992471+0000","last_change":"2023-05-11T07:37:18.292545+0000","last_active":"2023-05-11T07:37:19.992471+0000","last_peered":"2023-05-11T07:37:19.992471+0000","last_clean":"2023-05-11T07:37:19.992471+0000","last_became_active":"2023-05-11T07:37:18.292224+0000","last_became_peered":"2023-05-11T07:37:18.292224+0000","last_unstale":"2023-05-11T07:37:19.992471+0000","last_undegraded":"2023-05-11T07:37:19.992471+0000","last_fullsized":"2023-05-11T07:37:19.992471+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:10:20.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992369+0000","last_change":"2023-05-11T07:37:18.296188+0000","last_active":"2023-05-11T07:37:19.992369+0000","last_peered":"2023-05-11T07:37:19.992369+0000","last_clean":"2023-05-11T07:37:19.992369+0000","last_became_active":"2023-05-11T07:37:18.295883+0000","last_became_peered":"2023-05-11T07:37:18.295883+0000","last_unstale":"2023-05-11T07:37:19.992369+0000","last_undegraded":"2023-05-11T07:37:19.992369+0000","last_fullsized":"2023-05-11T07:37:19.992369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:11:59.401409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991859+0000","last_change":"2023-05-11T07:37:18.290472+0000","last_active":"2023-05-11T07:37:19.991859+0000","last_peered":"2023-05-11T07:37:19.991859+0000","last_clean":"2023-05-11T07:37:19.991859+0000","last_became_active":"2023-05-11T07:37:18.290200+0000","last_became_peered":"2023-05-11T07:37:18.290200+0000","last_unstale":"2023-05-11T07:37:19.991859+0000","last_undegraded":"2023-05-11T07:37:19.991859+0000","last_fullsized":"2023-05-11T07:37:19.991859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:04:09.879877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992561+0000","last_change":"2023-05-11T07:37:18.292414+0000","last_active":"2023-05-11T07:37:19.992561+0000","last_peered":"2023-05-11T07:37:19.992561+0000","last_clean":"2023-05-11T07:37:19.992561+0000","last_became_active":"2023-05-11T07:37:18.292152+0000","last_became_peered":"2023-05-11T07:37:18.292152+0000","last_unstale":"2023-05-11T07:37:19.992561+0000","last_undegraded":"2023-05-11T07:37:19.992561+0000","last_fullsized":"2023-05-11T07:37:19.992561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:29:58.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985989+0000","last_change":"2023-05-11T07:37:18.295459+0000","last_active":"2023-05-11T07:37:19.985989+0000","last_peered":"2023-05-11T07:37:19.985989+0000","last_clean":"2023-05-11T07:37:19.985989+0000","last_became_active":"2023-05-11T07:37:18.295061+0000","last_became_peered":"2023-05-11T07:37:18.295061+0000","last_unstale":"2023-05-11T07:37:19.985989+0000","last_undegraded":"2023-05-11T07:37:19.985989+0000","last_fullsized":"2023-05-11T07:37:19.985989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:34.937633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283239+0000","last_change":"2023-05-11T07:37:18.309208+0000","last_active":"2023-05-11T07:37:19.283239+0000","last_peered":"2023-05-11T07:37:19.283239+0000","last_clean":"2023-05-11T07:37:19.283239+0000","last_became_active":"2023-05-11T07:37:18.308913+0000","last_became_peered":"2023-05-11T07:37:18.308913+0000","last_unstale":"2023-05-11T07:37:19.283239+0000","last_undegraded":"2023-05-11T07:37:19.283239+0000","last_fullsized":"2023-05-11T07:37:19.283239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:00:43.186311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282224+0000","last_change":"2023-05-11T07:37:18.292799+0000","last_active":"2023-05-11T07:37:19.282224+0000","last_peered":"2023-05-11T07:37:19.282224+0000","last_clean":"2023-05-11T07:37:19.282224+0000","last_became_active":"2023-05-11T07:37:18.292476+0000","last_became_peered":"2023-05-11T07:37:18.292476+0000","last_unstale":"2023-05-11T07:37:19.282224+0000","last_undegraded":"2023-05-11T07:37:19.282224+0000","last_fullsized":"2023-05-11T07:37:19.282224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:22:36.881963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282065+0000","last_change":"2023-05-11T07:37:18.297272+0000","last_active":"2023-05-11T07:37:19.282065+0000","last_peered":"2023-05-11T07:37:19.282065+0000","last_clean":"2023-05-11T07:37:19.282065+0000","last_became_active":"2023-05-11T07:37:18.296933+0000","last_became_peered":"2023-05-11T07:37:18.296933+0000","last_unstale":"2023-05-11T07:37:19.282065+0000","last_undegraded":"2023-05-11T07:37:19.282065+0000","last_fullsized":"2023-05-11T07:37:19.282065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:01:15.986745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283687+0000","last_change":"2023-05-11T07:37:18.288933+0000","last_active":"2023-05-11T07:37:19.283687+0000","last_peered":"2023-05-11T07:37:19.283687+0000","last_clean":"2023-05-11T07:37:19.283687+0000","last_became_active":"2023-05-11T07:37:18.288605+0000","last_became_peered":"2023-05-11T07:37:18.288605+0000","last_unstale":"2023-05-11T07:37:19.283687+0000","last_undegraded":"2023-05-11T07:37:19.283687+0000","last_fullsized":"2023-05-11T07:37:19.283687+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:10:53.147958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992012+0000","last_change":"2023-05-11T07:37:18.304107+0000","last_active":"2023-05-11T07:37:19.992012+0000","last_peered":"2023-05-11T07:37:19.992012+0000","last_clean":"2023-05-11T07:37:19.992012+0000","last_became_active":"2023-05-11T07:37:18.303874+0000","last_became_peered":"2023-05-11T07:37:18.303874+0000","last_unstale":"2023-05-11T07:37:19.992012+0000","last_undegraded":"2023-05-11T07:37:19.992012+0000","last_fullsized":"2023-05-11T07:37:19.992012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:30.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986014+0000","last_change":"2023-05-11T07:37:18.296702+0000","last_active":"2023-05-11T07:37:19.986014+0000","last_peered":"2023-05-11T07:37:19.986014+0000","last_clean":"2023-05-11T07:37:19.986014+0000","last_became_active":"2023-05-11T07:37:18.296227+0000","last_became_peered":"2023-05-11T07:37:18.296227+0000","last_unstale":"2023-05-11T07:37:19.986014+0000","last_undegraded":"2023-05-11T07:37:19.986014+0000","last_fullsized":"2023-05-11T07:37:19.986014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:35:20.212233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992380+0000","last_change":"2023-05-11T07:37:18.302035+0000","last_active":"2023-05-11T07:37:19.992380+0000","last_peered":"2023-05-11T07:37:19.992380+0000","last_clean":"2023-05-11T07:37:19.992380+0000","last_became_active":"2023-05-11T07:37:18.301769+0000","last_became_peered":"2023-05-11T07:37:18.301769+0000","last_unstale":"2023-05-11T07:37:19.992380+0000","last_undegraded":"2023-05-11T07:37:19.992380+0000","last_fullsized":"2023-05-11T07:37:19.992380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:50:27.002175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283252+0000","last_change":"2023-05-11T07:37:18.287465+0000","last_active":"2023-05-11T07:37:19.283252+0000","last_peered":"2023-05-11T07:37:19.283252+0000","last_clean":"2023-05-11T07:37:19.283252+0000","last_became_active":"2023-05-11T07:37:18.286165+0000","last_became_peered":"2023-05-11T07:37:18.286165+0000","last_unstale":"2023-05-11T07:37:19.283252+0000","last_undegraded":"2023-05-11T07:37:19.283252+0000","last_fullsized":"2023-05-11T07:37:19.283252+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:45:47.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283293+0000","last_change":"2023-05-11T07:37:18.286561+0000","last_active":"2023-05-11T07:37:19.283293+0000","last_peered":"2023-05-11T07:37:19.283293+0000","last_clean":"2023-05-11T07:37:19.283293+0000","last_became_active":"2023-05-11T07:37:18.286216+0000","last_became_peered":"2023-05-11T07:37:18.286216+0000","last_unstale":"2023-05-11T07:37:19.283293+0000","last_undegraded":"2023-05-11T07:37:19.283293+0000","last_fullsized":"2023-05-11T07:37:19.283293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:27:51.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283989+0000","last_change":"2023-05-11T07:37:18.286834+0000","last_active":"2023-05-11T07:37:19.283989+0000","last_peered":"2023-05-11T07:37:19.283989+0000","last_clean":"2023-05-11T07:37:19.283989+0000","last_became_active":"2023-05-11T07:37:18.286568+0000","last_became_peered":"2023-05-11T07:37:18.286568+0000","last_unstale":"2023-05-11T07:37:19.283989+0000","last_undegraded":"2023-05-11T07:37:19.283989+0000","last_fullsized":"2023-05-11T07:37:19.283989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:46.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992099+0000","last_change":"2023-05-11T07:37:18.290513+0000","last_active":"2023-05-11T07:37:19.992099+0000","last_peered":"2023-05-11T07:37:19.992099+0000","last_clean":"2023-05-11T07:37:19.992099+0000","last_became_active":"2023-05-11T07:37:18.290222+0000","last_became_peered":"2023-05-11T07:37:18.290222+0000","last_unstale":"2023-05-11T07:37:19.992099+0000","last_undegraded":"2023-05-11T07:37:19.992099+0000","last_fullsized":"2023-05-11T07:37:19.992099+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:01.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282119+0000","last_change":"2023-05-11T07:37:18.289912+0000","last_active":"2023-05-11T07:37:19.282119+0000","last_peered":"2023-05-11T07:37:19.282119+0000","last_clean":"2023-05-11T07:37:19.282119+0000","last_became_active":"2023-05-11T07:37:18.289607+0000","last_became_peered":"2023-05-11T07:37:18.289607+0000","last_unstale":"2023-05-11T07:37:19.282119+0000","last_undegraded":"2023-05-11T07:37:19.282119+0000","last_fullsized":"2023-05-11T07:37:19.282119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:26:38.690549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992184+0000","last_change":"2023-05-11T07:37:18.296428+0000","last_active":"2023-05-11T07:37:19.992184+0000","last_peered":"2023-05-11T07:37:19.992184+0000","last_clean":"2023-05-11T07:37:19.992184+0000","last_became_active":"2023-05-11T07:37:18.296133+0000","last_became_peered":"2023-05-11T07:37:18.296133+0000","last_unstale":"2023-05-11T07:37:19.992184+0000","last_undegraded":"2023-05-11T07:37:19.992184+0000","last_fullsized":"2023-05-11T07:37:19.992184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:53:03.634364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283703+0000","last_change":"2023-05-11T07:37:18.286553+0000","last_active":"2023-05-11T07:37:19.283703+0000","last_peered":"2023-05-11T07:37:19.283703+0000","last_clean":"2023-05-11T07:37:19.283703+0000","last_became_active":"2023-05-11T07:37:18.286235+0000","last_became_peered":"2023-05-11T07:37:18.286235+0000","last_unstale":"2023-05-11T07:37:19.283703+0000","last_undegraded":"2023-05-11T07:37:19.283703+0000","last_fullsized":"2023-05-11T07:37:19.283703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:47:38.913921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281787+0000","last_change":"2023-05-11T07:37:18.291946+0000","last_active":"2023-05-11T07:37:19.281787+0000","last_peered":"2023-05-11T07:37:19.281787+0000","last_clean":"2023-05-11T07:37:19.281787+0000","last_became_active":"2023-05-11T07:37:18.291346+0000","last_became_peered":"2023-05-11T07:37:18.291346+0000","last_unstale":"2023-05-11T07:37:19.281787+0000","last_undegraded":"2023-05-11T07:37:19.281787+0000","last_fullsized":"2023-05-11T07:37:19.281787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:26:34.365278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985821+0000","last_change":"2023-05-11T07:37:18.298118+0000","last_active":"2023-05-11T07:37:19.985821+0000","last_peered":"2023-05-11T07:37:19.985821+0000","last_clean":"2023-05-11T07:37:19.985821+0000","last_became_active":"2023-05-11T07:37:18.297866+0000","last_became_peered":"2023-05-11T07:37:18.297866+0000","last_unstale":"2023-05-11T07:37:19.985821+0000","last_undegraded":"2023-05-11T07:37:19.985821+0000","last_fullsized":"2023-05-11T07:37:19.985821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991682+0000","last_change":"2023-05-11T07:37:18.291309+0000","last_active":"2023-05-11T07:37:19.991682+0000","last_peered":"2023-05-11T07:37:19.991682+0000","last_clean":"2023-05-11T07:37:19.991682+0000","last_became_active":"2023-05-11T07:37:18.290864+0000","last_became_peered":"2023-05-11T07:37:18.290864+0000","last_unstale":"2023-05-11T07:37:19.991682+0000","last_undegraded":"2023-05-11T07:37:19.991682+0000","last_fullsized":"2023-05-11T07:37:19.991682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:16.444730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993415+0000","last_change":"2023-05-11T07:37:18.292054+0000","last_active":"2023-05-11T07:37:19.993415+0000","last_peered":"2023-05-11T07:37:19.993415+0000","last_clean":"2023-05-11T07:37:19.993415+0000","last_became_active":"2023-05-11T07:37:18.291805+0000","last_became_peered":"2023-05-11T07:37:18.291805+0000","last_unstale":"2023-05-11T07:37:19.993415+0000","last_undegraded":"2023-05-11T07:37:19.993415+0000","last_fullsized":"2023-05-11T07:37:19.993415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:19.430601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986353+0000","last_change":"2023-05-11T07:37:17.813384+0000","last_active":"2023-05-11T07:37:19.986353+0000","last_peered":"2023-05-11T07:37:19.986353+0000","last_clean":"2023-05-11T07:37:19.986353+0000","last_became_active":"2023-05-11T07:37:17.813112+0000","last_became_peered":"2023-05-11T07:37:17.813112+0000","last_unstale":"2023-05-11T07:37:19.986353+0000","last_undegraded":"2023-05-11T07:37:19.986353+0000","last_fullsized":"2023-05-11T07:37:19.986353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283875+0000","last_change":"2023-05-11T07:37:18.294542+0000","last_active":"2023-05-11T07:37:19.283875+0000","last_peered":"2023-05-11T07:37:19.283875+0000","last_clean":"2023-05-11T07:37:19.283875+0000","last_became_active":"2023-05-11T07:37:18.294147+0000","last_became_peered":"2023-05-11T07:37:18.294147+0000","last_unstale":"2023-05-11T07:37:19.283875+0000","last_undegraded":"2023-05-11T07:37:19.283875+0000","last_fullsized":"2023-05-11T07:37:19.283875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:21:00.891302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282310+0000","last_change":"2023-05-11T07:37:17.803783+0000","last_active":"2023-05-11T07:37:19.282310+0000","last_peered":"2023-05-11T07:37:19.282310+0000","last_clean":"2023-05-11T07:37:19.282310+0000","last_became_active":"2023-05-11T07:37:17.803516+0000","last_became_peered":"2023-05-11T07:37:17.803516+0000","last_unstale":"2023-05-11T07:37:19.282310+0000","last_undegraded":"2023-05-11T07:37:19.282310+0000","last_fullsized":"2023-05-11T07:37:19.282310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:30:54.188343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992197+0000","last_change":"2023-05-11T07:37:18.292075+0000","last_active":"2023-05-11T07:37:19.992197+0000","last_peered":"2023-05-11T07:37:19.992197+0000","last_clean":"2023-05-11T07:37:19.992197+0000","last_became_active":"2023-05-11T07:37:18.291815+0000","last_became_peered":"2023-05-11T07:37:18.291815+0000","last_unstale":"2023-05-11T07:37:19.992197+0000","last_undegraded":"2023-05-11T07:37:19.992197+0000","last_fullsized":"2023-05-11T07:37:19.992197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:27.787504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993639+0000","last_change":"2023-05-11T07:37:17.803729+0000","last_active":"2023-05-11T07:37:19.993639+0000","last_peered":"2023-05-11T07:37:19.993639+0000","last_clean":"2023-05-11T07:37:19.993639+0000","last_became_active":"2023-05-11T07:37:17.803491+0000","last_became_peered":"2023-05-11T07:37:17.803491+0000","last_unstale":"2023-05-11T07:37:19.993639+0000","last_undegraded":"2023-05-11T07:37:19.993639+0000","last_fullsized":"2023-05-11T07:37:19.993639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:52.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993604+0000","last_change":"2023-05-11T07:37:18.289175+0000","last_active":"2023-05-11T07:37:19.993604+0000","last_peered":"2023-05-11T07:37:19.993604+0000","last_clean":"2023-05-11T07:37:19.993604+0000","last_became_active":"2023-05-11T07:37:18.287810+0000","last_became_peered":"2023-05-11T07:37:18.287810+0000","last_unstale":"2023-05-11T07:37:19.993604+0000","last_undegraded":"2023-05-11T07:37:19.993604+0000","last_fullsized":"2023-05-11T07:37:19.993604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:39.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:17.813722+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:17.813440+0000","last_became_peered":"2023-05-11T07:37:17.813440+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281890+0000","last_change":"2023-05-11T07:37:18.291751+0000","last_active":"2023-05-11T07:37:19.281890+0000","last_peered":"2023-05-11T07:37:19.281890+0000","last_clean":"2023-05-11T07:37:19.281890+0000","last_became_active":"2023-05-11T07:37:18.291049+0000","last_became_peered":"2023-05-11T07:37:18.291049+0000","last_unstale":"2023-05-11T07:37:19.281890+0000","last_undegraded":"2023-05-11T07:37:19.281890+0000","last_fullsized":"2023-05-11T07:37:19.281890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:24.836884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986327+0000","last_change":"2023-05-11T07:37:17.809016+0000","last_active":"2023-05-11T07:37:19.986327+0000","last_peered":"2023-05-11T07:37:19.986327+0000","last_clean":"2023-05-11T07:37:19.986327+0000","last_became_active":"2023-05-11T07:37:17.808761+0000","last_became_peered":"2023-05-11T07:37:17.808761+0000","last_unstale":"2023-05-11T07:37:19.986327+0000","last_undegraded":"2023-05-11T07:37:19.986327+0000","last_fullsized":"2023-05-11T07:37:19.986327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992518+0000","last_change":"2023-05-11T07:37:18.303445+0000","last_active":"2023-05-11T07:37:19.992518+0000","last_peered":"2023-05-11T07:37:19.992518+0000","last_clean":"2023-05-11T07:37:19.992518+0000","last_became_active":"2023-05-11T07:37:18.302989+0000","last_became_peered":"2023-05-11T07:37:18.302989+0000","last_unstale":"2023-05-11T07:37:19.992518+0000","last_undegraded":"2023-05-11T07:37:19.992518+0000","last_fullsized":"2023-05-11T07:37:19.992518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:49.393847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282053+0000","last_change":"2023-05-11T07:37:17.802629+0000","last_active":"2023-05-11T07:37:19.282053+0000","last_peered":"2023-05-11T07:37:19.282053+0000","last_clean":"2023-05-11T07:37:19.282053+0000","last_became_active":"2023-05-11T07:37:17.802309+0000","last_became_peered":"2023-05-11T07:37:17.802309+0000","last_unstale":"2023-05-11T07:37:19.282053+0000","last_undegraded":"2023-05-11T07:37:19.282053+0000","last_fullsized":"2023-05-11T07:37:19.282053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:37.107122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991983+0000","last_change":"2023-05-11T07:37:18.302792+0000","last_active":"2023-05-11T07:37:19.991983+0000","last_peered":"2023-05-11T07:37:19.991983+0000","last_clean":"2023-05-11T07:37:19.991983+0000","last_became_active":"2023-05-11T07:37:18.302144+0000","last_became_peered":"2023-05-11T07:37:18.302144+0000","last_unstale":"2023-05-11T07:37:19.991983+0000","last_undegraded":"2023-05-11T07:37:19.991983+0000","last_fullsized":"2023-05-11T07:37:19.991983+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:50:17.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991960+0000","last_change":"2023-05-11T07:37:17.806893+0000","last_active":"2023-05-11T07:37:19.991960+0000","last_peered":"2023-05-11T07:37:19.991960+0000","last_clean":"2023-05-11T07:37:19.991960+0000","last_became_active":"2023-05-11T07:37:17.806550+0000","last_became_peered":"2023-05-11T07:37:17.806550+0000","last_unstale":"2023-05-11T07:37:19.991960+0000","last_undegraded":"2023-05-11T07:37:19.991960+0000","last_fullsized":"2023-05-11T07:37:19.991960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:21.524193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283429+0000","last_change":"2023-05-11T07:37:18.285399+0000","last_active":"2023-05-11T07:37:19.283429+0000","last_peered":"2023-05-11T07:37:19.283429+0000","last_clean":"2023-05-11T07:37:19.283429+0000","last_became_active":"2023-05-11T07:37:18.284955+0000","last_became_peered":"2023-05-11T07:37:18.284955+0000","last_unstale":"2023-05-11T07:37:19.283429+0000","last_undegraded":"2023-05-11T07:37:19.283429+0000","last_fullsized":"2023-05-11T07:37:19.283429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:24:56.109130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991847+0000","last_change":"2023-05-11T07:37:17.810167+0000","last_active":"2023-05-11T07:37:19.991847+0000","last_peered":"2023-05-11T07:37:19.991847+0000","last_clean":"2023-05-11T07:37:19.991847+0000","last_became_active":"2023-05-11T07:37:17.809905+0000","last_became_peered":"2023-05-11T07:37:17.809905+0000","last_unstale":"2023-05-11T07:37:19.991847+0000","last_undegraded":"2023-05-11T07:37:19.991847+0000","last_fullsized":"2023-05-11T07:37:19.991847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:27.102878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282230+0000","last_change":"2023-05-11T07:37:18.296389+0000","last_active":"2023-05-11T07:37:19.282230+0000","last_peered":"2023-05-11T07:37:19.282230+0000","last_clean":"2023-05-11T07:37:19.282230+0000","last_became_active":"2023-05-11T07:37:18.296111+0000","last_became_peered":"2023-05-11T07:37:18.296111+0000","last_unstale":"2023-05-11T07:37:19.282230+0000","last_undegraded":"2023-05-11T07:37:19.282230+0000","last_fullsized":"2023-05-11T07:37:19.282230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:27:41.360370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282315+0000","last_change":"2023-05-11T07:37:17.801337+0000","last_active":"2023-05-11T07:37:19.282315+0000","last_peered":"2023-05-11T07:37:19.282315+0000","last_clean":"2023-05-11T07:37:19.282315+0000","last_became_active":"2023-05-11T07:37:17.800991+0000","last_became_peered":"2023-05-11T07:37:17.800991+0000","last_unstale":"2023-05-11T07:37:19.282315+0000","last_undegraded":"2023-05-11T07:37:19.282315+0000","last_fullsized":"2023-05-11T07:37:19.282315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:46.905451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993466+0000","last_change":"2023-05-11T07:37:18.295004+0000","last_active":"2023-05-11T07:37:19.993466+0000","last_peered":"2023-05-11T07:37:19.993466+0000","last_clean":"2023-05-11T07:37:19.993466+0000","last_became_active":"2023-05-11T07:37:18.294741+0000","last_became_peered":"2023-05-11T07:37:18.294741+0000","last_unstale":"2023-05-11T07:37:19.993466+0000","last_undegraded":"2023-05-11T07:37:19.993466+0000","last_fullsized":"2023-05-11T07:37:19.993466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:54.412110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992894+0000","last_change":"2023-05-11T07:37:17.809325+0000","last_active":"2023-05-11T07:37:19.992894+0000","last_peered":"2023-05-11T07:37:19.992894+0000","last_clean":"2023-05-11T07:37:19.992894+0000","last_became_active":"2023-05-11T07:37:17.808976+0000","last_became_peered":"2023-05-11T07:37:17.808976+0000","last_unstale":"2023-05-11T07:37:19.992894+0000","last_undegraded":"2023-05-11T07:37:19.992894+0000","last_fullsized":"2023-05-11T07:37:19.992894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986228+0000","last_change":"2023-05-11T07:37:18.293624+0000","last_active":"2023-05-11T07:37:19.986228+0000","last_peered":"2023-05-11T07:37:19.986228+0000","last_clean":"2023-05-11T07:37:19.986228+0000","last_became_active":"2023-05-11T07:37:18.293346+0000","last_became_peered":"2023-05-11T07:37:18.293346+0000","last_unstale":"2023-05-11T07:37:19.986228+0000","last_undegraded":"2023-05-11T07:37:19.986228+0000","last_fullsized":"2023-05-11T07:37:19.986228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993508+0000","last_change":"2023-05-11T07:37:17.813482+0000","last_active":"2023-05-11T07:37:19.993508+0000","last_peered":"2023-05-11T07:37:19.993508+0000","last_clean":"2023-05-11T07:37:19.993508+0000","last_became_active":"2023-05-11T07:37:17.813163+0000","last_became_peered":"2023-05-11T07:37:17.813163+0000","last_unstale":"2023-05-11T07:37:19.993508+0000","last_undegraded":"2023-05-11T07:37:19.993508+0000","last_fullsized":"2023-05-11T07:37:19.993508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:16:44.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993281+0000","last_change":"2023-05-11T07:37:18.290528+0000","last_active":"2023-05-11T07:37:19.993281+0000","last_peered":"2023-05-11T07:37:19.993281+0000","last_clean":"2023-05-11T07:37:19.993281+0000","last_became_active":"2023-05-11T07:37:18.290251+0000","last_became_peered":"2023-05-11T07:37:18.290251+0000","last_unstale":"2023-05-11T07:37:19.993281+0000","last_undegraded":"2023-05-11T07:37:19.993281+0000","last_fullsized":"2023-05-11T07:37:19.993281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992148+0000","last_change":"2023-05-11T07:37:17.804935+0000","last_active":"2023-05-11T07:37:19.992148+0000","last_peered":"2023-05-11T07:37:19.992148+0000","last_clean":"2023-05-11T07:37:19.992148+0000","last_became_active":"2023-05-11T07:37:17.804595+0000","last_became_peered":"2023-05-11T07:37:17.804595+0000","last_unstale":"2023-05-11T07:37:19.992148+0000","last_undegraded":"2023-05-11T07:37:19.992148+0000","last_fullsized":"2023-05-11T07:37:19.992148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:23:20.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283296+0000","last_change":"2023-05-11T07:37:18.302703+0000","last_active":"2023-05-11T07:37:19.283296+0000","last_peered":"2023-05-11T07:37:19.283296+0000","last_clean":"2023-05-11T07:37:19.283296+0000","last_became_active":"2023-05-11T07:37:18.302276+0000","last_became_peered":"2023-05-11T07:37:18.302276+0000","last_unstale":"2023-05-11T07:37:19.283296+0000","last_undegraded":"2023-05-11T07:37:19.283296+0000","last_fullsized":"2023-05-11T07:37:19.283296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:53:03.341271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986180+0000","last_change":"2023-05-11T07:37:17.805056+0000","last_active":"2023-05-11T07:37:19.986180+0000","last_peered":"2023-05-11T07:37:19.986180+0000","last_clean":"2023-05-11T07:37:19.986180+0000","last_became_active":"2023-05-11T07:37:17.804788+0000","last_became_peered":"2023-05-11T07:37:17.804788+0000","last_unstale":"2023-05-11T07:37:19.986180+0000","last_undegraded":"2023-05-11T07:37:19.986180+0000","last_fullsized":"2023-05-11T07:37:19.986180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:55.002267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992557+0000","last_change":"2023-05-11T07:37:18.297601+0000","last_active":"2023-05-11T07:37:19.992557+0000","last_peered":"2023-05-11T07:37:19.992557+0000","last_clean":"2023-05-11T07:37:19.992557+0000","last_became_active":"2023-05-11T07:37:18.297328+0000","last_became_peered":"2023-05-11T07:37:18.297328+0000","last_unstale":"2023-05-11T07:37:19.992557+0000","last_undegraded":"2023-05-11T07:37:19.992557+0000","last_fullsized":"2023-05-11T07:37:19.992557+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:18:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993056+0000","last_change":"2023-05-11T07:37:17.809230+0000","last_active":"2023-05-11T07:37:19.993056+0000","last_peered":"2023-05-11T07:37:19.993056+0000","last_clean":"2023-05-11T07:37:19.993056+0000","last_became_active":"2023-05-11T07:37:17.808956+0000","last_became_peered":"2023-05-11T07:37:17.808956+0000","last_unstale":"2023-05-11T07:37:19.993056+0000","last_undegraded":"2023-05-11T07:37:19.993056+0000","last_fullsized":"2023-05-11T07:37:19.993056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985829+0000","last_change":"2023-05-11T07:37:18.293684+0000","last_active":"2023-05-11T07:37:19.985829+0000","last_peered":"2023-05-11T07:37:19.985829+0000","last_clean":"2023-05-11T07:37:19.985829+0000","last_became_active":"2023-05-11T07:37:18.293412+0000","last_became_peered":"2023-05-11T07:37:18.293412+0000","last_unstale":"2023-05-11T07:37:19.985829+0000","last_undegraded":"2023-05-11T07:37:19.985829+0000","last_fullsized":"2023-05-11T07:37:19.985829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985944+0000","last_change":"2023-05-11T07:37:17.804908+0000","last_active":"2023-05-11T07:37:19.985944+0000","last_peered":"2023-05-11T07:37:19.985944+0000","last_clean":"2023-05-11T07:37:19.985944+0000","last_became_active":"2023-05-11T07:37:17.804649+0000","last_became_peered":"2023-05-11T07:37:17.804649+0000","last_unstale":"2023-05-11T07:37:19.985944+0000","last_undegraded":"2023-05-11T07:37:19.985944+0000","last_fullsized":"2023-05-11T07:37:19.985944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992957+0000","last_change":"2023-05-11T07:37:18.286709+0000","last_active":"2023-05-11T07:37:19.992957+0000","last_peered":"2023-05-11T07:37:19.992957+0000","last_clean":"2023-05-11T07:37:19.992957+0000","last_became_active":"2023-05-11T07:37:18.286345+0000","last_became_peered":"2023-05-11T07:37:18.286345+0000","last_unstale":"2023-05-11T07:37:19.992957+0000","last_undegraded":"2023-05-11T07:37:19.992957+0000","last_fullsized":"2023-05-11T07:37:19.992957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991968+0000","last_change":"2023-05-11T07:37:17.808521+0000","last_active":"2023-05-11T07:37:19.991968+0000","last_peered":"2023-05-11T07:37:19.991968+0000","last_clean":"2023-05-11T07:37:19.991968+0000","last_became_active":"2023-05-11T07:37:17.808176+0000","last_became_peered":"2023-05-11T07:37:17.808176+0000","last_unstale":"2023-05-11T07:37:19.991968+0000","last_undegraded":"2023-05-11T07:37:19.991968+0000","last_fullsized":"2023-05-11T07:37:19.991968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:52:14.634490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991825+0000","last_change":"2023-05-11T07:37:18.294767+0000","last_active":"2023-05-11T07:37:19.991825+0000","last_peered":"2023-05-11T07:37:19.991825+0000","last_clean":"2023-05-11T07:37:19.991825+0000","last_became_active":"2023-05-11T07:37:18.294516+0000","last_became_peered":"2023-05-11T07:37:18.294516+0000","last_unstale":"2023-05-11T07:37:19.991825+0000","last_undegraded":"2023-05-11T07:37:19.991825+0000","last_fullsized":"2023-05-11T07:37:19.991825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:30:18.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991981+0000","last_change":"2023-05-11T07:37:17.802776+0000","last_active":"2023-05-11T07:37:19.991981+0000","last_peered":"2023-05-11T07:37:19.991981+0000","last_clean":"2023-05-11T07:37:19.991981+0000","last_became_active":"2023-05-11T07:37:17.802533+0000","last_became_peered":"2023-05-11T07:37:17.802533+0000","last_unstale":"2023-05-11T07:37:19.991981+0000","last_undegraded":"2023-05-11T07:37:19.991981+0000","last_fullsized":"2023-05-11T07:37:19.991981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:49:16.959783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992780+0000","last_change":"2023-05-11T07:37:18.302806+0000","last_active":"2023-05-11T07:37:19.992780+0000","last_peered":"2023-05-11T07:37:19.992780+0000","last_clean":"2023-05-11T07:37:19.992780+0000","last_became_active":"2023-05-11T07:37:18.302486+0000","last_became_peered":"2023-05-11T07:37:18.302486+0000","last_unstale":"2023-05-11T07:37:19.992780+0000","last_undegraded":"2023-05-11T07:37:19.992780+0000","last_fullsized":"2023-05-11T07:37:19.992780+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:12:57.745998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282198+0000","last_change":"2023-05-11T07:37:17.801549+0000","last_active":"2023-05-11T07:37:19.282198+0000","last_peered":"2023-05-11T07:37:19.282198+0000","last_clean":"2023-05-11T07:37:19.282198+0000","last_became_active":"2023-05-11T07:37:17.801223+0000","last_became_peered":"2023-05-11T07:37:17.801223+0000","last_unstale":"2023-05-11T07:37:19.282198+0000","last_undegraded":"2023-05-11T07:37:19.282198+0000","last_fullsized":"2023-05-11T07:37:19.282198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:45.174857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283835+0000","last_change":"2023-05-11T07:37:18.289641+0000","last_active":"2023-05-11T07:37:19.283835+0000","last_peered":"2023-05-11T07:37:19.283835+0000","last_clean":"2023-05-11T07:37:19.283835+0000","last_became_active":"2023-05-11T07:37:18.289266+0000","last_became_peered":"2023-05-11T07:37:18.289266+0000","last_unstale":"2023-05-11T07:37:19.283835+0000","last_undegraded":"2023-05-11T07:37:19.283835+0000","last_fullsized":"2023-05-11T07:37:19.283835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:07:10.450228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992371+0000","last_change":"2023-05-11T07:37:17.806924+0000","last_active":"2023-05-11T07:37:19.992371+0000","last_peered":"2023-05-11T07:37:19.992371+0000","last_clean":"2023-05-11T07:37:19.992371+0000","last_became_active":"2023-05-11T07:37:17.806632+0000","last_became_peered":"2023-05-11T07:37:17.806632+0000","last_unstale":"2023-05-11T07:37:19.992371+0000","last_undegraded":"2023-05-11T07:37:19.992371+0000","last_fullsized":"2023-05-11T07:37:19.992371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:15.881529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283860+0000","last_change":"2023-05-11T07:37:18.287300+0000","last_active":"2023-05-11T07:37:19.283860+0000","last_peered":"2023-05-11T07:37:19.283860+0000","last_clean":"2023-05-11T07:37:19.283860+0000","last_became_active":"2023-05-11T07:37:18.286982+0000","last_became_peered":"2023-05-11T07:37:18.286982+0000","last_unstale":"2023-05-11T07:37:19.283860+0000","last_undegraded":"2023-05-11T07:37:19.283860+0000","last_fullsized":"2023-05-11T07:37:19.283860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:08:12.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986279+0000","last_change":"2023-05-11T07:37:17.811963+0000","last_active":"2023-05-11T07:37:19.986279+0000","last_peered":"2023-05-11T07:37:19.986279+0000","last_clean":"2023-05-11T07:37:19.986279+0000","last_became_active":"2023-05-11T07:37:17.811718+0000","last_became_peered":"2023-05-11T07:37:17.811718+0000","last_unstale":"2023-05-11T07:37:19.986279+0000","last_undegraded":"2023-05-11T07:37:19.986279+0000","last_fullsized":"2023-05-11T07:37:19.986279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:58:39.409698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986060+0000","last_change":"2023-05-11T07:37:18.294227+0000","last_active":"2023-05-11T07:37:19.986060+0000","last_peered":"2023-05-11T07:37:19.986060+0000","last_clean":"2023-05-11T07:37:19.986060+0000","last_became_active":"2023-05-11T07:37:18.293962+0000","last_became_peered":"2023-05-11T07:37:18.293962+0000","last_unstale":"2023-05-11T07:37:19.986060+0000","last_undegraded":"2023-05-11T07:37:19.986060+0000","last_fullsized":"2023-05-11T07:37:19.986060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:31:48.833972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986258+0000","last_change":"2023-05-11T07:37:17.809327+0000","last_active":"2023-05-11T07:37:19.986258+0000","last_peered":"2023-05-11T07:37:19.986258+0000","last_clean":"2023-05-11T07:37:19.986258+0000","last_became_active":"2023-05-11T07:37:17.808953+0000","last_became_peered":"2023-05-11T07:37:17.808953+0000","last_unstale":"2023-05-11T07:37:19.986258+0000","last_undegraded":"2023-05-11T07:37:19.986258+0000","last_fullsized":"2023-05-11T07:37:19.986258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:41.118642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993416+0000","last_change":"2023-05-11T07:37:18.293169+0000","last_active":"2023-05-11T07:37:19.993416+0000","last_peered":"2023-05-11T07:37:19.993416+0000","last_clean":"2023-05-11T07:37:19.993416+0000","last_became_active":"2023-05-11T07:37:18.292862+0000","last_became_peered":"2023-05-11T07:37:18.292862+0000","last_unstale":"2023-05-11T07:37:19.993416+0000","last_undegraded":"2023-05-11T07:37:19.993416+0000","last_fullsized":"2023-05-11T07:37:19.993416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:21.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991908+0000","last_change":"2023-05-11T07:37:17.808473+0000","last_active":"2023-05-11T07:37:19.991908+0000","last_peered":"2023-05-11T07:37:19.991908+0000","last_clean":"2023-05-11T07:37:19.991908+0000","last_became_active":"2023-05-11T07:37:17.808069+0000","last_became_peered":"2023-05-11T07:37:17.808069+0000","last_unstale":"2023-05-11T07:37:19.991908+0000","last_undegraded":"2023-05-11T07:37:19.991908+0000","last_fullsized":"2023-05-11T07:37:19.991908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991589+0000","last_change":"2023-05-11T07:37:18.289485+0000","last_active":"2023-05-11T07:37:19.991589+0000","last_peered":"2023-05-11T07:37:19.991589+0000","last_clean":"2023-05-11T07:37:19.991589+0000","last_became_active":"2023-05-11T07:37:18.289211+0000","last_became_peered":"2023-05-11T07:37:18.289211+0000","last_unstale":"2023-05-11T07:37:19.991589+0000","last_undegraded":"2023-05-11T07:37:19.991589+0000","last_fullsized":"2023-05-11T07:37:19.991589+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:00:01.334038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992227+0000","last_change":"2023-05-11T07:37:17.810204+0000","last_active":"2023-05-11T07:37:19.992227+0000","last_peered":"2023-05-11T07:37:19.992227+0000","last_clean":"2023-05-11T07:37:19.992227+0000","last_became_active":"2023-05-11T07:37:17.809936+0000","last_became_peered":"2023-05-11T07:37:17.809936+0000","last_unstale":"2023-05-11T07:37:19.992227+0000","last_undegraded":"2023-05-11T07:37:19.992227+0000","last_fullsized":"2023-05-11T07:37:19.992227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:01:22.030233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991918+0000","last_change":"2023-05-11T07:37:18.299199+0000","last_active":"2023-05-11T07:37:19.991918+0000","last_peered":"2023-05-11T07:37:19.991918+0000","last_clean":"2023-05-11T07:37:19.991918+0000","last_became_active":"2023-05-11T07:37:18.298935+0000","last_became_peered":"2023-05-11T07:37:18.298935+0000","last_unstale":"2023-05-11T07:37:19.991918+0000","last_undegraded":"2023-05-11T07:37:19.991918+0000","last_fullsized":"2023-05-11T07:37:19.991918+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:58.151794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992759+0000","last_change":"2023-05-11T07:37:17.809276+0000","last_active":"2023-05-11T07:37:19.992759+0000","last_peered":"2023-05-11T07:37:19.992759+0000","last_clean":"2023-05-11T07:37:19.992759+0000","last_became_active":"2023-05-11T07:37:17.809035+0000","last_became_peered":"2023-05-11T07:37:17.809035+0000","last_unstale":"2023-05-11T07:37:19.992759+0000","last_undegraded":"2023-05-11T07:37:19.992759+0000","last_fullsized":"2023-05-11T07:37:19.992759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:20.856372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281811+0000","last_change":"2023-05-11T07:37:18.292506+0000","last_active":"2023-05-11T07:37:19.281811+0000","last_peered":"2023-05-11T07:37:19.281811+0000","last_clean":"2023-05-11T07:37:19.281811+0000","last_became_active":"2023-05-11T07:37:18.292151+0000","last_became_peered":"2023-05-11T07:37:18.292151+0000","last_unstale":"2023-05-11T07:37:19.281811+0000","last_undegraded":"2023-05-11T07:37:19.281811+0000","last_fullsized":"2023-05-11T07:37:19.281811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:57:57.495757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992068+0000","last_change":"2023-05-11T07:37:17.803987+0000","last_active":"2023-05-11T07:37:19.992068+0000","last_peered":"2023-05-11T07:37:19.992068+0000","last_clean":"2023-05-11T07:37:19.992068+0000","last_became_active":"2023-05-11T07:37:17.803730+0000","last_became_peered":"2023-05-11T07:37:17.803730+0000","last_unstale":"2023-05-11T07:37:19.992068+0000","last_undegraded":"2023-05-11T07:37:19.992068+0000","last_fullsized":"2023-05-11T07:37:19.992068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:21:35.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993411+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:37:19.993411+0000","last_peered":"2023-05-11T07:37:19.993411+0000","last_clean":"2023-05-11T07:37:19.993411+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:37:19.993411+0000","last_undegraded":"2023-05-11T07:37:19.993411+0000","last_fullsized":"2023-05-11T07:37:19.993411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:54.361555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283895+0000","last_change":"2023-05-11T07:37:18.302712+0000","last_active":"2023-05-11T07:37:19.283895+0000","last_peered":"2023-05-11T07:37:19.283895+0000","last_clean":"2023-05-11T07:37:19.283895+0000","last_became_active":"2023-05-11T07:37:18.302367+0000","last_became_peered":"2023-05-11T07:37:18.302367+0000","last_unstale":"2023-05-11T07:37:19.283895+0000","last_undegraded":"2023-05-11T07:37:19.283895+0000","last_fullsized":"2023-05-11T07:37:19.283895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:23.623043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.988486+0000","last_change":"2023-05-11T07:37:17.806226+0000","last_active":"2023-05-11T07:37:19.988486+0000","last_peered":"2023-05-11T07:37:19.988486+0000","last_clean":"2023-05-11T07:37:19.988486+0000","last_became_active":"2023-05-11T07:37:17.805937+0000","last_became_peered":"2023-05-11T07:37:17.805937+0000","last_unstale":"2023-05-11T07:37:19.988486+0000","last_undegraded":"2023-05-11T07:37:19.988486+0000","last_fullsized":"2023-05-11T07:37:19.988486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991966+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:37:19.991966+0000","last_peered":"2023-05-11T07:37:19.991966+0000","last_clean":"2023-05-11T07:37:19.991966+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:37:19.991966+0000","last_undegraded":"2023-05-11T07:37:19.991966+0000","last_fullsized":"2023-05-11T07:37:19.991966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:00.155128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992737+0000","last_change":"2023-05-11T07:37:18.294025+0000","last_active":"2023-05-11T07:37:19.992737+0000","last_peered":"2023-05-11T07:37:19.992737+0000","last_clean":"2023-05-11T07:37:19.992737+0000","last_became_active":"2023-05-11T07:37:18.293752+0000","last_became_peered":"2023-05-11T07:37:18.293752+0000","last_unstale":"2023-05-11T07:37:19.992737+0000","last_undegraded":"2023-05-11T07:37:19.992737+0000","last_fullsized":"2023-05-11T07:37:19.992737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:39:05.817992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993579+0000","last_change":"2023-05-11T07:37:17.812286+0000","last_active":"2023-05-11T07:37:19.993579+0000","last_peered":"2023-05-11T07:37:19.993579+0000","last_clean":"2023-05-11T07:37:19.993579+0000","last_became_active":"2023-05-11T07:37:17.811876+0000","last_became_peered":"2023-05-11T07:37:17.811876+0000","last_unstale":"2023-05-11T07:37:19.993579+0000","last_undegraded":"2023-05-11T07:37:19.993579+0000","last_fullsized":"2023-05-11T07:37:19.993579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:26.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991425+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:37:19.991425+0000","last_peered":"2023-05-11T07:37:19.991425+0000","last_clean":"2023-05-11T07:37:19.991425+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:37:19.991425+0000","last_undegraded":"2023-05-11T07:37:19.991425+0000","last_fullsized":"2023-05-11T07:37:19.991425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:52:30.578344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992849+0000","last_change":"2023-05-11T07:37:18.297675+0000","last_active":"2023-05-11T07:37:19.992849+0000","last_peered":"2023-05-11T07:37:19.992849+0000","last_clean":"2023-05-11T07:37:19.992849+0000","last_became_active":"2023-05-11T07:37:18.297412+0000","last_became_peered":"2023-05-11T07:37:18.297412+0000","last_unstale":"2023-05-11T07:37:19.992849+0000","last_undegraded":"2023-05-11T07:37:19.992849+0000","last_fullsized":"2023-05-11T07:37:19.992849+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992392+0000","last_change":"2023-05-11T07:37:17.804167+0000","last_active":"2023-05-11T07:37:19.992392+0000","last_peered":"2023-05-11T07:37:19.992392+0000","last_clean":"2023-05-11T07:37:19.992392+0000","last_became_active":"2023-05-11T07:37:17.803797+0000","last_became_peered":"2023-05-11T07:37:17.803797+0000","last_unstale":"2023-05-11T07:37:19.992392+0000","last_undegraded":"2023-05-11T07:37:19.992392+0000","last_fullsized":"2023-05-11T07:37:19.992392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:27.503714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991965+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:37:19.991965+0000","last_peered":"2023-05-11T07:37:19.991965+0000","last_clean":"2023-05-11T07:37:19.991965+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:37:19.991965+0000","last_undegraded":"2023-05-11T07:37:19.991965+0000","last_fullsized":"2023-05-11T07:37:19.991965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:38:09.432242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992843+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:37:19.992843+0000","last_peered":"2023-05-11T07:37:19.992843+0000","last_clean":"2023-05-11T07:37:19.992843+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:37:19.992843+0000","last_undegraded":"2023-05-11T07:37:19.992843+0000","last_fullsized":"2023-05-11T07:37:19.992843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:04.224988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993367+0000","last_change":"2023-05-11T07:37:18.294585+0000","last_active":"2023-05-11T07:37:19.993367+0000","last_peered":"2023-05-11T07:37:19.993367+0000","last_clean":"2023-05-11T07:37:19.993367+0000","last_became_active":"2023-05-11T07:37:18.294299+0000","last_became_peered":"2023-05-11T07:37:18.294299+0000","last_unstale":"2023-05-11T07:37:19.993367+0000","last_undegraded":"2023-05-11T07:37:19.993367+0000","last_fullsized":"2023-05-11T07:37:19.993367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993477+0000","last_change":"2023-05-11T07:37:17.800828+0000","last_active":"2023-05-11T07:37:19.993477+0000","last_peered":"2023-05-11T07:37:19.993477+0000","last_clean":"2023-05-11T07:37:19.993477+0000","last_became_active":"2023-05-11T07:37:17.800524+0000","last_became_peered":"2023-05-11T07:37:17.800524+0000","last_unstale":"2023-05-11T07:37:19.993477+0000","last_undegraded":"2023-05-11T07:37:19.993477+0000","last_fullsized":"2023-05-11T07:37:19.993477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:35.326768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992929+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:37:19.992929+0000","last_peered":"2023-05-11T07:37:19.992929+0000","last_clean":"2023-05-11T07:37:19.992929+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:37:19.992929+0000","last_undegraded":"2023-05-11T07:37:19.992929+0000","last_fullsized":"2023-05-11T07:37:19.992929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:56:55.436349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991922+0000","last_change":"2023-05-11T07:37:18.290604+0000","last_active":"2023-05-11T07:37:19.991922+0000","last_peered":"2023-05-11T07:37:19.991922+0000","last_clean":"2023-05-11T07:37:19.991922+0000","last_became_active":"2023-05-11T07:37:18.290265+0000","last_became_peered":"2023-05-11T07:37:18.290265+0000","last_unstale":"2023-05-11T07:37:19.991922+0000","last_undegraded":"2023-05-11T07:37:19.991922+0000","last_fullsized":"2023-05-11T07:37:19.991922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993255+0000","last_change":"2023-05-11T07:37:17.803117+0000","last_active":"2023-05-11T07:37:19.993255+0000","last_peered":"2023-05-11T07:37:19.993255+0000","last_clean":"2023-05-11T07:37:19.993255+0000","last_became_active":"2023-05-11T07:37:17.802884+0000","last_became_peered":"2023-05-11T07:37:17.802884+0000","last_unstale":"2023-05-11T07:37:19.993255+0000","last_undegraded":"2023-05-11T07:37:19.993255+0000","last_fullsized":"2023-05-11T07:37:19.993255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:30.669761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993568+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:37:19.993568+0000","last_peered":"2023-05-11T07:37:19.993568+0000","last_clean":"2023-05-11T07:37:19.993568+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:37:19.993568+0000","last_undegraded":"2023-05-11T07:37:19.993568+0000","last_fullsized":"2023-05-11T07:37:19.993568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:18.654496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986054+0000","last_change":"2023-05-11T07:37:18.296544+0000","last_active":"2023-05-11T07:37:19.986054+0000","last_peered":"2023-05-11T07:37:19.986054+0000","last_clean":"2023-05-11T07:37:19.986054+0000","last_became_active":"2023-05-11T07:37:18.295758+0000","last_became_peered":"2023-05-11T07:37:18.295758+0000","last_unstale":"2023-05-11T07:37:19.986054+0000","last_undegraded":"2023-05-11T07:37:19.986054+0000","last_fullsized":"2023-05-11T07:37:19.986054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:34:51.857400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281928+0000","last_change":"2023-05-11T07:37:17.805120+0000","last_active":"2023-05-11T07:37:19.281928+0000","last_peered":"2023-05-11T07:37:19.281928+0000","last_clean":"2023-05-11T07:37:19.281928+0000","last_became_active":"2023-05-11T07:37:17.804834+0000","last_became_peered":"2023-05-11T07:37:17.804834+0000","last_unstale":"2023-05-11T07:37:19.281928+0000","last_undegraded":"2023-05-11T07:37:19.281928+0000","last_fullsized":"2023-05-11T07:37:19.281928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:10:26.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993536+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:37:19.993536+0000","last_peered":"2023-05-11T07:37:19.993536+0000","last_clean":"2023-05-11T07:37:19.993536+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:37:19.993536+0000","last_undegraded":"2023-05-11T07:37:19.993536+0000","last_fullsized":"2023-05-11T07:37:19.993536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:21:18.916469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986122+0000","last_change":"2023-05-11T07:37:18.292755+0000","last_active":"2023-05-11T07:37:19.986122+0000","last_peered":"2023-05-11T07:37:19.986122+0000","last_clean":"2023-05-11T07:37:19.986122+0000","last_became_active":"2023-05-11T07:37:18.292496+0000","last_became_peered":"2023-05-11T07:37:18.292496+0000","last_unstale":"2023-05-11T07:37:19.986122+0000","last_undegraded":"2023-05-11T07:37:19.986122+0000","last_fullsized":"2023-05-11T07:37:19.986122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:21.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993267+0000","last_change":"2023-05-11T07:37:17.813490+0000","last_active":"2023-05-11T07:37:19.993267+0000","last_peered":"2023-05-11T07:37:19.993267+0000","last_clean":"2023-05-11T07:37:19.993267+0000","last_became_active":"2023-05-11T07:37:17.813185+0000","last_became_peered":"2023-05-11T07:37:17.813185+0000","last_unstale":"2023-05-11T07:37:19.993267+0000","last_undegraded":"2023-05-11T07:37:19.993267+0000","last_fullsized":"2023-05-11T07:37:19.993267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.284047+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:37:19.284047+0000","last_peered":"2023-05-11T07:37:19.284047+0000","last_clean":"2023-05-11T07:37:19.284047+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:37:19.284047+0000","last_undegraded":"2023-05-11T07:37:19.284047+0000","last_fullsized":"2023-05-11T07:37:19.284047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:22.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.736000000000001,"5min":17.736000000000001,"15min":17.736000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":18.178000000000001,"5min":18.178000000000001,"15min":18.178000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":17.706,"5min":17.706,"15min":17.706},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":18.143999999999998,"5min":18.143999999999998,"15min":18.143999999999998},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.765000000000001,"5min":17.765000000000001,"15min":17.765000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":17.917999999999999,"5min":17.917999999999999,"15min":17.917999999999999},"last":0.63},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":17.602,"5min":17.602,"15min":17.602},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":17.992999999999999,"5min":17.992999999999999,"15min":17.992999999999999},"last":0.748}]},{"osd":6,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":17.558,"5min":17.558,"15min":17.558},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":17.960999999999999,"5min":17.960999999999999,"15min":17.960999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":14.349,"5min":14.349,"15min":14.349},"last":0.79200000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.745}]},{"osd":5,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.76400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":491520,"data_stored":213101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.313}]},{"osd":1,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.439},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.497}]},{"osd":6,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8668,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363172,"statfs":{"total":96636764160,"available":96627888128,"internally_reserved":0,"allocated":479232,"data_stored":211585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.436},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":12.396000000000001,"5min":12.396000000000001,"15min":12.396000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":12.429,"5min":12.429,"15min":12.429},"last":0.504}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.752},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.919,"5min":11.919,"15min":11.919},"last":0.627},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":12.329000000000001,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":12.051,"5min":12.051,"15min":12.051},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":12.287000000000001,"5min":12.287000000000001,"15min":12.287000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":12.016999999999999,"5min":12.016999999999999,"15min":12.016999999999999},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":0.44}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.623},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.746}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":495616,"data_stored":219160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.432},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:37:27.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T07:37:27.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.672+0000 7f3027bff700 1 Processor -- start 2023-05-11T07:37:27.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.672+0000 7f3027bff700 1 -- start start 2023-05-11T07:37:27.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.673+0000 7f3027bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f30200b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.673+0000 7f3027bff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200b3dc0 con 0x7f302015cc30 2023-05-11T07:37:27.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.673+0000 7f3027bff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200d08d0 con 0x7f302015d000 2023-05-11T07:37:27.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.673+0000 7f3027bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30200d0bb0 con 0x7f302006baf0 2023-05-11T07:37:27.677 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.673+0000 7f302599b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f302015cc30 0x7f302006b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35480/0 (socket says 172.21.15.144:35480) 2023-05-11T07:37:27.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f302599b700 1 -- 172.21.15.144:0/3938603076 learned_addr learned my addr 172.21.15.144:0/3938603076 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:27.678 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f302519a700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f30200b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235997839 0 0) 0x7f30200b3dc0 con 0x7f302015cc30 2023-05-11T07:37:27.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300c0035b0 con 0x7f302015cc30 2023-05-11T07:37:27.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283172694 0 0) 0x7f30200d08d0 con 0x7f302015d000 2023-05-11T07:37:27.680 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30200b3dc0 con 0x7f302015d000 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067975274 0 0) 0x7f300c0035b0 con 0x7f302015cc30 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 msgr2=0x7f30200b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f30200b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 >> v1:172.21.15.145:6789/0 conn(0x7f302015d000 legacy=0x7f30200b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200b4010 con 0x7f302015cc30 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1730707246 0 0) 0x7f301c001670 con 0x7f302015cc30 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 >> v1:172.21.15.144:6789/0 conn(0x7f302015cc30 legacy=0x7f302006b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.681 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f300c003bc0 0x7f300c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f300c004850 0x7f300c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f300c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30200d0bb0 con 0x7f300c003bc0 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c00bac0 con 0x7f300c004850 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.674+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c00bc30 con 0x7f302006baf0 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f300c003bc0 0x7f300c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.682 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302519a700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f300c004850 0x7f300c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302619c700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f300c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 -- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 msgr2=0x7f300c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f302006baf0 0x7f300c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 -- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f300c004850 msgr2=0x7f300c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f300c004850 0x7f300c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 -- 172.21.15.144:0/3938603076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c0035b0 con 0x7f300c003bc0 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.675+0000 7f302599b700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f300c003bc0 0x7f300c003fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c210 tx=0x7f300c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1f9f0d7b8aae82 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00cd50 con 0x7f300c003bc0 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c005960 con 0x7f300c003bc0 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3024999700 1 -- 172.21.15.144:0/3938603076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c005d10 con 0x7f300c003bc0 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 -- 172.21.15.144:0/3938603076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f300c003bc0 msgr2=0x7f300c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 --2- 172.21.15.144:0/3938603076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f300c003bc0 0x7f300c003fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c210 tx=0x7f300c005880 comp rx=0 tx=0).stop 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f302619c700 1 -- 172.21.15.144:0/3938603076 reap_dead start 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 -- 172.21.15.144:0/3938603076 shutdown_connections 2023-05-11T07:37:27.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 -- 172.21.15.144:0/3938603076 >> 172.21.15.144:0/3938603076 conn(0x7f302009a2e0 msgr2=0x7f30200d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:27.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 -- 172.21.15.144:0/3938603076 shutdown_connections 2023-05-11T07:37:27.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.676+0000 7f3027bff700 1 -- 172.21.15.144:0/3938603076 wait complete. 2023-05-11T07:37:27.686 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.679+0000 7f3027bff700 1 Processor -- start 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.679+0000 7f3027bff700 1 -- start start 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f300c003bc0 0x7f30201f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 0x7f302009daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30201f5610 con 0x7f30201f1c70 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302009e6b0 con 0x7f30201f1800 2023-05-11T07:37:27.687 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f3027bff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302009e990 con 0x7f300c003bc0 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f302619c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f302619c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34668/0 (socket says 172.21.15.144:34668) 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.680+0000 7f302619c700 1 -- 172.21.15.144:0/717734808 learned_addr learned my addr 172.21.15.144:0/717734808 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302519a700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 0x7f302009daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302599b700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f300c003bc0 0x7f30201f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.688 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 -- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f300c003bc0 msgr2=0x7f30201f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f300c003bc0 0x7f30201f60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 -- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 msgr2=0x7f302009daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 0x7f302009daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 -- 172.21.15.144:0/717734808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200d0560 con 0x7f30201f1c70 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302519a700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 0x7f302009daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f302619c700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f302008b260 tx=0x7f301800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3018003cd0 con 0x7f30201f1c70 2023-05-11T07:37:27.689 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3018003e50 con 0x7f30201f1c70 2023-05-11T07:37:27.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30200b42f0 con 0x7f30201f1c70 2023-05-11T07:37:27.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800dbd0 con 0x7f30201f1c70 2023-05-11T07:37:27.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.681+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30200b23f0 con 0x7f30201f1c70 2023-05-11T07:37:27.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.682+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3020070180 con 0x7f30201f1c70 2023-05-11T07:37:27.690 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.683+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f301800dd30 con 0x7f30201f1c70 2023-05-11T07:37:27.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.684+0000 7f30167fc700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 0x7f300406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:27.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.684+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3018089a10 con 0x7f30201f1c70 2023-05-11T07:37:27.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.684+0000 7f302599b700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 0x7f300406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:27.691 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.685+0000 7f302599b700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 0x7f300406d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f301c015040 tx=0x7f301c007f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:27.692 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.689+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f30180548e0 con 0x7f30201f1c70 2023-05-11T07:37:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.881+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 --> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30201f5750 con 0x7f300406ace0 2023-05-11T07:37:27.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.890+0000 7f30167fc700 1 -- 172.21.15.144:0/717734808 <== mgr.4110 v2:172.21.15.144:6832/2010441590 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310479 (secure 0 0 0) 0x7f301c0014b0 con 0x7f300406ace0 2023-05-11T07:37:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 msgr2=0x7f300406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 0x7f300406d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f301c015040 tx=0x7f301c007f90 comp rx=0 tx=0).stop 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 msgr2=0x7f302009e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f302008b260 tx=0x7f301800d430 comp rx=0 tx=0).stop 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 shutdown_connections 2023-05-11T07:37:27.899 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f300406ace0 0x7f300406d190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f300c003bc0 0x7f30201f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201f1c70 0x7f302009e030 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 --2- 172.21.15.144:0/717734808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30201f1800 0x7f302009daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 >> 172.21.15.144:0/717734808 conn(0x7f302009a2e0 msgr2=0x7f30200ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 shutdown_connections 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:27.894+0000 7f3027bff700 1 -- 172.21.15.144:0/717734808 wait complete. 2023-05-11T07:37:27.900 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2023-05-11T07:37:27.915 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-05-11T07:37:27.737315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71784,"kb_used_data":5032,"kb_used_omap":0,"kb_used_meta":66688,"kb_avail":754902936,"statfs":{"total":773094113280,"available":773020606464,"internally_reserved":0,"allocated":5152768,"data_stored":2933364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68288512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.464576"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:18.291434+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:18.291148+0000","last_became_peered":"2023-05-11T07:37:18.291148+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:22.530712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992276+0000","last_change":"2023-05-11T07:37:18.301388+0000","last_active":"2023-05-11T07:37:19.992276+0000","last_peered":"2023-05-11T07:37:19.992276+0000","last_clean":"2023-05-11T07:37:19.992276+0000","last_became_active":"2023-05-11T07:37:18.301121+0000","last_became_peered":"2023-05-11T07:37:18.301121+0000","last_unstale":"2023-05-11T07:37:19.992276+0000","last_undegraded":"2023-05-11T07:37:19.992276+0000","last_fullsized":"2023-05-11T07:37:19.992276+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:49:47.667555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282046+0000","last_change":"2023-05-11T07:37:18.292177+0000","last_active":"2023-05-11T07:37:19.282046+0000","last_peered":"2023-05-11T07:37:19.282046+0000","last_clean":"2023-05-11T07:37:19.282046+0000","last_became_active":"2023-05-11T07:37:18.291845+0000","last_became_peered":"2023-05-11T07:37:18.291845+0000","last_unstale":"2023-05-11T07:37:19.282046+0000","last_undegraded":"2023-05-11T07:37:19.282046+0000","last_fullsized":"2023-05-11T07:37:19.282046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:23.945011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992624+0000","last_change":"2023-05-11T07:37:18.302708+0000","last_active":"2023-05-11T07:37:19.992624+0000","last_peered":"2023-05-11T07:37:19.992624+0000","last_clean":"2023-05-11T07:37:19.992624+0000","last_became_active":"2023-05-11T07:37:18.302418+0000","last_became_peered":"2023-05-11T07:37:18.302418+0000","last_unstale":"2023-05-11T07:37:19.992624+0000","last_undegraded":"2023-05-11T07:37:19.992624+0000","last_fullsized":"2023-05-11T07:37:19.992624+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:16:40.908200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991955+0000","last_change":"2023-05-11T07:37:18.301367+0000","last_active":"2023-05-11T07:37:19.991955+0000","last_peered":"2023-05-11T07:37:19.991955+0000","last_clean":"2023-05-11T07:37:19.991955+0000","last_became_active":"2023-05-11T07:37:18.301084+0000","last_became_peered":"2023-05-11T07:37:18.301084+0000","last_unstale":"2023-05-11T07:37:19.991955+0000","last_undegraded":"2023-05-11T07:37:19.991955+0000","last_fullsized":"2023-05-11T07:37:19.991955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985990+0000","last_change":"2023-05-11T07:37:18.294756+0000","last_active":"2023-05-11T07:37:19.985990+0000","last_peered":"2023-05-11T07:37:19.985990+0000","last_clean":"2023-05-11T07:37:19.985990+0000","last_became_active":"2023-05-11T07:37:18.294511+0000","last_became_peered":"2023-05-11T07:37:18.294511+0000","last_unstale":"2023-05-11T07:37:19.985990+0000","last_undegraded":"2023-05-11T07:37:19.985990+0000","last_fullsized":"2023-05-11T07:37:19.985990+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:05:29.224864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993012+0000","last_change":"2023-05-11T07:37:18.292016+0000","last_active":"2023-05-11T07:37:19.993012+0000","last_peered":"2023-05-11T07:37:19.993012+0000","last_clean":"2023-05-11T07:37:19.993012+0000","last_became_active":"2023-05-11T07:37:18.291768+0000","last_became_peered":"2023-05-11T07:37:18.291768+0000","last_unstale":"2023-05-11T07:37:19.993012+0000","last_undegraded":"2023-05-11T07:37:19.993012+0000","last_fullsized":"2023-05-11T07:37:19.993012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:42.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991762+0000","last_change":"2023-05-11T07:37:18.303167+0000","last_active":"2023-05-11T07:37:19.991762+0000","last_peered":"2023-05-11T07:37:19.991762+0000","last_clean":"2023-05-11T07:37:19.991762+0000","last_became_active":"2023-05-11T07:37:18.302509+0000","last_became_peered":"2023-05-11T07:37:18.302509+0000","last_unstale":"2023-05-11T07:37:19.991762+0000","last_undegraded":"2023-05-11T07:37:19.991762+0000","last_fullsized":"2023-05-11T07:37:19.991762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:41:42.609012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992609+0000","last_change":"2023-05-11T07:37:18.299381+0000","last_active":"2023-05-11T07:37:19.992609+0000","last_peered":"2023-05-11T07:37:19.992609+0000","last_clean":"2023-05-11T07:37:19.992609+0000","last_became_active":"2023-05-11T07:37:18.299121+0000","last_became_peered":"2023-05-11T07:37:18.299121+0000","last_unstale":"2023-05-11T07:37:19.992609+0000","last_undegraded":"2023-05-11T07:37:19.992609+0000","last_fullsized":"2023-05-11T07:37:19.992609+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:27:58.862280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992809+0000","last_change":"2023-05-11T07:37:18.304312+0000","last_active":"2023-05-11T07:37:19.992809+0000","last_peered":"2023-05-11T07:37:19.992809+0000","last_clean":"2023-05-11T07:37:19.992809+0000","last_became_active":"2023-05-11T07:37:18.303884+0000","last_became_peered":"2023-05-11T07:37:18.303884+0000","last_unstale":"2023-05-11T07:37:19.992809+0000","last_undegraded":"2023-05-11T07:37:19.992809+0000","last_fullsized":"2023-05-11T07:37:19.992809+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992471+0000","last_change":"2023-05-11T07:37:18.292545+0000","last_active":"2023-05-11T07:37:19.992471+0000","last_peered":"2023-05-11T07:37:19.992471+0000","last_clean":"2023-05-11T07:37:19.992471+0000","last_became_active":"2023-05-11T07:37:18.292224+0000","last_became_peered":"2023-05-11T07:37:18.292224+0000","last_unstale":"2023-05-11T07:37:19.992471+0000","last_undegraded":"2023-05-11T07:37:19.992471+0000","last_fullsized":"2023-05-11T07:37:19.992471+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:10:20.312501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992369+0000","last_change":"2023-05-11T07:37:18.296188+0000","last_active":"2023-05-11T07:37:19.992369+0000","last_peered":"2023-05-11T07:37:19.992369+0000","last_clean":"2023-05-11T07:37:19.992369+0000","last_became_active":"2023-05-11T07:37:18.295883+0000","last_became_peered":"2023-05-11T07:37:18.295883+0000","last_unstale":"2023-05-11T07:37:19.992369+0000","last_undegraded":"2023-05-11T07:37:19.992369+0000","last_fullsized":"2023-05-11T07:37:19.992369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:11:59.401409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991859+0000","last_change":"2023-05-11T07:37:18.290472+0000","last_active":"2023-05-11T07:37:19.991859+0000","last_peered":"2023-05-11T07:37:19.991859+0000","last_clean":"2023-05-11T07:37:19.991859+0000","last_became_active":"2023-05-11T07:37:18.290200+0000","last_became_peered":"2023-05-11T07:37:18.290200+0000","last_unstale":"2023-05-11T07:37:19.991859+0000","last_undegraded":"2023-05-11T07:37:19.991859+0000","last_fullsized":"2023-05-11T07:37:19.991859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:04:09.879877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992561+0000","last_change":"2023-05-11T07:37:18.292414+0000","last_active":"2023-05-11T07:37:19.992561+0000","last_peered":"2023-05-11T07:37:19.992561+0000","last_clean":"2023-05-11T07:37:19.992561+0000","last_became_active":"2023-05-11T07:37:18.292152+0000","last_became_peered":"2023-05-11T07:37:18.292152+0000","last_unstale":"2023-05-11T07:37:19.992561+0000","last_undegraded":"2023-05-11T07:37:19.992561+0000","last_fullsized":"2023-05-11T07:37:19.992561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:29:58.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985989+0000","last_change":"2023-05-11T07:37:18.295459+0000","last_active":"2023-05-11T07:37:19.985989+0000","last_peered":"2023-05-11T07:37:19.985989+0000","last_clean":"2023-05-11T07:37:19.985989+0000","last_became_active":"2023-05-11T07:37:18.295061+0000","last_became_peered":"2023-05-11T07:37:18.295061+0000","last_unstale":"2023-05-11T07:37:19.985989+0000","last_undegraded":"2023-05-11T07:37:19.985989+0000","last_fullsized":"2023-05-11T07:37:19.985989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:34.937633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283239+0000","last_change":"2023-05-11T07:37:18.309208+0000","last_active":"2023-05-11T07:37:19.283239+0000","last_peered":"2023-05-11T07:37:19.283239+0000","last_clean":"2023-05-11T07:37:19.283239+0000","last_became_active":"2023-05-11T07:37:18.308913+0000","last_became_peered":"2023-05-11T07:37:18.308913+0000","last_unstale":"2023-05-11T07:37:19.283239+0000","last_undegraded":"2023-05-11T07:37:19.283239+0000","last_fullsized":"2023-05-11T07:37:19.283239+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:00:43.186311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282224+0000","last_change":"2023-05-11T07:37:18.292799+0000","last_active":"2023-05-11T07:37:19.282224+0000","last_peered":"2023-05-11T07:37:19.282224+0000","last_clean":"2023-05-11T07:37:19.282224+0000","last_became_active":"2023-05-11T07:37:18.292476+0000","last_became_peered":"2023-05-11T07:37:18.292476+0000","last_unstale":"2023-05-11T07:37:19.282224+0000","last_undegraded":"2023-05-11T07:37:19.282224+0000","last_fullsized":"2023-05-11T07:37:19.282224+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:22:36.881963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282065+0000","last_change":"2023-05-11T07:37:18.297272+0000","last_active":"2023-05-11T07:37:19.282065+0000","last_peered":"2023-05-11T07:37:19.282065+0000","last_clean":"2023-05-11T07:37:19.282065+0000","last_became_active":"2023-05-11T07:37:18.296933+0000","last_became_peered":"2023-05-11T07:37:18.296933+0000","last_unstale":"2023-05-11T07:37:19.282065+0000","last_undegraded":"2023-05-11T07:37:19.282065+0000","last_fullsized":"2023-05-11T07:37:19.282065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:01:15.986745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283687+0000","last_change":"2023-05-11T07:37:18.288933+0000","last_active":"2023-05-11T07:37:19.283687+0000","last_peered":"2023-05-11T07:37:19.283687+0000","last_clean":"2023-05-11T07:37:19.283687+0000","last_became_active":"2023-05-11T07:37:18.288605+0000","last_became_peered":"2023-05-11T07:37:18.288605+0000","last_unstale":"2023-05-11T07:37:19.283687+0000","last_undegraded":"2023-05-11T07:37:19.283687+0000","last_fullsized":"2023-05-11T07:37:19.283687+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:10:53.147958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992012+0000","last_change":"2023-05-11T07:37:18.304107+0000","last_active":"2023-05-11T07:37:19.992012+0000","last_peered":"2023-05-11T07:37:19.992012+0000","last_clean":"2023-05-11T07:37:19.992012+0000","last_became_active":"2023-05-11T07:37:18.303874+0000","last_became_peered":"2023-05-11T07:37:18.303874+0000","last_unstale":"2023-05-11T07:37:19.992012+0000","last_undegraded":"2023-05-11T07:37:19.992012+0000","last_fullsized":"2023-05-11T07:37:19.992012+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:30.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986014+0000","last_change":"2023-05-11T07:37:18.296702+0000","last_active":"2023-05-11T07:37:19.986014+0000","last_peered":"2023-05-11T07:37:19.986014+0000","last_clean":"2023-05-11T07:37:19.986014+0000","last_became_active":"2023-05-11T07:37:18.296227+0000","last_became_peered":"2023-05-11T07:37:18.296227+0000","last_unstale":"2023-05-11T07:37:19.986014+0000","last_undegraded":"2023-05-11T07:37:19.986014+0000","last_fullsized":"2023-05-11T07:37:19.986014+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:35:20.212233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992380+0000","last_change":"2023-05-11T07:37:18.302035+0000","last_active":"2023-05-11T07:37:19.992380+0000","last_peered":"2023-05-11T07:37:19.992380+0000","last_clean":"2023-05-11T07:37:19.992380+0000","last_became_active":"2023-05-11T07:37:18.301769+0000","last_became_peered":"2023-05-11T07:37:18.301769+0000","last_unstale":"2023-05-11T07:37:19.992380+0000","last_undegraded":"2023-05-11T07:37:19.992380+0000","last_fullsized":"2023-05-11T07:37:19.992380+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:50:27.002175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283252+0000","last_change":"2023-05-11T07:37:18.287465+0000","last_active":"2023-05-11T07:37:19.283252+0000","last_peered":"2023-05-11T07:37:19.283252+0000","last_clean":"2023-05-11T07:37:19.283252+0000","last_became_active":"2023-05-11T07:37:18.286165+0000","last_became_peered":"2023-05-11T07:37:18.286165+0000","last_unstale":"2023-05-11T07:37:19.283252+0000","last_undegraded":"2023-05-11T07:37:19.283252+0000","last_fullsized":"2023-05-11T07:37:19.283252+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:45:47.309427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283293+0000","last_change":"2023-05-11T07:37:18.286561+0000","last_active":"2023-05-11T07:37:19.283293+0000","last_peered":"2023-05-11T07:37:19.283293+0000","last_clean":"2023-05-11T07:37:19.283293+0000","last_became_active":"2023-05-11T07:37:18.286216+0000","last_became_peered":"2023-05-11T07:37:18.286216+0000","last_unstale":"2023-05-11T07:37:19.283293+0000","last_undegraded":"2023-05-11T07:37:19.283293+0000","last_fullsized":"2023-05-11T07:37:19.283293+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:27:51.510412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283989+0000","last_change":"2023-05-11T07:37:18.286834+0000","last_active":"2023-05-11T07:37:19.283989+0000","last_peered":"2023-05-11T07:37:19.283989+0000","last_clean":"2023-05-11T07:37:19.283989+0000","last_became_active":"2023-05-11T07:37:18.286568+0000","last_became_peered":"2023-05-11T07:37:18.286568+0000","last_unstale":"2023-05-11T07:37:19.283989+0000","last_undegraded":"2023-05-11T07:37:19.283989+0000","last_fullsized":"2023-05-11T07:37:19.283989+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:46.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992099+0000","last_change":"2023-05-11T07:37:18.290513+0000","last_active":"2023-05-11T07:37:19.992099+0000","last_peered":"2023-05-11T07:37:19.992099+0000","last_clean":"2023-05-11T07:37:19.992099+0000","last_became_active":"2023-05-11T07:37:18.290222+0000","last_became_peered":"2023-05-11T07:37:18.290222+0000","last_unstale":"2023-05-11T07:37:19.992099+0000","last_undegraded":"2023-05-11T07:37:19.992099+0000","last_fullsized":"2023-05-11T07:37:19.992099+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:01.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282119+0000","last_change":"2023-05-11T07:37:18.289912+0000","last_active":"2023-05-11T07:37:19.282119+0000","last_peered":"2023-05-11T07:37:19.282119+0000","last_clean":"2023-05-11T07:37:19.282119+0000","last_became_active":"2023-05-11T07:37:18.289607+0000","last_became_peered":"2023-05-11T07:37:18.289607+0000","last_unstale":"2023-05-11T07:37:19.282119+0000","last_undegraded":"2023-05-11T07:37:19.282119+0000","last_fullsized":"2023-05-11T07:37:19.282119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:26:38.690549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992184+0000","last_change":"2023-05-11T07:37:18.296428+0000","last_active":"2023-05-11T07:37:19.992184+0000","last_peered":"2023-05-11T07:37:19.992184+0000","last_clean":"2023-05-11T07:37:19.992184+0000","last_became_active":"2023-05-11T07:37:18.296133+0000","last_became_peered":"2023-05-11T07:37:18.296133+0000","last_unstale":"2023-05-11T07:37:19.992184+0000","last_undegraded":"2023-05-11T07:37:19.992184+0000","last_fullsized":"2023-05-11T07:37:19.992184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:53:03.634364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283703+0000","last_change":"2023-05-11T07:37:18.286553+0000","last_active":"2023-05-11T07:37:19.283703+0000","last_peered":"2023-05-11T07:37:19.283703+0000","last_clean":"2023-05-11T07:37:19.283703+0000","last_became_active":"2023-05-11T07:37:18.286235+0000","last_became_peered":"2023-05-11T07:37:18.286235+0000","last_unstale":"2023-05-11T07:37:19.283703+0000","last_undegraded":"2023-05-11T07:37:19.283703+0000","last_fullsized":"2023-05-11T07:37:19.283703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:47:38.913921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281787+0000","last_change":"2023-05-11T07:37:18.291946+0000","last_active":"2023-05-11T07:37:19.281787+0000","last_peered":"2023-05-11T07:37:19.281787+0000","last_clean":"2023-05-11T07:37:19.281787+0000","last_became_active":"2023-05-11T07:37:18.291346+0000","last_became_peered":"2023-05-11T07:37:18.291346+0000","last_unstale":"2023-05-11T07:37:19.281787+0000","last_undegraded":"2023-05-11T07:37:19.281787+0000","last_fullsized":"2023-05-11T07:37:19.281787+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:26:34.365278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985821+0000","last_change":"2023-05-11T07:37:18.298118+0000","last_active":"2023-05-11T07:37:19.985821+0000","last_peered":"2023-05-11T07:37:19.985821+0000","last_clean":"2023-05-11T07:37:19.985821+0000","last_became_active":"2023-05-11T07:37:18.297866+0000","last_became_peered":"2023-05-11T07:37:18.297866+0000","last_unstale":"2023-05-11T07:37:19.985821+0000","last_undegraded":"2023-05-11T07:37:19.985821+0000","last_fullsized":"2023-05-11T07:37:19.985821+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:04.557042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991682+0000","last_change":"2023-05-11T07:37:18.291309+0000","last_active":"2023-05-11T07:37:19.991682+0000","last_peered":"2023-05-11T07:37:19.991682+0000","last_clean":"2023-05-11T07:37:19.991682+0000","last_became_active":"2023-05-11T07:37:18.290864+0000","last_became_peered":"2023-05-11T07:37:18.290864+0000","last_unstale":"2023-05-11T07:37:19.991682+0000","last_undegraded":"2023-05-11T07:37:19.991682+0000","last_fullsized":"2023-05-11T07:37:19.991682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:16.444730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993415+0000","last_change":"2023-05-11T07:37:18.292054+0000","last_active":"2023-05-11T07:37:19.993415+0000","last_peered":"2023-05-11T07:37:19.993415+0000","last_clean":"2023-05-11T07:37:19.993415+0000","last_became_active":"2023-05-11T07:37:18.291805+0000","last_became_peered":"2023-05-11T07:37:18.291805+0000","last_unstale":"2023-05-11T07:37:19.993415+0000","last_undegraded":"2023-05-11T07:37:19.993415+0000","last_fullsized":"2023-05-11T07:37:19.993415+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:19.430601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986353+0000","last_change":"2023-05-11T07:37:17.813384+0000","last_active":"2023-05-11T07:37:19.986353+0000","last_peered":"2023-05-11T07:37:19.986353+0000","last_clean":"2023-05-11T07:37:19.986353+0000","last_became_active":"2023-05-11T07:37:17.813112+0000","last_became_peered":"2023-05-11T07:37:17.813112+0000","last_unstale":"2023-05-11T07:37:19.986353+0000","last_undegraded":"2023-05-11T07:37:19.986353+0000","last_fullsized":"2023-05-11T07:37:19.986353+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283875+0000","last_change":"2023-05-11T07:37:18.294542+0000","last_active":"2023-05-11T07:37:19.283875+0000","last_peered":"2023-05-11T07:37:19.283875+0000","last_clean":"2023-05-11T07:37:19.283875+0000","last_became_active":"2023-05-11T07:37:18.294147+0000","last_became_peered":"2023-05-11T07:37:18.294147+0000","last_unstale":"2023-05-11T07:37:19.283875+0000","last_undegraded":"2023-05-11T07:37:19.283875+0000","last_fullsized":"2023-05-11T07:37:19.283875+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:21:00.891302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282310+0000","last_change":"2023-05-11T07:37:17.803783+0000","last_active":"2023-05-11T07:37:19.282310+0000","last_peered":"2023-05-11T07:37:19.282310+0000","last_clean":"2023-05-11T07:37:19.282310+0000","last_became_active":"2023-05-11T07:37:17.803516+0000","last_became_peered":"2023-05-11T07:37:17.803516+0000","last_unstale":"2023-05-11T07:37:19.282310+0000","last_undegraded":"2023-05-11T07:37:19.282310+0000","last_fullsized":"2023-05-11T07:37:19.282310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:30:54.188343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992197+0000","last_change":"2023-05-11T07:37:18.292075+0000","last_active":"2023-05-11T07:37:19.992197+0000","last_peered":"2023-05-11T07:37:19.992197+0000","last_clean":"2023-05-11T07:37:19.992197+0000","last_became_active":"2023-05-11T07:37:18.291815+0000","last_became_peered":"2023-05-11T07:37:18.291815+0000","last_unstale":"2023-05-11T07:37:19.992197+0000","last_undegraded":"2023-05-11T07:37:19.992197+0000","last_fullsized":"2023-05-11T07:37:19.992197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:27.787504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993639+0000","last_change":"2023-05-11T07:37:17.803729+0000","last_active":"2023-05-11T07:37:19.993639+0000","last_peered":"2023-05-11T07:37:19.993639+0000","last_clean":"2023-05-11T07:37:19.993639+0000","last_became_active":"2023-05-11T07:37:17.803491+0000","last_became_peered":"2023-05-11T07:37:17.803491+0000","last_unstale":"2023-05-11T07:37:19.993639+0000","last_undegraded":"2023-05-11T07:37:19.993639+0000","last_fullsized":"2023-05-11T07:37:19.993639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:41:52.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993604+0000","last_change":"2023-05-11T07:37:18.289175+0000","last_active":"2023-05-11T07:37:19.993604+0000","last_peered":"2023-05-11T07:37:19.993604+0000","last_clean":"2023-05-11T07:37:19.993604+0000","last_became_active":"2023-05-11T07:37:18.287810+0000","last_became_peered":"2023-05-11T07:37:18.287810+0000","last_unstale":"2023-05-11T07:37:19.993604+0000","last_undegraded":"2023-05-11T07:37:19.993604+0000","last_fullsized":"2023-05-11T07:37:19.993604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:39.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993447+0000","last_change":"2023-05-11T07:37:17.813722+0000","last_active":"2023-05-11T07:37:19.993447+0000","last_peered":"2023-05-11T07:37:19.993447+0000","last_clean":"2023-05-11T07:37:19.993447+0000","last_became_active":"2023-05-11T07:37:17.813440+0000","last_became_peered":"2023-05-11T07:37:17.813440+0000","last_unstale":"2023-05-11T07:37:19.993447+0000","last_undegraded":"2023-05-11T07:37:19.993447+0000","last_fullsized":"2023-05-11T07:37:19.993447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281890+0000","last_change":"2023-05-11T07:37:18.291751+0000","last_active":"2023-05-11T07:37:19.281890+0000","last_peered":"2023-05-11T07:37:19.281890+0000","last_clean":"2023-05-11T07:37:19.281890+0000","last_became_active":"2023-05-11T07:37:18.291049+0000","last_became_peered":"2023-05-11T07:37:18.291049+0000","last_unstale":"2023-05-11T07:37:19.281890+0000","last_undegraded":"2023-05-11T07:37:19.281890+0000","last_fullsized":"2023-05-11T07:37:19.281890+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:24.836884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986327+0000","last_change":"2023-05-11T07:37:17.809016+0000","last_active":"2023-05-11T07:37:19.986327+0000","last_peered":"2023-05-11T07:37:19.986327+0000","last_clean":"2023-05-11T07:37:19.986327+0000","last_became_active":"2023-05-11T07:37:17.808761+0000","last_became_peered":"2023-05-11T07:37:17.808761+0000","last_unstale":"2023-05-11T07:37:19.986327+0000","last_undegraded":"2023-05-11T07:37:19.986327+0000","last_fullsized":"2023-05-11T07:37:19.986327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:15.052051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992518+0000","last_change":"2023-05-11T07:37:18.303445+0000","last_active":"2023-05-11T07:37:19.992518+0000","last_peered":"2023-05-11T07:37:19.992518+0000","last_clean":"2023-05-11T07:37:19.992518+0000","last_became_active":"2023-05-11T07:37:18.302989+0000","last_became_peered":"2023-05-11T07:37:18.302989+0000","last_unstale":"2023-05-11T07:37:19.992518+0000","last_undegraded":"2023-05-11T07:37:19.992518+0000","last_fullsized":"2023-05-11T07:37:19.992518+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:22:49.393847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282053+0000","last_change":"2023-05-11T07:37:17.802629+0000","last_active":"2023-05-11T07:37:19.282053+0000","last_peered":"2023-05-11T07:37:19.282053+0000","last_clean":"2023-05-11T07:37:19.282053+0000","last_became_active":"2023-05-11T07:37:17.802309+0000","last_became_peered":"2023-05-11T07:37:17.802309+0000","last_unstale":"2023-05-11T07:37:19.282053+0000","last_undegraded":"2023-05-11T07:37:19.282053+0000","last_fullsized":"2023-05-11T07:37:19.282053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:15:37.107122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991983+0000","last_change":"2023-05-11T07:37:18.302792+0000","last_active":"2023-05-11T07:37:19.991983+0000","last_peered":"2023-05-11T07:37:19.991983+0000","last_clean":"2023-05-11T07:37:19.991983+0000","last_became_active":"2023-05-11T07:37:18.302144+0000","last_became_peered":"2023-05-11T07:37:18.302144+0000","last_unstale":"2023-05-11T07:37:19.991983+0000","last_undegraded":"2023-05-11T07:37:19.991983+0000","last_fullsized":"2023-05-11T07:37:19.991983+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:50:17.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991960+0000","last_change":"2023-05-11T07:37:17.806893+0000","last_active":"2023-05-11T07:37:19.991960+0000","last_peered":"2023-05-11T07:37:19.991960+0000","last_clean":"2023-05-11T07:37:19.991960+0000","last_became_active":"2023-05-11T07:37:17.806550+0000","last_became_peered":"2023-05-11T07:37:17.806550+0000","last_unstale":"2023-05-11T07:37:19.991960+0000","last_undegraded":"2023-05-11T07:37:19.991960+0000","last_fullsized":"2023-05-11T07:37:19.991960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:02:21.524193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283429+0000","last_change":"2023-05-11T07:37:18.285399+0000","last_active":"2023-05-11T07:37:19.283429+0000","last_peered":"2023-05-11T07:37:19.283429+0000","last_clean":"2023-05-11T07:37:19.283429+0000","last_became_active":"2023-05-11T07:37:18.284955+0000","last_became_peered":"2023-05-11T07:37:18.284955+0000","last_unstale":"2023-05-11T07:37:19.283429+0000","last_undegraded":"2023-05-11T07:37:19.283429+0000","last_fullsized":"2023-05-11T07:37:19.283429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:24:56.109130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991847+0000","last_change":"2023-05-11T07:37:17.810167+0000","last_active":"2023-05-11T07:37:19.991847+0000","last_peered":"2023-05-11T07:37:19.991847+0000","last_clean":"2023-05-11T07:37:19.991847+0000","last_became_active":"2023-05-11T07:37:17.809905+0000","last_became_peered":"2023-05-11T07:37:17.809905+0000","last_unstale":"2023-05-11T07:37:19.991847+0000","last_undegraded":"2023-05-11T07:37:19.991847+0000","last_fullsized":"2023-05-11T07:37:19.991847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:27.102878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282230+0000","last_change":"2023-05-11T07:37:18.296389+0000","last_active":"2023-05-11T07:37:19.282230+0000","last_peered":"2023-05-11T07:37:19.282230+0000","last_clean":"2023-05-11T07:37:19.282230+0000","last_became_active":"2023-05-11T07:37:18.296111+0000","last_became_peered":"2023-05-11T07:37:18.296111+0000","last_unstale":"2023-05-11T07:37:19.282230+0000","last_undegraded":"2023-05-11T07:37:19.282230+0000","last_fullsized":"2023-05-11T07:37:19.282230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:27:41.360370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282315+0000","last_change":"2023-05-11T07:37:17.801337+0000","last_active":"2023-05-11T07:37:19.282315+0000","last_peered":"2023-05-11T07:37:19.282315+0000","last_clean":"2023-05-11T07:37:19.282315+0000","last_became_active":"2023-05-11T07:37:17.800991+0000","last_became_peered":"2023-05-11T07:37:17.800991+0000","last_unstale":"2023-05-11T07:37:19.282315+0000","last_undegraded":"2023-05-11T07:37:19.282315+0000","last_fullsized":"2023-05-11T07:37:19.282315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:26:46.905451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993466+0000","last_change":"2023-05-11T07:37:18.295004+0000","last_active":"2023-05-11T07:37:19.993466+0000","last_peered":"2023-05-11T07:37:19.993466+0000","last_clean":"2023-05-11T07:37:19.993466+0000","last_became_active":"2023-05-11T07:37:18.294741+0000","last_became_peered":"2023-05-11T07:37:18.294741+0000","last_unstale":"2023-05-11T07:37:19.993466+0000","last_undegraded":"2023-05-11T07:37:19.993466+0000","last_fullsized":"2023-05-11T07:37:19.993466+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:39:54.412110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992894+0000","last_change":"2023-05-11T07:37:17.809325+0000","last_active":"2023-05-11T07:37:19.992894+0000","last_peered":"2023-05-11T07:37:19.992894+0000","last_clean":"2023-05-11T07:37:19.992894+0000","last_became_active":"2023-05-11T07:37:17.808976+0000","last_became_peered":"2023-05-11T07:37:17.808976+0000","last_unstale":"2023-05-11T07:37:19.992894+0000","last_undegraded":"2023-05-11T07:37:19.992894+0000","last_fullsized":"2023-05-11T07:37:19.992894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986228+0000","last_change":"2023-05-11T07:37:18.293624+0000","last_active":"2023-05-11T07:37:19.986228+0000","last_peered":"2023-05-11T07:37:19.986228+0000","last_clean":"2023-05-11T07:37:19.986228+0000","last_became_active":"2023-05-11T07:37:18.293346+0000","last_became_peered":"2023-05-11T07:37:18.293346+0000","last_unstale":"2023-05-11T07:37:19.986228+0000","last_undegraded":"2023-05-11T07:37:19.986228+0000","last_fullsized":"2023-05-11T07:37:19.986228+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993508+0000","last_change":"2023-05-11T07:37:17.813482+0000","last_active":"2023-05-11T07:37:19.993508+0000","last_peered":"2023-05-11T07:37:19.993508+0000","last_clean":"2023-05-11T07:37:19.993508+0000","last_became_active":"2023-05-11T07:37:17.813163+0000","last_became_peered":"2023-05-11T07:37:17.813163+0000","last_unstale":"2023-05-11T07:37:19.993508+0000","last_undegraded":"2023-05-11T07:37:19.993508+0000","last_fullsized":"2023-05-11T07:37:19.993508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:16:44.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993281+0000","last_change":"2023-05-11T07:37:18.290528+0000","last_active":"2023-05-11T07:37:19.993281+0000","last_peered":"2023-05-11T07:37:19.993281+0000","last_clean":"2023-05-11T07:37:19.993281+0000","last_became_active":"2023-05-11T07:37:18.290251+0000","last_became_peered":"2023-05-11T07:37:18.290251+0000","last_unstale":"2023-05-11T07:37:19.993281+0000","last_undegraded":"2023-05-11T07:37:19.993281+0000","last_fullsized":"2023-05-11T07:37:19.993281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992148+0000","last_change":"2023-05-11T07:37:17.804935+0000","last_active":"2023-05-11T07:37:19.992148+0000","last_peered":"2023-05-11T07:37:19.992148+0000","last_clean":"2023-05-11T07:37:19.992148+0000","last_became_active":"2023-05-11T07:37:17.804595+0000","last_became_peered":"2023-05-11T07:37:17.804595+0000","last_unstale":"2023-05-11T07:37:19.992148+0000","last_undegraded":"2023-05-11T07:37:19.992148+0000","last_fullsized":"2023-05-11T07:37:19.992148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:23:20.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283296+0000","last_change":"2023-05-11T07:37:18.302703+0000","last_active":"2023-05-11T07:37:19.283296+0000","last_peered":"2023-05-11T07:37:19.283296+0000","last_clean":"2023-05-11T07:37:19.283296+0000","last_became_active":"2023-05-11T07:37:18.302276+0000","last_became_peered":"2023-05-11T07:37:18.302276+0000","last_unstale":"2023-05-11T07:37:19.283296+0000","last_undegraded":"2023-05-11T07:37:19.283296+0000","last_fullsized":"2023-05-11T07:37:19.283296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:53:03.341271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986180+0000","last_change":"2023-05-11T07:37:17.805056+0000","last_active":"2023-05-11T07:37:19.986180+0000","last_peered":"2023-05-11T07:37:19.986180+0000","last_clean":"2023-05-11T07:37:19.986180+0000","last_became_active":"2023-05-11T07:37:17.804788+0000","last_became_peered":"2023-05-11T07:37:17.804788+0000","last_unstale":"2023-05-11T07:37:19.986180+0000","last_undegraded":"2023-05-11T07:37:19.986180+0000","last_fullsized":"2023-05-11T07:37:19.986180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:45:55.002267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992557+0000","last_change":"2023-05-11T07:37:18.297601+0000","last_active":"2023-05-11T07:37:19.992557+0000","last_peered":"2023-05-11T07:37:19.992557+0000","last_clean":"2023-05-11T07:37:19.992557+0000","last_became_active":"2023-05-11T07:37:18.297328+0000","last_became_peered":"2023-05-11T07:37:18.297328+0000","last_unstale":"2023-05-11T07:37:19.992557+0000","last_undegraded":"2023-05-11T07:37:19.992557+0000","last_fullsized":"2023-05-11T07:37:19.992557+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:18:31.033647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993056+0000","last_change":"2023-05-11T07:37:17.809230+0000","last_active":"2023-05-11T07:37:19.993056+0000","last_peered":"2023-05-11T07:37:19.993056+0000","last_clean":"2023-05-11T07:37:19.993056+0000","last_became_active":"2023-05-11T07:37:17.808956+0000","last_became_peered":"2023-05-11T07:37:17.808956+0000","last_unstale":"2023-05-11T07:37:19.993056+0000","last_undegraded":"2023-05-11T07:37:19.993056+0000","last_fullsized":"2023-05-11T07:37:19.993056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985829+0000","last_change":"2023-05-11T07:37:18.293684+0000","last_active":"2023-05-11T07:37:19.985829+0000","last_peered":"2023-05-11T07:37:19.985829+0000","last_clean":"2023-05-11T07:37:19.985829+0000","last_became_active":"2023-05-11T07:37:18.293412+0000","last_became_peered":"2023-05-11T07:37:18.293412+0000","last_unstale":"2023-05-11T07:37:19.985829+0000","last_undegraded":"2023-05-11T07:37:19.985829+0000","last_fullsized":"2023-05-11T07:37:19.985829+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.985944+0000","last_change":"2023-05-11T07:37:17.804908+0000","last_active":"2023-05-11T07:37:19.985944+0000","last_peered":"2023-05-11T07:37:19.985944+0000","last_clean":"2023-05-11T07:37:19.985944+0000","last_became_active":"2023-05-11T07:37:17.804649+0000","last_became_peered":"2023-05-11T07:37:17.804649+0000","last_unstale":"2023-05-11T07:37:19.985944+0000","last_undegraded":"2023-05-11T07:37:19.985944+0000","last_fullsized":"2023-05-11T07:37:19.985944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:00:50.426172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992957+0000","last_change":"2023-05-11T07:37:18.286709+0000","last_active":"2023-05-11T07:37:19.992957+0000","last_peered":"2023-05-11T07:37:19.992957+0000","last_clean":"2023-05-11T07:37:19.992957+0000","last_became_active":"2023-05-11T07:37:18.286345+0000","last_became_peered":"2023-05-11T07:37:18.286345+0000","last_unstale":"2023-05-11T07:37:19.992957+0000","last_undegraded":"2023-05-11T07:37:19.992957+0000","last_fullsized":"2023-05-11T07:37:19.992957+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:18:10.395454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991968+0000","last_change":"2023-05-11T07:37:17.808521+0000","last_active":"2023-05-11T07:37:19.991968+0000","last_peered":"2023-05-11T07:37:19.991968+0000","last_clean":"2023-05-11T07:37:19.991968+0000","last_became_active":"2023-05-11T07:37:17.808176+0000","last_became_peered":"2023-05-11T07:37:17.808176+0000","last_unstale":"2023-05-11T07:37:19.991968+0000","last_undegraded":"2023-05-11T07:37:19.991968+0000","last_fullsized":"2023-05-11T07:37:19.991968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:52:14.634490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991825+0000","last_change":"2023-05-11T07:37:18.294767+0000","last_active":"2023-05-11T07:37:19.991825+0000","last_peered":"2023-05-11T07:37:19.991825+0000","last_clean":"2023-05-11T07:37:19.991825+0000","last_became_active":"2023-05-11T07:37:18.294516+0000","last_became_peered":"2023-05-11T07:37:18.294516+0000","last_unstale":"2023-05-11T07:37:19.991825+0000","last_undegraded":"2023-05-11T07:37:19.991825+0000","last_fullsized":"2023-05-11T07:37:19.991825+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:30:18.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991981+0000","last_change":"2023-05-11T07:37:17.802776+0000","last_active":"2023-05-11T07:37:19.991981+0000","last_peered":"2023-05-11T07:37:19.991981+0000","last_clean":"2023-05-11T07:37:19.991981+0000","last_became_active":"2023-05-11T07:37:17.802533+0000","last_became_peered":"2023-05-11T07:37:17.802533+0000","last_unstale":"2023-05-11T07:37:19.991981+0000","last_undegraded":"2023-05-11T07:37:19.991981+0000","last_fullsized":"2023-05-11T07:37:19.991981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:49:16.959783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992780+0000","last_change":"2023-05-11T07:37:18.302806+0000","last_active":"2023-05-11T07:37:19.992780+0000","last_peered":"2023-05-11T07:37:19.992780+0000","last_clean":"2023-05-11T07:37:19.992780+0000","last_became_active":"2023-05-11T07:37:18.302486+0000","last_became_peered":"2023-05-11T07:37:18.302486+0000","last_unstale":"2023-05-11T07:37:19.992780+0000","last_undegraded":"2023-05-11T07:37:19.992780+0000","last_fullsized":"2023-05-11T07:37:19.992780+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T19:12:57.745998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.282198+0000","last_change":"2023-05-11T07:37:17.801549+0000","last_active":"2023-05-11T07:37:19.282198+0000","last_peered":"2023-05-11T07:37:19.282198+0000","last_clean":"2023-05-11T07:37:19.282198+0000","last_became_active":"2023-05-11T07:37:17.801223+0000","last_became_peered":"2023-05-11T07:37:17.801223+0000","last_unstale":"2023-05-11T07:37:19.282198+0000","last_undegraded":"2023-05-11T07:37:19.282198+0000","last_fullsized":"2023-05-11T07:37:19.282198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:36:45.174857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283835+0000","last_change":"2023-05-11T07:37:18.289641+0000","last_active":"2023-05-11T07:37:19.283835+0000","last_peered":"2023-05-11T07:37:19.283835+0000","last_clean":"2023-05-11T07:37:19.283835+0000","last_became_active":"2023-05-11T07:37:18.289266+0000","last_became_peered":"2023-05-11T07:37:18.289266+0000","last_unstale":"2023-05-11T07:37:19.283835+0000","last_undegraded":"2023-05-11T07:37:19.283835+0000","last_fullsized":"2023-05-11T07:37:19.283835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:07:10.450228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992371+0000","last_change":"2023-05-11T07:37:17.806924+0000","last_active":"2023-05-11T07:37:19.992371+0000","last_peered":"2023-05-11T07:37:19.992371+0000","last_clean":"2023-05-11T07:37:19.992371+0000","last_became_active":"2023-05-11T07:37:17.806632+0000","last_became_peered":"2023-05-11T07:37:17.806632+0000","last_unstale":"2023-05-11T07:37:19.992371+0000","last_undegraded":"2023-05-11T07:37:19.992371+0000","last_fullsized":"2023-05-11T07:37:19.992371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:15.881529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283860+0000","last_change":"2023-05-11T07:37:18.287300+0000","last_active":"2023-05-11T07:37:19.283860+0000","last_peered":"2023-05-11T07:37:19.283860+0000","last_clean":"2023-05-11T07:37:19.283860+0000","last_became_active":"2023-05-11T07:37:18.286982+0000","last_became_peered":"2023-05-11T07:37:18.286982+0000","last_unstale":"2023-05-11T07:37:19.283860+0000","last_undegraded":"2023-05-11T07:37:19.283860+0000","last_fullsized":"2023-05-11T07:37:19.283860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:08:12.304473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986279+0000","last_change":"2023-05-11T07:37:17.811963+0000","last_active":"2023-05-11T07:37:19.986279+0000","last_peered":"2023-05-11T07:37:19.986279+0000","last_clean":"2023-05-11T07:37:19.986279+0000","last_became_active":"2023-05-11T07:37:17.811718+0000","last_became_peered":"2023-05-11T07:37:17.811718+0000","last_unstale":"2023-05-11T07:37:19.986279+0000","last_undegraded":"2023-05-11T07:37:19.986279+0000","last_fullsized":"2023-05-11T07:37:19.986279+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:58:39.409698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986060+0000","last_change":"2023-05-11T07:37:18.294227+0000","last_active":"2023-05-11T07:37:19.986060+0000","last_peered":"2023-05-11T07:37:19.986060+0000","last_clean":"2023-05-11T07:37:19.986060+0000","last_became_active":"2023-05-11T07:37:18.293962+0000","last_became_peered":"2023-05-11T07:37:18.293962+0000","last_unstale":"2023-05-11T07:37:19.986060+0000","last_undegraded":"2023-05-11T07:37:19.986060+0000","last_fullsized":"2023-05-11T07:37:19.986060+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:31:48.833972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986258+0000","last_change":"2023-05-11T07:37:17.809327+0000","last_active":"2023-05-11T07:37:19.986258+0000","last_peered":"2023-05-11T07:37:19.986258+0000","last_clean":"2023-05-11T07:37:19.986258+0000","last_became_active":"2023-05-11T07:37:17.808953+0000","last_became_peered":"2023-05-11T07:37:17.808953+0000","last_unstale":"2023-05-11T07:37:19.986258+0000","last_undegraded":"2023-05-11T07:37:19.986258+0000","last_fullsized":"2023-05-11T07:37:19.986258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:31:41.118642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993416+0000","last_change":"2023-05-11T07:37:18.293169+0000","last_active":"2023-05-11T07:37:19.993416+0000","last_peered":"2023-05-11T07:37:19.993416+0000","last_clean":"2023-05-11T07:37:19.993416+0000","last_became_active":"2023-05-11T07:37:18.292862+0000","last_became_peered":"2023-05-11T07:37:18.292862+0000","last_unstale":"2023-05-11T07:37:19.993416+0000","last_undegraded":"2023-05-11T07:37:19.993416+0000","last_fullsized":"2023-05-11T07:37:19.993416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:48:21.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991908+0000","last_change":"2023-05-11T07:37:17.808473+0000","last_active":"2023-05-11T07:37:19.991908+0000","last_peered":"2023-05-11T07:37:19.991908+0000","last_clean":"2023-05-11T07:37:19.991908+0000","last_became_active":"2023-05-11T07:37:17.808069+0000","last_became_peered":"2023-05-11T07:37:17.808069+0000","last_unstale":"2023-05-11T07:37:19.991908+0000","last_undegraded":"2023-05-11T07:37:19.991908+0000","last_fullsized":"2023-05-11T07:37:19.991908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991589+0000","last_change":"2023-05-11T07:37:18.289485+0000","last_active":"2023-05-11T07:37:19.991589+0000","last_peered":"2023-05-11T07:37:19.991589+0000","last_clean":"2023-05-11T07:37:19.991589+0000","last_became_active":"2023-05-11T07:37:18.289211+0000","last_became_peered":"2023-05-11T07:37:18.289211+0000","last_unstale":"2023-05-11T07:37:19.991589+0000","last_undegraded":"2023-05-11T07:37:19.991589+0000","last_fullsized":"2023-05-11T07:37:19.991589+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:00:01.334038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992227+0000","last_change":"2023-05-11T07:37:17.810204+0000","last_active":"2023-05-11T07:37:19.992227+0000","last_peered":"2023-05-11T07:37:19.992227+0000","last_clean":"2023-05-11T07:37:19.992227+0000","last_became_active":"2023-05-11T07:37:17.809936+0000","last_became_peered":"2023-05-11T07:37:17.809936+0000","last_unstale":"2023-05-11T07:37:19.992227+0000","last_undegraded":"2023-05-11T07:37:19.992227+0000","last_fullsized":"2023-05-11T07:37:19.992227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:01:22.030233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991918+0000","last_change":"2023-05-11T07:37:18.299199+0000","last_active":"2023-05-11T07:37:19.991918+0000","last_peered":"2023-05-11T07:37:19.991918+0000","last_clean":"2023-05-11T07:37:19.991918+0000","last_became_active":"2023-05-11T07:37:18.298935+0000","last_became_peered":"2023-05-11T07:37:18.298935+0000","last_unstale":"2023-05-11T07:37:19.991918+0000","last_undegraded":"2023-05-11T07:37:19.991918+0000","last_fullsized":"2023-05-11T07:37:19.991918+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:58.151794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992759+0000","last_change":"2023-05-11T07:37:17.809276+0000","last_active":"2023-05-11T07:37:19.992759+0000","last_peered":"2023-05-11T07:37:19.992759+0000","last_clean":"2023-05-11T07:37:19.992759+0000","last_became_active":"2023-05-11T07:37:17.809035+0000","last_became_peered":"2023-05-11T07:37:17.809035+0000","last_unstale":"2023-05-11T07:37:19.992759+0000","last_undegraded":"2023-05-11T07:37:19.992759+0000","last_fullsized":"2023-05-11T07:37:19.992759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:20.856372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281811+0000","last_change":"2023-05-11T07:37:18.292506+0000","last_active":"2023-05-11T07:37:19.281811+0000","last_peered":"2023-05-11T07:37:19.281811+0000","last_clean":"2023-05-11T07:37:19.281811+0000","last_became_active":"2023-05-11T07:37:18.292151+0000","last_became_peered":"2023-05-11T07:37:18.292151+0000","last_unstale":"2023-05-11T07:37:19.281811+0000","last_undegraded":"2023-05-11T07:37:19.281811+0000","last_fullsized":"2023-05-11T07:37:19.281811+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:57:57.495757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992068+0000","last_change":"2023-05-11T07:37:17.803987+0000","last_active":"2023-05-11T07:37:19.992068+0000","last_peered":"2023-05-11T07:37:19.992068+0000","last_clean":"2023-05-11T07:37:19.992068+0000","last_became_active":"2023-05-11T07:37:17.803730+0000","last_became_peered":"2023-05-11T07:37:17.803730+0000","last_unstale":"2023-05-11T07:37:19.992068+0000","last_undegraded":"2023-05-11T07:37:19.992068+0000","last_fullsized":"2023-05-11T07:37:19.992068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:21:35.520411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993411+0000","last_change":"2023-05-11T07:35:33.992032+0000","last_active":"2023-05-11T07:37:19.993411+0000","last_peered":"2023-05-11T07:37:19.993411+0000","last_clean":"2023-05-11T07:37:19.993411+0000","last_became_active":"2023-05-11T07:35:33.991717+0000","last_became_peered":"2023-05-11T07:35:33.991717+0000","last_unstale":"2023-05-11T07:37:19.993411+0000","last_undegraded":"2023-05-11T07:37:19.993411+0000","last_fullsized":"2023-05-11T07:37:19.993411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:54.361555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.283895+0000","last_change":"2023-05-11T07:37:18.302712+0000","last_active":"2023-05-11T07:37:19.283895+0000","last_peered":"2023-05-11T07:37:19.283895+0000","last_clean":"2023-05-11T07:37:19.283895+0000","last_became_active":"2023-05-11T07:37:18.302367+0000","last_became_peered":"2023-05-11T07:37:18.302367+0000","last_unstale":"2023-05-11T07:37:19.283895+0000","last_undegraded":"2023-05-11T07:37:19.283895+0000","last_fullsized":"2023-05-11T07:37:19.283895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:07:23.623043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.988486+0000","last_change":"2023-05-11T07:37:17.806226+0000","last_active":"2023-05-11T07:37:19.988486+0000","last_peered":"2023-05-11T07:37:19.988486+0000","last_clean":"2023-05-11T07:37:19.988486+0000","last_became_active":"2023-05-11T07:37:17.805937+0000","last_became_peered":"2023-05-11T07:37:17.805937+0000","last_unstale":"2023-05-11T07:37:19.988486+0000","last_undegraded":"2023-05-11T07:37:19.988486+0000","last_fullsized":"2023-05-11T07:37:19.988486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:30.715472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991966+0000","last_change":"2023-05-11T07:35:33.829825+0000","last_active":"2023-05-11T07:37:19.991966+0000","last_peered":"2023-05-11T07:37:19.991966+0000","last_clean":"2023-05-11T07:37:19.991966+0000","last_became_active":"2023-05-11T07:35:33.829129+0000","last_became_peered":"2023-05-11T07:35:33.829129+0000","last_unstale":"2023-05-11T07:37:19.991966+0000","last_undegraded":"2023-05-11T07:37:19.991966+0000","last_fullsized":"2023-05-11T07:37:19.991966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:00.155128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992737+0000","last_change":"2023-05-11T07:37:18.294025+0000","last_active":"2023-05-11T07:37:19.992737+0000","last_peered":"2023-05-11T07:37:19.992737+0000","last_clean":"2023-05-11T07:37:19.992737+0000","last_became_active":"2023-05-11T07:37:18.293752+0000","last_became_peered":"2023-05-11T07:37:18.293752+0000","last_unstale":"2023-05-11T07:37:19.992737+0000","last_undegraded":"2023-05-11T07:37:19.992737+0000","last_fullsized":"2023-05-11T07:37:19.992737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:39:05.817992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993579+0000","last_change":"2023-05-11T07:37:17.812286+0000","last_active":"2023-05-11T07:37:19.993579+0000","last_peered":"2023-05-11T07:37:19.993579+0000","last_clean":"2023-05-11T07:37:19.993579+0000","last_became_active":"2023-05-11T07:37:17.811876+0000","last_became_peered":"2023-05-11T07:37:17.811876+0000","last_unstale":"2023-05-11T07:37:19.993579+0000","last_undegraded":"2023-05-11T07:37:19.993579+0000","last_fullsized":"2023-05-11T07:37:19.993579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:26:26.780984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991425+0000","last_change":"2023-05-11T07:35:33.823881+0000","last_active":"2023-05-11T07:37:19.991425+0000","last_peered":"2023-05-11T07:37:19.991425+0000","last_clean":"2023-05-11T07:37:19.991425+0000","last_became_active":"2023-05-11T07:35:33.823559+0000","last_became_peered":"2023-05-11T07:35:33.823559+0000","last_unstale":"2023-05-11T07:37:19.991425+0000","last_undegraded":"2023-05-11T07:37:19.991425+0000","last_fullsized":"2023-05-11T07:37:19.991425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:52:30.578344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992849+0000","last_change":"2023-05-11T07:37:18.297675+0000","last_active":"2023-05-11T07:37:19.992849+0000","last_peered":"2023-05-11T07:37:19.992849+0000","last_clean":"2023-05-11T07:37:19.992849+0000","last_became_active":"2023-05-11T07:37:18.297412+0000","last_became_peered":"2023-05-11T07:37:18.297412+0000","last_unstale":"2023-05-11T07:37:19.992849+0000","last_undegraded":"2023-05-11T07:37:19.992849+0000","last_fullsized":"2023-05-11T07:37:19.992849+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:34:30.041647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992392+0000","last_change":"2023-05-11T07:37:17.804167+0000","last_active":"2023-05-11T07:37:19.992392+0000","last_peered":"2023-05-11T07:37:19.992392+0000","last_clean":"2023-05-11T07:37:19.992392+0000","last_became_active":"2023-05-11T07:37:17.803797+0000","last_became_peered":"2023-05-11T07:37:17.803797+0000","last_unstale":"2023-05-11T07:37:19.992392+0000","last_undegraded":"2023-05-11T07:37:19.992392+0000","last_fullsized":"2023-05-11T07:37:19.992392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:42:27.503714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991965+0000","last_change":"2023-05-11T07:35:33.829329+0000","last_active":"2023-05-11T07:37:19.991965+0000","last_peered":"2023-05-11T07:37:19.991965+0000","last_clean":"2023-05-11T07:37:19.991965+0000","last_became_active":"2023-05-11T07:35:33.828895+0000","last_became_peered":"2023-05-11T07:35:33.828895+0000","last_unstale":"2023-05-11T07:37:19.991965+0000","last_undegraded":"2023-05-11T07:37:19.991965+0000","last_fullsized":"2023-05-11T07:37:19.991965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:38:09.432242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992843+0000","last_change":"2023-05-11T07:35:27.272136+0000","last_active":"2023-05-11T07:37:19.992843+0000","last_peered":"2023-05-11T07:37:19.992843+0000","last_clean":"2023-05-11T07:37:19.992843+0000","last_became_active":"2023-05-11T07:35:27.271105+0000","last_became_peered":"2023-05-11T07:35:27.271105+0000","last_unstale":"2023-05-11T07:37:19.992843+0000","last_undegraded":"2023-05-11T07:37:19.992843+0000","last_fullsized":"2023-05-11T07:37:19.992843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:25.996143+0000","last_clean_scrub_stamp":"2023-05-11T07:35:25.996143+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:44:04.224988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993367+0000","last_change":"2023-05-11T07:37:18.294585+0000","last_active":"2023-05-11T07:37:19.993367+0000","last_peered":"2023-05-11T07:37:19.993367+0000","last_clean":"2023-05-11T07:37:19.993367+0000","last_became_active":"2023-05-11T07:37:18.294299+0000","last_became_peered":"2023-05-11T07:37:18.294299+0000","last_unstale":"2023-05-11T07:37:19.993367+0000","last_undegraded":"2023-05-11T07:37:19.993367+0000","last_fullsized":"2023-05-11T07:37:19.993367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:32:26.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993477+0000","last_change":"2023-05-11T07:37:17.800828+0000","last_active":"2023-05-11T07:37:19.993477+0000","last_peered":"2023-05-11T07:37:19.993477+0000","last_clean":"2023-05-11T07:37:19.993477+0000","last_became_active":"2023-05-11T07:37:17.800524+0000","last_became_peered":"2023-05-11T07:37:17.800524+0000","last_unstale":"2023-05-11T07:37:19.993477+0000","last_undegraded":"2023-05-11T07:37:19.993477+0000","last_fullsized":"2023-05-11T07:37:19.993477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:35.326768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.992929+0000","last_change":"2023-05-11T07:35:33.829302+0000","last_active":"2023-05-11T07:37:19.992929+0000","last_peered":"2023-05-11T07:37:19.992929+0000","last_clean":"2023-05-11T07:37:19.992929+0000","last_became_active":"2023-05-11T07:35:33.829031+0000","last_became_peered":"2023-05-11T07:35:33.829031+0000","last_unstale":"2023-05-11T07:37:19.992929+0000","last_undegraded":"2023-05-11T07:37:19.992929+0000","last_fullsized":"2023-05-11T07:37:19.992929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:56:55.436349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.991922+0000","last_change":"2023-05-11T07:37:18.290604+0000","last_active":"2023-05-11T07:37:19.991922+0000","last_peered":"2023-05-11T07:37:19.991922+0000","last_clean":"2023-05-11T07:37:19.991922+0000","last_became_active":"2023-05-11T07:37:18.290265+0000","last_became_peered":"2023-05-11T07:37:18.290265+0000","last_unstale":"2023-05-11T07:37:19.991922+0000","last_undegraded":"2023-05-11T07:37:19.991922+0000","last_fullsized":"2023-05-11T07:37:19.991922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:24:56.551063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993255+0000","last_change":"2023-05-11T07:37:17.803117+0000","last_active":"2023-05-11T07:37:19.993255+0000","last_peered":"2023-05-11T07:37:19.993255+0000","last_clean":"2023-05-11T07:37:19.993255+0000","last_became_active":"2023-05-11T07:37:17.802884+0000","last_became_peered":"2023-05-11T07:37:17.802884+0000","last_unstale":"2023-05-11T07:37:19.993255+0000","last_undegraded":"2023-05-11T07:37:19.993255+0000","last_fullsized":"2023-05-11T07:37:19.993255+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:34:30.669761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993568+0000","last_change":"2023-05-11T07:35:33.992212+0000","last_active":"2023-05-11T07:37:19.993568+0000","last_peered":"2023-05-11T07:37:19.993568+0000","last_clean":"2023-05-11T07:37:19.993568+0000","last_became_active":"2023-05-11T07:35:33.991814+0000","last_became_peered":"2023-05-11T07:35:33.991814+0000","last_unstale":"2023-05-11T07:37:19.993568+0000","last_undegraded":"2023-05-11T07:37:19.993568+0000","last_fullsized":"2023-05-11T07:37:19.993568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:18.654496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986054+0000","last_change":"2023-05-11T07:37:18.296544+0000","last_active":"2023-05-11T07:37:19.986054+0000","last_peered":"2023-05-11T07:37:19.986054+0000","last_clean":"2023-05-11T07:37:19.986054+0000","last_became_active":"2023-05-11T07:37:18.295758+0000","last_became_peered":"2023-05-11T07:37:18.295758+0000","last_unstale":"2023-05-11T07:37:19.986054+0000","last_undegraded":"2023-05-11T07:37:19.986054+0000","last_fullsized":"2023-05-11T07:37:19.986054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:34:51.857400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.281928+0000","last_change":"2023-05-11T07:37:17.805120+0000","last_active":"2023-05-11T07:37:19.281928+0000","last_peered":"2023-05-11T07:37:19.281928+0000","last_clean":"2023-05-11T07:37:19.281928+0000","last_became_active":"2023-05-11T07:37:17.804834+0000","last_became_peered":"2023-05-11T07:37:17.804834+0000","last_unstale":"2023-05-11T07:37:19.281928+0000","last_undegraded":"2023-05-11T07:37:19.281928+0000","last_fullsized":"2023-05-11T07:37:19.281928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:10:26.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993536+0000","last_change":"2023-05-11T07:35:33.825369+0000","last_active":"2023-05-11T07:37:19.993536+0000","last_peered":"2023-05-11T07:37:19.993536+0000","last_clean":"2023-05-11T07:37:19.993536+0000","last_became_active":"2023-05-11T07:35:33.824982+0000","last_became_peered":"2023-05-11T07:35:33.824982+0000","last_unstale":"2023-05-11T07:37:19.993536+0000","last_undegraded":"2023-05-11T07:37:19.993536+0000","last_fullsized":"2023-05-11T07:37:19.993536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:21:18.916469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.986122+0000","last_change":"2023-05-11T07:37:18.292755+0000","last_active":"2023-05-11T07:37:19.986122+0000","last_peered":"2023-05-11T07:37:19.986122+0000","last_clean":"2023-05-11T07:37:19.986122+0000","last_became_active":"2023-05-11T07:37:18.292496+0000","last_became_peered":"2023-05-11T07:37:18.292496+0000","last_unstale":"2023-05-11T07:37:19.986122+0000","last_undegraded":"2023-05-11T07:37:19.986122+0000","last_fullsized":"2023-05-11T07:37:19.986122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:17.779942+0000","last_clean_scrub_stamp":"2023-05-11T07:37:17.779942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:13:21.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.993267+0000","last_change":"2023-05-11T07:37:17.813490+0000","last_active":"2023-05-11T07:37:19.993267+0000","last_peered":"2023-05-11T07:37:19.993267+0000","last_clean":"2023-05-11T07:37:19.993267+0000","last_became_active":"2023-05-11T07:37:17.813185+0000","last_became_peered":"2023-05-11T07:37:17.813185+0000","last_unstale":"2023-05-11T07:37:19.993267+0000","last_undegraded":"2023-05-11T07:37:19.993267+0000","last_fullsized":"2023-05-11T07:37:19.993267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:37:16.773422+0000","last_clean_scrub_stamp":"2023-05-11T07:37:16.773422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:49:21.490515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T07:37:19.284047+0000","last_change":"2023-05-11T07:35:33.827545+0000","last_active":"2023-05-11T07:37:19.284047+0000","last_peered":"2023-05-11T07:37:19.284047+0000","last_clean":"2023-05-11T07:37:19.284047+0000","last_became_active":"2023-05-11T07:35:33.827154+0000","last_became_peered":"2023-05-11T07:35:33.827154+0000","last_unstale":"2023-05-11T07:37:19.284047+0000","last_undegraded":"2023-05-11T07:37:19.284047+0000","last_fullsized":"2023-05-11T07:37:19.284047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T07:35:32.800073+0000","last_clean_scrub_stamp":"2023-05-11T07:35:32.800073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:15:22.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":17.736000000000001,"5min":17.736000000000001,"15min":17.736000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":18.178000000000001,"5min":18.178000000000001,"15min":18.178000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":17.706,"5min":17.706,"15min":17.706},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":18.143999999999998,"5min":18.143999999999998,"15min":18.143999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":24.933,"5min":24.933,"15min":24.933},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":17.765000000000001,"5min":17.765000000000001,"15min":17.765000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":17.917999999999999,"5min":17.917999999999999,"15min":17.917999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":14.381,"5min":14.381,"15min":14.381},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":17.602,"5min":17.602,"15min":17.602},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":17.992999999999999,"5min":17.992999999999999,"15min":17.992999999999999},"last":0.745}]},{"osd":6,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.311999999999999,"5min":14.311999999999999,"15min":14.311999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":17.558,"5min":17.558,"15min":17.558},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":17.960999999999999,"5min":17.960999999999999,"15min":17.960999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":14.349,"5min":14.349,"15min":14.349},"last":0.80100000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9836,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362004,"statfs":{"total":96636764160,"available":96626692096,"internally_reserved":0,"allocated":1085440,"data_stored":808946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.628}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8564,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363276,"statfs":{"total":96636764160,"available":96627994624,"internally_reserved":0,"allocated":503808,"data_stored":220074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.496},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu May 11 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.434}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":12.396000000000001,"5min":12.396000000000001,"15min":12.396000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":12.429,"5min":12.429,"15min":12.429},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.62},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.7480000000000002,"5min":4.7480000000000002,"15min":4.7480000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":11.919,"5min":11.919,"15min":11.919},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":12.329000000000001,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":12.051,"5min":12.051,"15min":12.051},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":12.287000000000001,"5min":12.287000000000001,"15min":12.287000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":12.364000000000001,"5min":12.364000000000001,"15min":12.364000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":12.016999999999999,"5min":12.016999999999999,"15min":12.016999999999999},"last":0.57299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.435},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.627},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.746}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.72699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.748}]},{"osd":1,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu May 11 07:36:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.872},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu May 11 07:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":495616,"data_stored":219160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.377},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.499},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.623},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu May 11 07:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T07:37:27.922 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-11T07:37:27.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-11T07:37:28.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.142+0000 7f88f35ff700 1 Processor -- start 2023-05-11T07:37:28.146 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.143+0000 7f88f35ff700 1 -- start start 2023-05-11T07:37:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f35ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f35ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88ec15e530 0x7f88ec0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f35ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec06b750 con 0x7f88ec0c92f0 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f35ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec15aec0 con 0x7f88ec15e530 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f35ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec15eaa0 con 0x7f88ec15aaf0 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f0b9a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88ec15e530 0x7f88ec0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f0b9a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88ec15e530 0x7f88ec0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34676/0 (socket says 172.21.15.144:34676) 2023-05-11T07:37:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f139b700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.144+0000 7f88f0b9a700 1 -- 172.21.15.144:0/2140325284 learned_addr learned my addr 172.21.15.144:0/2140325284 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:28.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88e3fff700 1 -- 172.21.15.144:0/2140325284 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383949999 0 0) 0x7f88ec06b750 con 0x7f88ec0c92f0 2023-05-11T07:37:28.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f0b9a700 1 -- 172.21.15.144:0/2140325284 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 msgr2=0x7f88ec0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:28.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f0b9a700 1 -- 172.21.15.144:0/2140325284 >> v1:172.21.15.145:6789/0 conn(0x7f88ec0c92f0 legacy=0x7f88ec06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f0b9a700 1 -- 172.21.15.144:0/2140325284 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec15ed80 con 0x7f88ec15e530 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f139b700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec15e530 0x7f88ec0b42c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0098f0 tx=0x7f88dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f40583955c04503 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88e3fff700 1 -- 172.21.15.144:0/2140325284 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011830 con 0x7f88ec15e530 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88e3fff700 1 -- 172.21.15.144:0/2140325284 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc011990 con 0x7f88ec15e530 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.145+0000 7f88e3fff700 1 -- 172.21.15.144:0/2140325284 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011d20 con 0x7f88ec15e530 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 -- 172.21.15.144:0/2140325284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec15e530 msgr2=0x7f88ec0b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec15e530 0x7f88ec0b42c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0098f0 tx=0x7f88dc009c00 comp rx=0 tx=0).stop 2023-05-11T07:37:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 -- 172.21.15.144:0/2140325284 shutdown_connections 2023-05-11T07:37:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2140325284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec15e530 0x7f88ec0b42c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 -- 172.21.15.144:0/2140325284 >> 172.21.15.144:0/2140325284 conn(0x7f88ec0cb720 msgr2=0x7f88ec0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 -- 172.21.15.144:0/2140325284 shutdown_connections 2023-05-11T07:37:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.146+0000 7f88f35ff700 1 -- 172.21.15.144:0/2140325284 wait complete. 2023-05-11T07:37:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.148+0000 7f88f35ff700 1 Processor -- start 2023-05-11T07:37:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.148+0000 7f88f35ff700 1 -- start start 2023-05-11T07:37:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88ec15e530 0x7f88ec0cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0ccdb0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0ccfe0 con 0x7f88ec15e530 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f35ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0cd2c0 con 0x7f88ec15aaf0 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34682/0 (socket says 172.21.15.144:34682) 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 -- 172.21.15.144:0/2708739646 learned_addr learned my addr 172.21.15.144:0/2708739646 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f1b9c700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88ec15e530 0x7f88ec0cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 -- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 msgr2=0x7f88ec0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 -- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88ec15e530 msgr2=0x7f88ec0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88ec15e530 0x7f88ec0cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f139b700 1 -- 172.21.15.144:0/2708739646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80094a0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.149+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88f139b700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f88e800ebe0 tx=0x7f88e8009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800c8b0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800ca10 con 0x7f88ec0c92f0 2023-05-11T07:37:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800cda0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc009550 con 0x7f88ec0c92f0 2023-05-11T07:37:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.150+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec15f340 con 0x7f88ec0c92f0 2023-05-11T07:37:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.151+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec15f060 con 0x7f88ec0c92f0 2023-05-11T07:37:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.152+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88e8013470 con 0x7f88ec0c92f0 2023-05-11T07:37:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.153+0000 7f88e1ffb700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 0x7f88d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.153+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f88e8089720 con 0x7f88ec0c92f0 2023-05-11T07:37:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.153+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 0x7f88d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.153+0000 7f88f0b9a700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 0x7f88d006d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000c00 tx=0x7f88dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.157+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f88e8054680 con 0x7f88ec0c92f0 2023-05-11T07:37:28.431 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.427+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f88ec0b0fd0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.435 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.431+0000 7f88e1ffb700 1 -- 172.21.15.144:0/2708739646 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f88e8057ca0 con 0x7f88ec0c92f0 2023-05-11T07:37:28.437 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 msgr2=0x7f88d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 0x7f88d006d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88dc000c00 tx=0x7f88dc008030 comp rx=0 tx=0).stop 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 msgr2=0x7f88ec0cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f88e800ebe0 tx=0x7f88e8009e20 comp rx=0 tx=0).stop 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 shutdown_connections 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f88d006ace0 0x7f88d006d190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88ec15e530 0x7f88ec0cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88ec0c92f0 0x7f88ec0cc870 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 --2- 172.21.15.144:0/2708739646 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f88ec15aaf0 0x7f88ec0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 >> 172.21.15.144:0/2708739646 conn(0x7f88ec0cb720 msgr2=0x7f88ec0c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:28.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 shutdown_connections 2023-05-11T07:37:28.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.434+0000 7f88f35ff700 1 -- 172.21.15.144:0/2708739646 wait complete. 2023-05-11T07:37:28.439 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2023-05-11T07:37:28.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T07:37:28.640 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.637+0000 7f5e88fff700 1 Processor -- start 2023-05-11T07:37:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.637+0000 7f5e88fff700 1 -- start start 2023-05-11T07:37:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.638+0000 7f5e88fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840b87e0 0x7f5e840b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.638+0000 7f5e88fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e840d02c0 0x7f5e840b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.638+0000 7f5e88fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8415cef0 con 0x7f5e840d2090 2023-05-11T07:37:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.638+0000 7f5e88fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840b5a80 con 0x7f5e840d02c0 2023-05-11T07:37:28.642 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.638+0000 7f5e88fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840cdf70 con 0x7f5e840b87e0 2023-05-11T07:37:28.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e81d9b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5e840d02c0 0x7f5e840b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e8259c700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840b87e0 0x7f5e840b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.643 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e82d9d700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f5e840d2090 0x7f5e840d24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.144:41550/0 (socket says 172.21.15.144:41550) 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e82d9d700 1 -- 172.21.15.144:0/2479158507 learned_addr learned my addr 172.21.15.144:0/2479158507 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e81d9b700 1 -- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840b87e0 msgr2=0x7f5e840b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e81d9b700 1 --2- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840b87e0 0x7f5e840b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e81d9b700 1 -- 172.21.15.144:0/2479158507 >> v1:172.21.15.145:6789/0 conn(0x7f5e840d2090 legacy=0x7f5e840d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.639+0000 7f5e81d9b700 1 -- 172.21.15.144:0/2479158507 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840cd760 con 0x7f5e840d02c0 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e81d9b700 1 --2- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e840b50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009840 tx=0x7f5e78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f053d986e090bead server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e8159a700 1 -- 172.21.15.144:0/2479158507 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78011830 con 0x7f5e840d02c0 2023-05-11T07:37:28.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e8159a700 1 -- 172.21.15.144:0/2479158507 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78011990 con 0x7f5e840d02c0 2023-05-11T07:37:28.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e8159a700 1 -- 172.21.15.144:0/2479158507 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78011d20 con 0x7f5e840d02c0 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 -- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 msgr2=0x7f5e840b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 --2- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e840b50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009840 tx=0x7f5e78009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 -- 172.21.15.144:0/2479158507 shutdown_connections 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 --2- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840b87e0 0x7f5e840b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 --2- 172.21.15.144:0/2479158507 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e840b50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.646 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 -- 172.21.15.144:0/2479158507 >> 172.21.15.144:0/2479158507 conn(0x7f5e8406acf0 msgr2=0x7f5e8406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:28.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.640+0000 7f5e88fff700 1 -- 172.21.15.144:0/2479158507 shutdown_connections 2023-05-11T07:37:28.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.641+0000 7f5e88fff700 1 -- 172.21.15.144:0/2479158507 wait complete. 2023-05-11T07:37:28.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.642+0000 7f5e88fff700 1 Processor -- start 2023-05-11T07:37:28.647 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.642+0000 7f5e88fff700 1 -- start start 2023-05-11T07:37:28.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e8415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840d2090 0x7f5e840b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8415e050 con 0x7f5e840b87e0 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8415ebd0 con 0x7f5e840d02c0 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e88fff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8415eeb0 con 0x7f5e840d2090 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e8259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e8259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34698/0 (socket says 172.21.15.144:34698) 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.643+0000 7f5e8259c700 1 -- 172.21.15.144:0/1977103608 learned_addr learned my addr 172.21.15.144:0/1977103608 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e82d9d700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840d2090 0x7f5e840b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e81d9b700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e8415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 -- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840d2090 msgr2=0x7f5e840b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840d2090 0x7f5e840b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 -- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 msgr2=0x7f5e8415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e8415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 -- 172.21.15.144:0/1977103608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780094a0 con 0x7f5e840b87e0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e8259c700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e9b0 tx=0x7f5e7400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74009710 con 0x7f5e840b87e0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400c850 con 0x7f5e840b87e0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400cbc0 con 0x7f5e840b87e0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.644+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840cd9b0 con 0x7f5e840b87e0 2023-05-11T07:37:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.645+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840d2d30 con 0x7f5e840b87e0 2023-05-11T07:37:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.646+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840cdc90 con 0x7f5e840b87e0 2023-05-11T07:37:28.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.646+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e7400cd20 con 0x7f5e840b87e0 2023-05-11T07:37:28.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.648+0000 7f5e72ffd700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 0x7f5e6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:28.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.648+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5e74089640 con 0x7f5e840b87e0 2023-05-11T07:37:28.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.648+0000 7f5e81d9b700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 0x7f5e6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:28.654 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.648+0000 7f5e81d9b700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 0x7f5e6406d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000c00 tx=0x7f5e78008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:28.655 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.652+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5e740580d0 con 0x7f5e840b87e0 2023-05-11T07:37:28.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.886+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e8408b830 con 0x7f5e840b87e0 2023-05-11T07:37:28.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.886+0000 7f5e72ffd700 1 -- 172.21.15.144:0/1977103608 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4680 (secure 0 0 0) 0x7f5e74057c60 con 0x7f5e840b87e0 2023-05-11T07:37:28.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:28.890 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/140341330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":140341330},{"type":"v1","addr":"172.21.15.144:6837","nonce":140341330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5003,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3680363199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6833","nonce":3680363199},{"type":"v1","addr":"172.21.15.145:6835","nonce":3680363199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6834/3789358729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3789358729},{"type":"v1","addr":"172.21.15.145:6834","nonce":3789358729}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T07:37:18.267969+0000","modified":"2023-05-11T07:37:21.285806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6836/2598222041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2598222041},{"type":"v1","addr":"172.21.15.144:6836","nonce":2598222041}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-11T07:37:28.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 msgr2=0x7f5e6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 0x7f5e6406d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000c00 tx=0x7f5e78008030 comp rx=0 tx=0).stop 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 msgr2=0x7f5e8415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400e9b0 tx=0x7f5e7400ed70 comp rx=0 tx=0).stop 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 shutdown_connections 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f5e6406ace0 0x7f5e6406d190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f5e840d2090 0x7f5e840b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e840b87e0 0x7f5e8415e540 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 --2- 172.21.15.144:0/1977103608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5e840d02c0 0x7f5e8415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 >> 172.21.15.144:0/1977103608 conn(0x7f5e8406acf0 msgr2=0x7f5e840d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 shutdown_connections 2023-05-11T07:37:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:28.889+0000 7f5e88fff700 1 -- 172.21.15.144:0/1977103608 wait complete. 2023-05-11T07:37:28.894 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2023-05-11T07:37:29.312 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T07:37:18.267969+0000', 'modified': '2023-05-11T07:37:21.285806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5370}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5370': {'gid': 5370, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.144:6836/2598222041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 2598222041}, {'type': 'v1', 'addr': '172.21.15.144:6836', 'nonce': 2598222041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-11T07:37:29.313 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T07:37:29.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-11T07:37:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.497+0000 7f4620dff700 1 Processor -- start 2023-05-11T07:37:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.497+0000 7f4620dff700 1 -- start start 2023-05-11T07:37:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.498+0000 7f4620dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c15aaf0 0x7f461c0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.498+0000 7f4620dff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f461c0b49d0 0x7f461c06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.498+0000 7f4620dff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c06b750 con 0x7f461c15e530 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.498+0000 7f4620dff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c15aec0 con 0x7f461c0b49d0 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f4620dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c15eaa0 con 0x7f461c15aaf0 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f461c0b49d0 0x7f461c06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f461c0b49d0 0x7f461c06bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34708/0 (socket says 172.21.15.144:34708) 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 -- 172.21.15.144:0/3461944904 learned_addr learned my addr 172.21.15.144:0/3461944904 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461a59c700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c15aaf0 0x7f461c0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 -- 172.21.15.144:0/3461944904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c15aaf0 msgr2=0x7f461c0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c15aaf0 0x7f461c0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 -- 172.21.15.144:0/3461944904 >> v1:172.21.15.145:6789/0 conn(0x7f461c15e530 legacy=0x7f461c0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 -- 172.21.15.144:0/3461944904 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c15ed80 con 0x7f461c0b49d0 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.499+0000 7f461ad9d700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c0b49d0 0x7f461c06bbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4614009e50 tx=0x7f461400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f55f39eaa833b2b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4619d9b700 1 -- 172.21.15.144:0/3461944904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400e070 con 0x7f461c0b49d0 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4619d9b700 1 -- 172.21.15.144:0/3461944904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400b910 con 0x7f461c0b49d0 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4619d9b700 1 -- 172.21.15.144:0/3461944904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400bcc0 con 0x7f461c0b49d0 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 -- 172.21.15.144:0/3461944904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c0b49d0 msgr2=0x7f461c06bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c0b49d0 0x7f461c06bbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4614009e50 tx=0x7f461400b330 comp rx=0 tx=0).stop 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 -- 172.21.15.144:0/3461944904 shutdown_connections 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c0b49d0 0x7f461c06bbe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 --2- 172.21.15.144:0/3461944904 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c15aaf0 0x7f461c0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 -- 172.21.15.144:0/3461944904 >> 172.21.15.144:0/3461944904 conn(0x7f461c0cb720 msgr2=0x7f461c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 -- 172.21.15.144:0/3461944904 shutdown_connections 2023-05-11T07:37:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.500+0000 7f4620dff700 1 -- 172.21.15.144:0/3461944904 wait complete. 2023-05-11T07:37:29.508 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.502+0000 7f4620dff700 1 Processor -- start 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.502+0000 7f4620dff700 1 -- start start 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 0x7f461c150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f461c15e530 0x7f461c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c7ac0 con 0x7f461c15aaf0 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c77c0 con 0x7f461c15e530 2023-05-11T07:37:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4620dff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c6a00 con 0x7f461c0b49d0 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4613fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4613fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34724/0 (socket says 172.21.15.144:34724) 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f4613fff700 1 -- 172.21.15.144:0/1258322537 learned_addr learned my addr 172.21.15.144:0/1258322537 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f461c15e530 0x7f461c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.503+0000 7f461a59c700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 0x7f461c150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 -- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 msgr2=0x7f461c150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 0x7f461c150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 -- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f461c15e530 msgr2=0x7f461c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f461c15e530 0x7f461c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 -- 172.21.15.144:0/1258322537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009b30 con 0x7f461c15aaf0 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f461a59c700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 0x7f461c150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4613fff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f460400c450 tx=0x7f460400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4612ffd700 1 -- 172.21.15.144:0/1258322537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040052d0 con 0x7f461c15aaf0 2023-05-11T07:37:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4612ffd700 1 -- 172.21.15.144:0/1258322537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4604005430 con 0x7f461c15aaf0 2023-05-11T07:37:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c15f340 con 0x7f461c15aaf0 2023-05-11T07:37:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4612ffd700 1 -- 172.21.15.144:0/1258322537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040038c0 con 0x7f461c15aaf0 2023-05-11T07:37:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.504+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c15f060 con 0x7f461c15aaf0 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.506+0000 7f4612ffd700 1 -- 172.21.15.144:0/1258322537 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4604003a20 con 0x7f461c15aaf0 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.507+0000 7f4612ffd700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 0x7f45fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.508+0000 7f4612ffd700 1 -- 172.21.15.144:0/1258322537 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4604088a20 con 0x7f461c15aaf0 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.508+0000 7f461a59c700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 0x7f45fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.508+0000 7f461a59c700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 0x7f45fc06d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cb000 tx=0x7f460c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.509+0000 7f46346e0b80 1 Processor -- start 2023-05-11T07:37:29.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 -- start start 2023-05-11T07:37:29.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e509600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 0x55d16e4ee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.515 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e3ad600 con 0x55d16e4c1740 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e41c790 con 0x55d16e50a2d0 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.510+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d16e415a60 con 0x55d16e509230 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34730/0 (socket says 172.21.15.144:34730) 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 -- 172.21.15.144:0/2315750836 learned_addr learned my addr 172.21.15.144:0/2315750836 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461a59c700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e509600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f4613fff700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 0x55d16e4ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 -- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 msgr2=0x55d16e509600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e509600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 -- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 msgr2=0x55d16e4ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 0x55d16e4ee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 -- 172.21.15.144:0/2315750836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d16e209790 con 0x55d16e4c1740 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f4613fff700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 0x55d16e4ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.511+0000 7f461ad9d700 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f461400b680 tx=0x7f4614010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c7398fec0dc416 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f45fbfff700 1 -- 172.21.15.144:0/2315750836 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614003c20 con 0x55d16e4c1740 2023-05-11T07:37:29.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f45fbfff700 1 -- 172.21.15.144:0/2315750836 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614003d80 con 0x55d16e4c1740 2023-05-11T07:37:29.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f45fbfff700 1 -- 172.21.15.144:0/2315750836 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614004260 con 0x55d16e4c1740 2023-05-11T07:37:29.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 -- 172.21.15.144:0/2315750836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 msgr2=0x55d16e4ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.523 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f461400b680 tx=0x7f4614010000 comp rx=0 tx=0).stop 2023-05-11T07:37:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 -- 172.21.15.144:0/2315750836 shutdown_connections 2023-05-11T07:37:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e509600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e4c1740 0x55d16e4ee6c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 --2- 172.21.15.144:0/2315750836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e50a2d0 0x55d16e4ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 -- 172.21.15.144:0/2315750836 >> 172.21.15.144:0/2315750836 conn(0x55d16e4b8b60 msgr2=0x55d16e4be0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 -- 172.21.15.144:0/2315750836 shutdown_connections 2023-05-11T07:37:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.512+0000 7f46346e0b80 1 -- 172.21.15.144:0/2315750836 wait complete. 2023-05-11T07:37:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.513+0000 7f46346e0b80 1 -- start start 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.513+0000 7f46346e0b80 1 Processor -- start 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e4f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e50a2d0 0x55d16e4e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e3b1ad0 con 0x55d16e509230 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e3b1770 con 0x55d16e4c1740 2023-05-11T07:37:29.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d16e20a390 con 0x55d16e50a2d0 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.514+0000 7f46346e0b80 10 client.0 _ll_register_callbacks cb 0x55d16e3b3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34746/0 (socket says 172.21.15.144:34746) 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 -- 172.21.15.144:0/300254591 learned_addr learned my addr 172.21.15.144:0/300254591 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f461a59c700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e4f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f461ad9d700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e50a2d0 0x55d16e4e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 -- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e50a2d0 msgr2=0x55d16e4e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e50a2d0 0x55d16e4e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 -- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 msgr2=0x55d16e4f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e4f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 -- 172.21.15.144:0/300254591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461400be70 con 0x55d16e509230 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f4613fff700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4604053ab0 tx=0x7f460405b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e60a24fdaff9497 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f45f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460405b350 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d16e4b6170 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.515+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f460405f470 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f460405f630 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 10 client.5574 fetch_fsmap learned FSMap version 17 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d16e3dc2e0 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d16e4b6170 con 0x55d16e509230 2023-05-11T07:37:29.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f460406e020 con 0x55d16e509230 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 10 client.5574 fetch_fsmap finished waiting for FSMap version 17 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 10 client.5574 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 20 client.5574 populate_metadata read hostname 'smithi144' 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e5190d0 0x55d16e4ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 4 client.5574 mds_command: new command op to 5370 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 --> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d16e4932f0 con 0x55d16e5190d0 2023-05-11T07:37:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.516+0000 7f461a59c700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e5190d0 0x55d16e4ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.517+0000 7f461a59c700 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e5190d0 0x55d16e4ef260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5df60d6e1200d46c server_cookie=ccc4d054e7831a1a in_seq=0 out_seq=0 2023-05-11T07:37:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.517+0000 7f45f97fa700 10 client.5574 ms_handle_connect on v2:172.21.15.144:6835/2598222041 2023-05-11T07:37:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.517+0000 7f45f97fa700 1 -- 172.21.15.144:0/300254591 <== mds.0 v2:172.21.15.144:6835/2598222041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x55d16e4932f0 con 0x55d16e5190d0 2023-05-11T07:37:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.517+0000 7f45f97fa700 10 client.5574 handle_command_reply: tid=0 2023-05-11T07:37:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.517+0000 7f46346e0b80 1 client.5574 shutdown 2023-05-11T07:37:29.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 msgr2=0x55d16e4ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4604053ab0 tx=0x7f460405b570 comp rx=0 tx=0).stop 2023-05-11T07:37:29.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 shutdown_connections 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e5190d0 0x55d16e4ef260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e50a2d0 0x55d16e4e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e4f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 --2- 172.21.15.144:0/300254591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e509230 0x55d16e4ee580 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f45f97fa700 0 client.5574 ms_handle_reset on v2:172.21.15.144:6835/2598222041 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 >> 172.21.15.144:0/300254591 conn(0x55d16e4b8b60 msgr2=0x55d16e508770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 shutdown_connections 2023-05-11T07:37:29.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 1 -- 172.21.15.144:0/300254591 wait complete. 2023-05-11T07:37:29.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.518+0000 7f46346e0b80 20 client.5574 trim_cache size 0 max 16384 2023-05-11T07:37:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.536+0000 7f46346e0b80 1 Processor -- start 2023-05-11T07:37:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 -- start start 2023-05-11T07:37:29.541 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e509a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e4e22b0 con 0x55d16e50a2d0 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e4c3190 con 0x55d16e4c1740 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.537+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d16e52b470 con 0x55d16e509230 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34750/0 (socket says 172.21.15.144:34750) 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 -- 172.21.15.144:0/1655253229 learned_addr learned my addr 172.21.15.144:0/1655253229 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f4613fff700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461a59c700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e509a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 -- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 msgr2=0x55d16e4bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4bcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 -- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 msgr2=0x55d16e509a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e509a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 -- 172.21.15.144:0/1655253229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d16e3dc030 con 0x55d16e50a2d0 2023-05-11T07:37:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461a59c700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e509a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.538+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4614021000 tx=0x7f4614009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eff65e606fdda3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f4610ff9700 1 -- 172.21.15.144:0/1655253229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614003a20 con 0x55d16e50a2d0 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f4610ff9700 1 -- 172.21.15.144:0/1655253229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614003ba0 con 0x55d16e50a2d0 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f4610ff9700 1 -- 172.21.15.144:0/1655253229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140256b0 con 0x55d16e50a2d0 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 -- 172.21.15.144:0/1655253229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 msgr2=0x55d16e4bd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4614021000 tx=0x7f4614009810 comp rx=0 tx=0).stop 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 -- 172.21.15.144:0/1655253229 shutdown_connections 2023-05-11T07:37:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e4bd330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e509a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1655253229 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4bcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 -- 172.21.15.144:0/1655253229 >> 172.21.15.144:0/1655253229 conn(0x55d16e4b8b60 msgr2=0x55d16e4bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 -- 172.21.15.144:0/1655253229 shutdown_connections 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.539+0000 7f46346e0b80 1 -- 172.21.15.144:0/1655253229 wait complete. 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.540+0000 7f46346e0b80 1 -- start start 2023-05-11T07:37:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.540+0000 7f46346e0b80 1 Processor -- start 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e570d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e4e8d60 con 0x55d16e50a2d0 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16e511990 con 0x55d16e4c1740 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d16e4e20c0 con 0x55d16e509230 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f46346e0b80 10 client.0 _ll_register_callbacks cb 0x55d16e3b3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T07:37:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f461ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34760/0 (socket says 172.21.15.144:34760) 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.541+0000 7f461ad9d700 1 -- 172.21.15.144:0/1791945415 learned_addr learned my addr 172.21.15.144:0/1791945415 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461a59c700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e570d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f4613fff700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 -- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 msgr2=0x55d16e4ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 -- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 msgr2=0x55d16e570d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e570d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 -- 172.21.15.144:0/1791945415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d16e209790 con 0x55d16e50a2d0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f461ad9d700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4614027040 tx=0x7f4614004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cc00c45f603d60 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f45f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614003a20 con 0x55d16e50a2d0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4614025de0 con 0x55d16e50a2d0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.542+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4614003d80 con 0x55d16e50a2d0 2023-05-11T07:37:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4614009900 con 0x55d16e50a2d0 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 10 client.5580 fetch_fsmap learned FSMap version 17 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d16e3c2b10 con 0x55d16e50a2d0 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614003d80 con 0x55d16e50a2d0 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4614037030 con 0x55d16e50a2d0 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 10 client.5580 fetch_fsmap finished waiting for FSMap version 17 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 10 client.5580 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-11T07:37:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 20 client.5580 populate_metadata read hostname 'smithi144' 2023-05-11T07:37:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e511140 0x55d16e4f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 4 client.5580 mds_command: new command op to 5370 tid=0[{"prefix": "status"}] 2023-05-11T07:37:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 --> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d16e40eba0 con 0x55d16e511140 2023-05-11T07:37:29.553 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.543+0000 7f461a59c700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e511140 0x55d16e4f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f45f97fa700 10 client.5580 ms_handle_connect on v2:172.21.15.144:6835/2598222041 2023-05-11T07:37:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f461a59c700 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e511140 0x55d16e4f0d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e227f64fd31630 server_cookie=19e086735fb45415 in_seq=0 out_seq=0 2023-05-11T07:37:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f45f97fa700 1 -- 172.21.15.144:0/1791945415 <== mds.0 v2:172.21.15.144:6835/2598222041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d16e40eba0 con 0x55d16e511140 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f45f97fa700 10 client.5580 handle_command_reply: tid=0 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 client.5580 shutdown 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 msgr2=0x55d16e510c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4614027040 tx=0x7f4614004b40 comp rx=0 tx=0).stop 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 shutdown_connections 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:6835/2598222041,v1:172.21.15.144:6836/2598222041] conn(0x55d16e511140 0x55d16e4f0d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d16e50a2d0 0x55d16e510c00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d16e4c1740 0x55d16e570d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f45f97fa700 0 client.5580 ms_handle_reset on v2:172.21.15.144:6835/2598222041 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 --2- 172.21.15.144:0/1791945415 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x55d16e509230 0x55d16e4ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 >> 172.21.15.144:0/1791945415 conn(0x55d16e4b8b60 msgr2=0x55d16e4bcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 shutdown_connections 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.544+0000 7f46346e0b80 1 -- 172.21.15.144:0/1791945415 wait complete. 2023-05-11T07:37:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f46346e0b80 20 client.5580 trim_cache size 0 max 16384 2023-05-11T07:37:29.557 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-05-11T07:37:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "424d6242-b269-485d-aca8-83f4424787ea", 2023-05-11T07:37:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2023-05-11T07:37:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5370, 2023-05-11T07:37:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 11.275311998999999, 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 17, 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 42, 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 42, 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 19.565619211000001 2023-05-11T07:37:29.558 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-05-11T07:37:29.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 msgr2=0x7f45fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 0x7f45fc06d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cb000 tx=0x7f460c008040 comp rx=0 tx=0).stop 2023-05-11T07:37:29.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 msgr2=0x7f461c0c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f460400c450 tx=0x7f460400c760 comp rx=0 tx=0).stop 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 shutdown_connections 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f45fc06ace0 0x7f45fc06d190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f461c0b49d0 0x7f461c150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f461c15e530 0x7f461c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 --2- 172.21.15.144:0/1258322537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15aaf0 0x7f461c0c64c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 >> 172.21.15.144:0/1258322537 conn(0x7f461c0cb720 msgr2=0x7f461c0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 shutdown_connections 2023-05-11T07:37:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.545+0000 7f4620dff700 1 -- 172.21.15.144:0/1258322537 wait complete. 2023-05-11T07:37:29.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T07:37:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.745+0000 7f6b8edff700 1 Processor -- start 2023-05-11T07:37:29.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.746+0000 7f6b8edff700 1 -- start start 2023-05-11T07:37:29.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b88158be0 0x7f6b880ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 0x7f6b8806b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806bce0 0x7f6b88070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880c9790 con 0x7f6b88158be0 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880cb2b0 con 0x7f6b8806af50 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.747+0000 7f6b8edff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8815d3c0 con 0x7f6b8806bce0 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b88158be0 0x7f6b880ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b88158be0 0x7f6b880ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34776/0 (socket says 172.21.15.144:34776) 2023-05-11T07:37:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 -- 172.21.15.144:0/292067844 learned_addr learned my addr 172.21.15.144:0/292067844 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b87fff700 1 --2- 172.21.15.144:0/292067844 >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 0x7f6b8806b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8d39c700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806bce0 0x7f6b88070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 -- 172.21.15.144:0/292067844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806bce0 msgr2=0x7f6b88070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806bce0 0x7f6b88070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 -- 172.21.15.144:0/292067844 >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 msgr2=0x7f6b8806b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/292067844 >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 0x7f6b8806b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 -- 172.21.15.144:0/292067844 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8815d6a0 con 0x7f6b88158be0 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b87fff700 1 --2- 172.21.15.144:0/292067844 >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 0x7f6b8806b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.748+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b88158be0 0x7f6b880ce570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b880c5de0 tx=0x7f6b7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fbfd064152862b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b877fe700 1 -- 172.21.15.144:0/292067844 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00b870 con 0x7f6b88158be0 2023-05-11T07:37:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b877fe700 1 -- 172.21.15.144:0/292067844 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00b9d0 con 0x7f6b88158be0 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b877fe700 1 -- 172.21.15.144:0/292067844 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00bd60 con 0x7f6b88158be0 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 -- 172.21.15.144:0/292067844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b88158be0 msgr2=0x7f6b880ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b88158be0 0x7f6b880ce570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6b880c5de0 tx=0x7f6b7c009bd0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 -- 172.21.15.144:0/292067844 shutdown_connections 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806bce0 0x7f6b88070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 --2- 172.21.15.144:0/292067844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b88158be0 0x7f6b880ce570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 --2- 172.21.15.144:0/292067844 >> v2:172.21.15.145:3300/0 conn(0x7f6b8806af50 0x7f6b8806b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 -- 172.21.15.144:0/292067844 >> 172.21.15.144:0/292067844 conn(0x7f6b880cb7e0 msgr2=0x7f6b880cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 -- 172.21.15.144:0/292067844 shutdown_connections 2023-05-11T07:37:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.749+0000 7f6b8edff700 1 -- 172.21.15.144:0/292067844 wait complete. 2023-05-11T07:37:29.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.751+0000 7f6b8edff700 1 Processor -- start 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.751+0000 7f6b8edff700 1 -- start start 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806af50 0x7f6b880c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b88158be0 0x7f6b881506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c7510 con 0x7f6b8806bce0 2023-05-11T07:37:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881511a0 con 0x7f6b88158be0 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8edff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88151480 con 0x7f6b8806af50 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34778/0 (socket says 172.21.15.144:34778) 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b87fff700 1 -- 172.21.15.144:0/1316028201 learned_addr learned my addr 172.21.15.144:0/1316028201 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8d39c700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b88158be0 0x7f6b881506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.752+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806af50 0x7f6b880c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 -- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806af50 msgr2=0x7f6b880c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806af50 0x7f6b880c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 -- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b88158be0 msgr2=0x7f6b881506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b88158be0 0x7f6b881506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 -- 172.21.15.144:0/1316028201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c009550 con 0x7f6b8806bce0 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b87fff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d7d0 tx=0x7f6b7400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004030 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b74004190 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b880ceab0 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004500 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.753+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b880c93b0 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.754+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880caea0 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.755+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b740036a0 con 0x7f6b8806bce0 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.757+0000 7f6b857fa700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 0x7f6b6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:29.765 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.757+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6b74089270 con 0x7f6b8806bce0 2023-05-11T07:37:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.757+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 0x7f6b6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.758+0000 7f6b8cb9b700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 0x7f6b6c06d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c014040 tx=0x7f6b7c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.761+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b740541d0 con 0x7f6b8806bce0 2023-05-11T07:37:30.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:29.999+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6b88074530 con 0x7f6b8806bce0 2023-05-11T07:37:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.000+0000 7f6b857fa700 1 -- 172.21.15.144:0/1316028201 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6b740577f0 con 0x7f6b8806bce0 2023-05-11T07:37:30.004 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-11T07:37:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 msgr2=0x7f6b6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 0x7f6b6c06d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c014040 tx=0x7f6b7c008030 comp rx=0 tx=0).stop 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 msgr2=0x7f6b880afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d7d0 tx=0x7f6b7400dae0 comp rx=0 tx=0).stop 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 shutdown_connections 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f6b6c06ace0 0x7f6b6c06d190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f6b8806af50 0x7f6b880c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b88158be0 0x7f6b881506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:30.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 --2- 172.21.15.144:0/1316028201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b8806bce0 0x7f6b880afa60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:30.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 >> 172.21.15.144:0/1316028201 conn(0x7f6b880cb7e0 msgr2=0x7f6b880cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:30.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 shutdown_connections 2023-05-11T07:37:30.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:30.002+0000 7f6b8edff700 1 -- 172.21.15.144:0/1316028201 wait complete. 2023-05-11T07:37:30.022 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-11T07:37:30.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T07:37:30.023 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-05-11T07:37:30.024 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-11T07:37:30.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T07:37:30.024 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-11T07:37:30.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-11T07:37:30.025 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T07:37:30.025 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T07:37:30.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.026 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-05-11T07:37:30.068 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.069 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T07:37:30.070 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42225sec preferred_lft 42225sec 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.071 INFO:teuthology.orchestra.run.smithi144.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:bc:82:48:be:48 brd ff:ff:ff:ff:ff:ff 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f8e9:c2ff:fe53:c8ef/64 scope link 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:bc:82:48:be:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T07:37:30.072 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::cbc:82ff:fe48:be48/64 scope link 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f6:42:68:b8:af:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f442:68ff:feb8:af82/64 scope link 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-05-11T07:37:30.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.074 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T07:37:30.169 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-05-11T07:37:30.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.172 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-05-11T07:37:30.216 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-05-11T07:37:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T07:37:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T07:37:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T07:37:30.217 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T07:37:30.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.218 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-05-11T07:37:30.218 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-05-11T07:37:30.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T07:37:30.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T07:37:30.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T07:37:30.219 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-05-11T07:37:30.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.408 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-05-11T07:37:30.450 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-11T07:37:30.450 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-11T07:37:30.450 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T07:37:30.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-05-11T07:37:30.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:37:30.555 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-11T07:37:30.597 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-11T07:37:30.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T07:37:30.598 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-11T07:37:30.678 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-11T07:37:30.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:37:30.814 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:37:30.814 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:37:30.814 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:37:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:37:30.828 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:37:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:37:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:37:30.829 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:37:30.851 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-11T07:37:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-11T07:37:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-05-11T07:37:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.145:3300,172.21.15.145:3301" 2023-05-11T07:37:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-11T07:37:30.852 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790" 2023-05-11T07:37:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.144:6789,172.21.15.145:6789,172.21.15.145:6790:/ 2023-05-11T07:37:30.853 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=424d6242-b269-485d-aca8-83f4424787ea" will pass to kernel 2023-05-11T07:37:30.857 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-11T07:37:30.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-11T07:37:30.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:30.922 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-11T07:37:31.014 INFO:teuthology.orchestra.run.smithi144.stdout:client5494 2023-05-11T07:37:31.014 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:37:31.015 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T07:37:31.056 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=xfstests-dev 2023-05-11T07:37:31.136 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.Kh63E6MZ0bxfstests-dev 2023-05-11T07:37:31.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:31.137 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.Kh63E6MZ0bxfstests-dev) 2023-05-11T07:37:31.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:31.243 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.Kh63E6MZ0bxfstests-dev) 2023-05-11T07:37:31.289 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/tmp/tmp.Kh63E6MZ0bxfstests-dev'... 2023-05-11T07:37:32.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:32.149 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-11T07:37:32.199 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=test 2023-05-11T07:37:32.239 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.UvWLtE3F76test 2023-05-11T07:37:32.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:37:32.240 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-11T07:37:32.323 DEBUG:teuthology.orchestra.run.smithi144:> mktemp -d --suffix=scratch 2023-05-11T07:37:32.403 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:37:32.404 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-05-11T07:37:32.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-05-11T07:37:33.009 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:37:33.014 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:37:33.373 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:07:00 ago on Thu 11 May 2023 07:30:33 AM UTC. 2023-05-11T07:37:34.358 INFO:teuthology.orchestra.run.smithi144.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T07:37:34.358 INFO:teuthology.orchestra.run.smithi144.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T07:37:34.360 INFO:teuthology.orchestra.run.smithi144.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-05-11T07:37:34.360 INFO:teuthology.orchestra.run.smithi144.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-05-11T07:37:34.361 INFO:teuthology.orchestra.run.smithi144.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-05-11T07:37:34.363 INFO:teuthology.orchestra.run.smithi144.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-05-11T07:37:34.365 INFO:teuthology.orchestra.run.smithi144.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-05-11T07:37:34.366 INFO:teuthology.orchestra.run.smithi144.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-05-11T07:37:34.367 INFO:teuthology.orchestra.run.smithi144.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-05-11T07:37:34.368 INFO:teuthology.orchestra.run.smithi144.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-05-11T07:37:34.369 INFO:teuthology.orchestra.run.smithi144.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-05-11T07:37:34.370 INFO:teuthology.orchestra.run.smithi144.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-05-11T07:37:34.371 INFO:teuthology.orchestra.run.smithi144.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-05-11T07:37:34.372 INFO:teuthology.orchestra.run.smithi144.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-05-11T07:37:34.373 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T07:37:34.374 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T07:37:34.375 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T07:37:34.376 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T07:37:34.377 INFO:teuthology.orchestra.run.smithi144.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-05-11T07:37:34.378 INFO:teuthology.orchestra.run.smithi144.stdout:Package libuuid-devel-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T07:37:34.379 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T07:37:34.381 INFO:teuthology.orchestra.run.smithi144.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-05-11T07:37:34.385 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T07:37:34.533 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-05-11T07:37:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2023-05-11T07:37:34.535 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repo Size 2023-05-11T07:37:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2023-05-11T07:37:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: daxctl-libs x86_64 71.1-4.el8 baseos 42 k 2023-05-11T07:37:34.536 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: ndctl-libs x86_64 71.1-4.el8 baseos 80 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-05-11T07:37:34.537 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout: python27 2.7 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2023-05-11T07:37:34.538 INFO:teuthology.orchestra.run.smithi144.stdout:Install 14 Packages 2023-05-11T07:37:34.539 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:34.539 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 11 M 2023-05-11T07:37:34.539 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 40 M 2023-05-11T07:37:34.540 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-05-11T07:37:34.890 INFO:teuthology.orchestra.run.smithi144.stdout:(1/14): libpmemblk-1.6.1-1.el8.x86_64.rpm 491 kB/s | 92 kB 00:00 2023-05-11T07:37:34.915 INFO:teuthology.orchestra.run.smithi144.stdout:(2/14): python2-2.7.18-12.module_el8+299+aa6e9a 521 kB/s | 110 kB 00:00 2023-05-11T07:37:34.990 INFO:teuthology.orchestra.run.smithi144.stdout:(3/14): fio-3.19-4.el8.x86_64.rpm 1.8 MB/s | 538 kB 00:00 2023-05-11T07:37:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:(4/14): python2-pip-9.0.3-19.module_el8+299+aa6 11 MB/s | 1.8 MB 00:00 2023-05-11T07:37:35.116 INFO:teuthology.orchestra.run.smithi144.stdout:(5/14): python2-pip-wheel-9.0.3-19.module_el8+2 6.9 MB/s | 892 kB 00:00 2023-05-11T07:37:35.149 INFO:teuthology.orchestra.run.smithi144.stdout:(6/14): python2-setuptools-39.0.1-13.module_el8 9.1 MB/s | 702 kB 00:00 2023-05-11T07:37:35.183 INFO:teuthology.orchestra.run.smithi144.stdout:(7/14): python2-setuptools-wheel-39.0.1-13.modu 4.2 MB/s | 287 kB 00:00 2023-05-11T07:37:35.208 INFO:teuthology.orchestra.run.smithi144.stdout:(8/14): python2-wheel-wheel-0.31.1-3.module_el8 762 kB/s | 44 kB 00:00 2023-05-11T07:37:35.367 INFO:teuthology.orchestra.run.smithi144.stdout:(9/14): python2-libs-2.7.18-12.module_el8+299+a 14 MB/s | 6.5 MB 00:00 2023-05-11T07:37:35.392 INFO:teuthology.orchestra.run.smithi144.stdout:(10/14): daxctl-libs-71.1-4.el8.x86_64.rpm 201 kB/s | 42 kB 00:00 2023-05-11T07:37:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:(11/14): dump-0.4-0.36.b46.el8.x86_64.rpm 702 kB/s | 164 kB 00:00 2023-05-11T07:37:35.484 INFO:teuthology.orchestra.run.smithi144.stdout:(12/14): rmt-1.5.3-13.el8.x86_64.rpm 560 kB/s | 51 kB 00:00 2023-05-11T07:37:35.543 INFO:teuthology.orchestra.run.smithi144.stdout:(13/14): ndctl-libs-71.1-4.el8.x86_64.rpm 455 kB/s | 80 kB 00:00 2023-05-11T07:37:35.626 INFO:teuthology.orchestra.run.smithi144.stdout:(14/14): indent-2.2.13-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-05-11T07:37:35.627 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-05-11T07:37:35.627 INFO:teuthology.orchestra.run.smithi144.stdout:Total 10 MB/s | 11 MB 00:01 2023-05-11T07:37:35.926 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-05-11T07:37:35.954 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-05-11T07:37:35.955 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-05-11T07:37:36.219 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-05-11T07:37:36.224 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-05-11T07:37:36.836 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-05-11T07:37:37.019 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-11T07:37:37.107 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-11T07:37:37.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-11T07:37:37.376 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-11T07:37:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-11T07:37:37.609 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-11T07:37:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/14 2023-05-11T07:37:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 5/14 2023-05-11T07:37:39.362 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-11T07:37:40.158 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 7/14 2023-05-11T07:37:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 8/14 2023-05-11T07:37:40.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 9/14 2023-05-11T07:37:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-11T07:37:41.317 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-11T07:37:41.586 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-11T07:37:41.863 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fio-3.19-4.el8.x86_64 12/14 2023-05-11T07:37:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : indent-2.2.13-2.el8.x86_64 13/14 2023-05-11T07:37:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-11T07:37:42.663 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-11T07:37:42.664 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fio-3.19-4.el8.x86_64 1/14 2023-05-11T07:37:42.664 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/14 2023-05-11T07:37:42.664 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/14 2023-05-11T07:37:42.664 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/14 2023-05-11T07:37:42.664 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-11T07:37:42.665 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/14 2023-05-11T07:37:42.666 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/14 2023-05-11T07:37:43.408 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/14 2023-05-11T07:37:43.408 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: fio-3.19-4.el8.x86_64 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: indent-2.2.13-2.el8.x86_64 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-05-11T07:37:43.409 INFO:teuthology.orchestra.run.smithi144.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-11T07:37:43.410 INFO:teuthology.orchestra.run.smithi144.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-05-11T07:37:43.411 INFO:teuthology.orchestra.run.smithi144.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-05-11T07:37:43.411 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:43.411 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-05-11T07:37:43.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd -m fsgqa 2023-05-11T07:37:43.681 INFO:teuthology.orchestra.run.smithi144.stderr:useradd: user 'fsgqa' already exists 2023-05-11T07:37:43.683 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-11T07:37:43.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo groupadd fsgqa 2023-05-11T07:37:43.745 INFO:teuthology.orchestra.run.smithi144.stderr:groupadd: group 'fsgqa' already exists 2023-05-11T07:37:43.747 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-11T07:37:43.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd fsgqa2 2023-05-11T07:37:44.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo useradd 123456-fsgqa 2023-05-11T07:37:45.281 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-11T07:37:45.466 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.464+0000 7f50113ff700 1 Processor -- start 2023-05-11T07:37:45.467 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.464+0000 7f50113ff700 1 -- start start 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f50113ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f500c06baf0 0x7f500c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f50113ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c06e020 con 0x7f500c15ca50 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f50113ff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c06e250 con 0x7f500c0cfaa0 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f50113ff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c06e530 con 0x7f500c06baf0 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f500b7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f500c06baf0 0x7f500c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f500affd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f500c15ca50 0x7f500c06f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42432/0 (socket says 172.21.15.144:42432) 2023-05-11T07:37:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.465+0000 7f500affd700 1 -- 172.21.15.144:0/701888283 learned_addr learned my addr 172.21.15.144:0/701888283 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f500b7fe700 1 -- 172.21.15.144:0/701888283 >> v1:172.21.15.145:6789/0 conn(0x7f500c0cfaa0 legacy=0x7f500c06b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f500b7fe700 1 -- 172.21.15.144:0/701888283 >> v1:172.21.15.144:6789/0 conn(0x7f500c15ca50 legacy=0x7f500c06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f500b7fe700 1 -- 172.21.15.144:0/701888283 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c06e810 con 0x7f500c06baf0 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f5009ffb700 1 -- 172.21.15.144:0/701888283 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371434616 0 0) 0x7f500c06e020 con 0x7f500c15ca50 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f500b7fe700 1 --2- 172.21.15.144:0/701888283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c06baf0 0x7f500c06dae0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5004009d90 tx=0x7f500400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217837f83164bb51 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.470 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f5009ffb700 1 -- 172.21.15.144:0/701888283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400e070 con 0x7f500c06baf0 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f5009ffb700 1 -- 172.21.15.144:0/701888283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500400bb90 con 0x7f500c06baf0 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.466+0000 7f5009ffb700 1 -- 172.21.15.144:0/701888283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004003a20 con 0x7f500c06baf0 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 -- 172.21.15.144:0/701888283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c06baf0 msgr2=0x7f500c06dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 --2- 172.21.15.144:0/701888283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c06baf0 0x7f500c06dae0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5004009d90 tx=0x7f500400b330 comp rx=0 tx=0).stop 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 -- 172.21.15.144:0/701888283 shutdown_connections 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 --2- 172.21.15.144:0/701888283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c06baf0 0x7f500c06dae0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.471 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 -- 172.21.15.144:0/701888283 >> 172.21.15.144:0/701888283 conn(0x7f500c09a230 msgr2=0x7f500c0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:45.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 -- 172.21.15.144:0/701888283 shutdown_connections 2023-05-11T07:37:45.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.467+0000 7f50113ff700 1 -- 172.21.15.144:0/701888283 wait complete. 2023-05-11T07:37:45.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.469+0000 7f50113ff700 1 Processor -- start 2023-05-11T07:37:45.472 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.470+0000 7f50113ff700 1 -- start start 2023-05-11T07:37:45.473 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c06baf0 0x7f500c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f500c0cfaa0 0x7f500c09d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15b490 con 0x7f500c15ca50 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1f6230 con 0x7f500c06baf0 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f50113ff700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c1f6510 con 0x7f500c0cfaa0 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f500b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f500b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47594/0 (socket says 172.21.15.144:47594) 2023-05-11T07:37:45.474 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f500b7fe700 1 -- 172.21.15.144:0/3623882377 learned_addr learned my addr 172.21.15.144:0/3623882377 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:45.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f500affd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c06baf0 0x7f500c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.475 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.471+0000 7f500a7fc700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f500c0cfaa0 0x7f500c09d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 -- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f500c0cfaa0 msgr2=0x7f500c09d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f500c0cfaa0 0x7f500c09d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 -- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c06baf0 msgr2=0x7f500c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c06baf0 0x7f500c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 -- 172.21.15.144:0/3623882377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004009a70 con 0x7f500c15ca50 2023-05-11T07:37:45.476 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f500b7fe700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f500400b730 tx=0x7f5004004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004012630 con 0x7f500c15ca50 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5004012790 con 0x7f500c15ca50 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004012b40 con 0x7f500c15ca50 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c06edd0 con 0x7f500c15ca50 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.472+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c06eaf0 con 0x7f500c15ca50 2023-05-11T07:37:45.477 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.473+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c06f9e0 con 0x7f500c15ca50 2023-05-11T07:37:45.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.474+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5004012ca0 con 0x7f500c15ca50 2023-05-11T07:37:45.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.475+0000 7f4ff37fe700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 0x7f4ff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.475+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f500408b7c0 con 0x7f500c15ca50 2023-05-11T07:37:45.478 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.475+0000 7f500affd700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 0x7f4ff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.479 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.476+0000 7f500affd700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 0x7f4ff806d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0010e0 tx=0x7f4ffc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.482 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.480+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5004056720 con 0x7f500c15ca50 2023-05-11T07:37:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.753+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f500c08b280 con 0x7f500c15ca50 2023-05-11T07:37:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.753+0000 7f4ff37fe700 1 -- 172.21.15.144:0/3623882377 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f5004059d40 con 0x7f500c15ca50 2023-05-11T07:37:45.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:37:45.756 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"fsid":"424d6242-b269-485d-aca8-83f4424787ea","modified":"2023-05-11T07:34:34.840320Z","created":"2023-05-11T07:34:34.840320Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3301","nonce":0},{"type":"v1","addr":"172.21.15.145:6790","nonce":0}]},"addr":"172.21.15.145:6790/0","public_addr":"172.21.15.145:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-11T07:37:45.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 msgr2=0x7f4ff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 0x7f4ff806d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0010e0 tx=0x7f4ffc009040 comp rx=0 tx=0).stop 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 msgr2=0x7f500c159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f500400b730 tx=0x7f5004004ad0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 shutdown_connections 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7f4ff806ace0 0x7f4ff806d190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f500c15ca50 0x7f500c159d90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c06baf0 0x7f500c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 --2- 172.21.15.144:0/3623882377 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7f500c0cfaa0 0x7f500c09d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 >> 172.21.15.144:0/3623882377 conn(0x7f500c09a230 msgr2=0x7f500c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:45.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 shutdown_connections 2023-05-11T07:37:45.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.756+0000 7f50113ff700 1 -- 172.21.15.144:0/3623882377 wait complete. 2023-05-11T07:37:45.760 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 1 2023-05-11T07:37:45.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-05-11T07:37:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.959+0000 7fbabf59e700 1 Processor -- start 2023-05-11T07:37:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.959+0000 7fbabf59e700 1 -- start start 2023-05-11T07:37:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.960+0000 7fbabf59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbac00cd2c0 0x7fbac00b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.960+0000 7fbabf59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac00d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.960+0000 7fbabf59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00cd790 con 0x7fbac015c960 2023-05-11T07:37:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.960+0000 7fbabf59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00cda30 con 0x7fbac00cd2c0 2023-05-11T07:37:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.960+0000 7fbabf59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00cdd10 con 0x7fbac00b5770 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabe59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbac015c960 0x7fbac00b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42434/0 (socket says 172.21.15.144:42434) 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabe59c700 1 -- 172.21.15.144:0/1462842781 learned_addr learned my addr 172.21.15.144:0/1462842781 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/1462842781 >> v2:172.21.15.144:3300/0 conn(0x7fbac00cd2c0 0x7fbac00b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabed9d700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac00d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 -- 172.21.15.144:0/1462842781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 msgr2=0x7fbac00d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T07:37:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac00d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 -- 172.21.15.144:0/1462842781 >> v1:172.21.15.144:6789/0 conn(0x7fbac015c960 legacy=0x7fbac00b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 -- 172.21.15.144:0/1462842781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00d1680 con 0x7fbac00cd2c0 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabd59a700 1 -- 172.21.15.144:0/1462842781 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056835587 0 0) 0x7fbac00cd790 con 0x7fbac015c960 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.961+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac00cd2c0 0x7fbac00b5230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009840 tx=0x7fbab4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3748fc23541fc8c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabd59a700 1 -- 172.21.15.144:0/1462842781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4011830 con 0x7fbac00cd2c0 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabd59a700 1 -- 172.21.15.144:0/1462842781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab4011990 con 0x7fbac00cd2c0 2023-05-11T07:37:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabd59a700 1 -- 172.21.15.144:0/1462842781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4011d20 con 0x7fbac00cd2c0 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 -- 172.21.15.144:0/1462842781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac00cd2c0 msgr2=0x7fbac00b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac00cd2c0 0x7fbac00b5230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009840 tx=0x7fbab4009b50 comp rx=0 tx=0).stop 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 -- 172.21.15.144:0/1462842781 shutdown_connections 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac00d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 --2- 172.21.15.144:0/1462842781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac00cd2c0 0x7fbac00b5230 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 -- 172.21.15.144:0/1462842781 >> 172.21.15.144:0/1462842781 conn(0x7fbac006abd0 msgr2=0x7fbac006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:45.967 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 -- 172.21.15.144:0/1462842781 shutdown_connections 2023-05-11T07:37:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.962+0000 7fbabf59e700 1 -- 172.21.15.144:0/1462842781 wait complete. 2023-05-11T07:37:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.964+0000 7fbabf59e700 1 Processor -- start 2023-05-11T07:37:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.964+0000 7fbabf59e700 1 -- start start 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 --2- >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac01f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 0x7fbac00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00c99d0 con 0x7fbac015c960 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01f2fc0 con 0x7fbac00c8230 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabf59e700 1 -- --> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00cc020 con 0x7fbac00b5770 2023-05-11T07:37:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabdd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabdd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47614/0 (socket says 172.21.15.144:47614) 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.965+0000 7fbabdd9b700 1 -- 172.21.15.144:0/123986110 learned_addr learned my addr 172.21.15.144:0/123986110 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabe59c700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac01f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabed9d700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 0x7fbac00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 -- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 msgr2=0x7fbac01f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac01f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 -- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 msgr2=0x7fbac00cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 0x7fbac00cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 -- 172.21.15.144:0/123986110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40094a0 con 0x7fbac015c960 2023-05-11T07:37:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabed9d700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 0x7fbac00cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T07:37:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabdd9b700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbab40090b0 tx=0x7fbab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40036a0 con 0x7fbac015c960 2023-05-11T07:37:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab401f070 con 0x7fbac015c960 2023-05-11T07:37:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4003a00 con 0x7fbac015c960 2023-05-11T07:37:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.966+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00b5ef0 con 0x7fbac015c960 2023-05-11T07:37:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.967+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac00d1960 con 0x7fbac015c960 2023-05-11T07:37:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.968+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac015cd30 con 0x7fbac015c960 2023-05-11T07:37:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.968+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbab4003b60 con 0x7fbac015c960 2023-05-11T07:37:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.969+0000 7fbaaeffd700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 0x7fbaa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T07:37:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.969+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbab4021070 con 0x7fbac015c960 2023-05-11T07:37:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.970+0000 7fbabe59c700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 0x7fbaa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T07:37:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.970+0000 7fbabe59c700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 0x7fbaa006d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbab0007fd0 tx=0x7fbab0007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T07:37:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:45.974+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbab4055f60 con 0x7fbac015c960 2023-05-11T07:37:46.244 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.242+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fbac00744c0 con 0x7fbac015c960 2023-05-11T07:37:46.245 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.242+0000 7fbaaeffd700 1 -- 172.21.15.144:0/123986110 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fbab4015050 con 0x7fbac015c960 2023-05-11T07:37:46.245 INFO:teuthology.orchestra.run.smithi144.stdout:[client.admin] 2023-05-11T07:37:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== 2023-05-11T07:37:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 msgr2=0x7fbaa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 0x7fbaa006d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbab0007fd0 tx=0x7fbab0007de0 comp rx=0 tx=0).stop 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 msgr2=0x7fbac00cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbab40090b0 tx=0x7fbab4004750 comp rx=0 tx=0).stop 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 shutdown_connections 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:6832/2010441590,v1:172.21.15.144:6833/2010441590] conn(0x7fbaa006ace0 0x7fbaa006d190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3301/0,v1:172.21.15.145:6790/0] conn(0x7fbac00b5770 0x7fbac01f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbac00c8230 0x7fbac00cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:46.248 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 --2- 172.21.15.144:0/123986110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac015c960 0x7fbac00cbae0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T07:37:46.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 >> 172.21.15.144:0/123986110 conn(0x7fbac006abd0 msgr2=0x7fbac00d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T07:37:46.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 shutdown_connections 2023-05-11T07:37:46.249 INFO:teuthology.orchestra.run.smithi144.stderr:2023-05-11T07:37:46.245+0000 7fbabf59e700 1 -- 172.21.15.144:0/123986110 wait complete. 2023-05-11T07:37:46.264 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:37:46.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/tmp/tmp.Kh63E6MZ0bxfstests-dev/local.config 2023-05-11T07:37:46.326 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.144:6789:/test export TEST_DIR=/tmp/tmp.UvWLtE3F76test export SCRATCH_DEV=172.21.15.144:6789:/scratch export SCRATCH_MNT=/tmp/tmp.YcD326Vnm7scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw==" 2023-05-11T07:37:46.327 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-05-11T07:37:46.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/tmp/tmp.Kh63E6MZ0bxfstests-dev/ceph.exclude 2023-05-11T07:37:46.428 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo make) 2023-05-11T07:37:46.549 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize -cfi 2023-05-11T07:37:47.051 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-11T07:37:47.051 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.guess' 2023-05-11T07:37:47.060 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './config.sub' 2023-05-11T07:37:47.069 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './install-sh' 2023-05-11T07:37:47.079 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file './ltmain.sh' 2023-05-11T07:37:47.133 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-11T07:37:47.133 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-11T07:37:47.144 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-11T07:37:47.155 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-11T07:37:47.166 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-11T07:37:47.178 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-11T07:37:47.193 INFO:teuthology.orchestra.run.smithi144.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-11T07:37:47.196 INFO:teuthology.orchestra.run.smithi144.stdout:cp include/install-sh . 2023-05-11T07:37:47.198 INFO:teuthology.orchestra.run.smithi144.stdout:aclocal -I m4 2023-05-11T07:37:48.431 INFO:teuthology.orchestra.run.smithi144.stdout:autoheader 2023-05-11T07:37:48.783 INFO:teuthology.orchestra.run.smithi144.stdout:autoconf 2023-05-11T07:37:48.984 INFO:teuthology.orchestra.run.smithi144.stdout:./configure \ 2023-05-11T07:37:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: --libexecdir=/usr/lib \ 2023-05-11T07:37:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: --exec_prefix=/var/lib 2023-05-11T07:37:49.575 INFO:teuthology.orchestra.run.smithi144.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-11T07:37:49.576 INFO:teuthology.orchestra.run.smithi144.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-11T07:37:49.579 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to print strings... printf 2023-05-11T07:37:49.579 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... gcc 2023-05-11T07:37:49.739 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the C compiler works... yes 2023-05-11T07:37:49.739 INFO:teuthology.orchestra.run.smithi144.stdout:checking for C compiler default output file name... a.out 2023-05-11T07:37:49.787 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of executables... 2023-05-11T07:37:49.856 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are cross compiling... no 2023-05-11T07:37:49.891 INFO:teuthology.orchestra.run.smithi144.stdout:checking for suffix of object files... o 2023-05-11T07:37:49.923 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... yes 2023-05-11T07:37:49.955 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... yes 2023-05-11T07:37:50.001 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-11T07:37:50.007 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a sed that does not truncate output... /bin/sed 2023-05-11T07:37:50.012 INFO:teuthology.orchestra.run.smithi144.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-05-11T07:37:50.014 INFO:teuthology.orchestra.run.smithi144.stdout:checking for egrep... /bin/grep -E 2023-05-11T07:37:50.017 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fgrep... /bin/grep -F 2023-05-11T07:37:50.024 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ld used by gcc... /bin/ld 2023-05-11T07:37:50.028 INFO:teuthology.orchestra.run.smithi144.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-05-11T07:37:50.041 INFO:teuthology.orchestra.run.smithi144.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-05-11T07:37:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-05-11T07:37:50.077 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-05-11T07:37:50.098 INFO:teuthology.orchestra.run.smithi144.stdout:checking the maximum length of command line arguments... 1572864 2023-05-11T07:37:50.103 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-11T07:37:50.103 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-11T07:37:50.104 INFO:teuthology.orchestra.run.smithi144.stdout:checking for /bin/ld option to reload object files... -r 2023-05-11T07:37:50.104 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdump... objdump 2023-05-11T07:37:50.105 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to recognize dependent libraries... pass_all 2023-05-11T07:37:50.105 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlltool... no 2023-05-11T07:37:50.105 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-11T07:37:50.105 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ar... ar 2023-05-11T07:37:50.156 INFO:teuthology.orchestra.run.smithi144.stdout:checking for archiver @FILE support... @ 2023-05-11T07:37:50.157 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strip... strip 2023-05-11T07:37:50.157 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ranlib... ranlib 2023-05-11T07:37:50.157 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gawk... gawk 2023-05-11T07:37:50.259 INFO:teuthology.orchestra.run.smithi144.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-05-11T07:37:50.262 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sysroot... no 2023-05-11T07:37:50.269 INFO:teuthology.orchestra.run.smithi144.stdout:checking for a working dd... /bin/dd 2023-05-11T07:37:50.275 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-05-11T07:37:50.303 INFO:teuthology.orchestra.run.smithi144.stdout:checking for mt... no 2023-05-11T07:37:50.309 INFO:teuthology.orchestra.run.smithi144.stdout:checking if : is a manifest tool... no 2023-05-11T07:37:50.366 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to run the C preprocessor... gcc -E 2023-05-11T07:37:50.613 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ANSI C header files... yes 2023-05-11T07:37:50.653 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/types.h... yes 2023-05-11T07:37:50.706 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/stat.h... yes 2023-05-11T07:37:50.755 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdlib.h... yes 2023-05-11T07:37:50.805 INFO:teuthology.orchestra.run.smithi144.stdout:checking for string.h... yes 2023-05-11T07:37:50.856 INFO:teuthology.orchestra.run.smithi144.stdout:checking for memory.h... yes 2023-05-11T07:37:50.905 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strings.h... yes 2023-05-11T07:37:50.958 INFO:teuthology.orchestra.run.smithi144.stdout:checking for inttypes.h... yes 2023-05-11T07:37:51.008 INFO:teuthology.orchestra.run.smithi144.stdout:checking for stdint.h... yes 2023-05-11T07:37:51.062 INFO:teuthology.orchestra.run.smithi144.stdout:checking for unistd.h... yes 2023-05-11T07:37:51.120 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dlfcn.h... yes 2023-05-11T07:37:51.128 INFO:teuthology.orchestra.run.smithi144.stdout:checking for objdir... .libs 2023-05-11T07:37:51.254 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-11T07:37:51.254 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-11T07:37:51.289 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-11T07:37:51.327 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc static flag -static works... no 2023-05-11T07:37:51.374 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... yes 2023-05-11T07:37:51.375 INFO:teuthology.orchestra.run.smithi144.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-11T07:37:51.388 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-11T07:37:51.435 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether -lc should be explicitly linked in... no 2023-05-11T07:37:51.524 INFO:teuthology.orchestra.run.smithi144.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-11T07:37:51.525 INFO:teuthology.orchestra.run.smithi144.stdout:checking how to hardcode library paths into programs... immediate 2023-05-11T07:37:51.536 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether stripping libraries is possible... yes 2023-05-11T07:37:51.537 INFO:teuthology.orchestra.run.smithi144.stdout:checking if libtool supports shared libraries... yes 2023-05-11T07:37:51.537 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build shared libraries... yes 2023-05-11T07:37:51.537 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether to build static libraries... yes 2023-05-11T07:37:51.547 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc... (cached) gcc 2023-05-11T07:37:51.582 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-11T07:37:51.582 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-11T07:37:51.582 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-11T07:37:51.582 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gmake... /usr/bin/gmake 2023-05-11T07:37:51.583 INFO:teuthology.orchestra.run.smithi144.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-05-11T07:37:51.583 INFO:teuthology.orchestra.run.smithi144.stdout:checking for tar... /bin/tar 2023-05-11T07:37:51.583 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gzip... /bin/gzip 2023-05-11T07:37:51.598 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether gcc -MM is supported... yes 2023-05-11T07:37:51.598 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sort... /bin/sort 2023-05-11T07:37:51.599 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether ln -s works... yes 2023-05-11T07:37:51.599 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpm... /bin/rpm 2023-05-11T07:37:51.606 INFO:teuthology.orchestra.run.smithi144.stdout:checking for rpmbuild... no 2023-05-11T07:37:51.672 INFO:teuthology.orchestra.run.smithi144.stdout:checking assert.h usability... yes 2023-05-11T07:37:51.687 INFO:teuthology.orchestra.run.smithi144.stdout:checking assert.h presence... yes 2023-05-11T07:37:51.687 INFO:teuthology.orchestra.run.smithi144.stdout:checking for assert.h... yes 2023-05-11T07:37:51.741 INFO:teuthology.orchestra.run.smithi144.stdout:checking bstring.h usability... no 2023-05-11T07:37:51.763 INFO:teuthology.orchestra.run.smithi144.stdout:checking bstring.h presence... no 2023-05-11T07:37:51.763 INFO:teuthology.orchestra.run.smithi144.stdout:checking for bstring.h... no 2023-05-11T07:37:51.810 INFO:teuthology.orchestra.run.smithi144.stdout:checking libgen.h usability... yes 2023-05-11T07:37:51.825 INFO:teuthology.orchestra.run.smithi144.stdout:checking libgen.h presence... yes 2023-05-11T07:37:51.825 INFO:teuthology.orchestra.run.smithi144.stdout:checking for libgen.h... yes 2023-05-11T07:37:51.880 INFO:teuthology.orchestra.run.smithi144.stdout:checking dirent.h usability... yes 2023-05-11T07:37:51.896 INFO:teuthology.orchestra.run.smithi144.stdout:checking dirent.h presence... yes 2023-05-11T07:37:51.896 INFO:teuthology.orchestra.run.smithi144.stdout:checking for dirent.h... yes 2023-05-11T07:37:51.969 INFO:teuthology.orchestra.run.smithi144.stdout:checking errno.h usability... yes 2023-05-11T07:37:51.984 INFO:teuthology.orchestra.run.smithi144.stdout:checking errno.h presence... yes 2023-05-11T07:37:51.984 INFO:teuthology.orchestra.run.smithi144.stdout:checking for errno.h... yes 2023-05-11T07:37:52.043 INFO:teuthology.orchestra.run.smithi144.stdout:checking malloc.h usability... yes 2023-05-11T07:37:52.060 INFO:teuthology.orchestra.run.smithi144.stdout:checking malloc.h presence... yes 2023-05-11T07:37:52.060 INFO:teuthology.orchestra.run.smithi144.stdout:checking for malloc.h... yes 2023-05-11T07:37:52.112 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h usability... no 2023-05-11T07:37:52.134 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid.h presence... no 2023-05-11T07:37:52.134 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid.h... no 2023-05-11T07:37:52.190 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h usability... yes 2023-05-11T07:37:52.208 INFO:teuthology.orchestra.run.smithi144.stdout:checking uuid/uuid.h presence... yes 2023-05-11T07:37:52.208 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid/uuid.h... yes 2023-05-11T07:37:52.260 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h usability... no 2023-05-11T07:37:52.282 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/uuid.h presence... no 2023-05-11T07:37:52.283 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/uuid.h... no 2023-05-11T07:37:52.331 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/file.h usability... yes 2023-05-11T07:37:52.347 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/file.h presence... yes 2023-05-11T07:37:52.347 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/file.h... yes 2023-05-11T07:37:52.401 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fcntl.h usability... yes 2023-05-11T07:37:52.417 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fcntl.h presence... yes 2023-05-11T07:37:52.417 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fcntl.h... yes 2023-05-11T07:37:52.469 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/syssgi.h usability... no 2023-05-11T07:37:52.491 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/syssgi.h presence... no 2023-05-11T07:37:52.491 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/syssgi.h... no 2023-05-11T07:37:52.563 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/param.h usability... yes 2023-05-11T07:37:52.583 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/param.h presence... yes 2023-05-11T07:37:52.583 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/param.h... yes 2023-05-11T07:37:52.596 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/stat.h... (cached) yes 2023-05-11T07:37:52.654 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/statvfs.h usability... yes 2023-05-11T07:37:52.669 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/statvfs.h presence... yes 2023-05-11T07:37:52.669 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/statvfs.h... yes 2023-05-11T07:37:52.722 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/time.h usability... yes 2023-05-11T07:37:52.738 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/time.h presence... yes 2023-05-11T07:37:52.738 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/time.h... yes 2023-05-11T07:37:52.812 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/ioctl.h usability... yes 2023-05-11T07:37:52.828 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/ioctl.h presence... yes 2023-05-11T07:37:52.828 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/ioctl.h... yes 2023-05-11T07:37:52.885 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/wait.h usability... yes 2023-05-11T07:37:52.903 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/wait.h presence... yes 2023-05-11T07:37:52.903 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/wait.h... yes 2023-05-11T07:37:52.915 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/types.h... (cached) yes 2023-05-11T07:37:52.928 INFO:teuthology.orchestra.run.smithi144.stdout:checking for strings.h... (cached) yes 2023-05-11T07:37:52.984 INFO:teuthology.orchestra.run.smithi144.stdout:checking err.h usability... yes 2023-05-11T07:37:52.999 INFO:teuthology.orchestra.run.smithi144.stdout:checking err.h presence... yes 2023-05-11T07:37:52.999 INFO:teuthology.orchestra.run.smithi144.stdout:checking for err.h... yes 2023-05-11T07:37:53.052 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/falloc.h usability... yes 2023-05-11T07:37:53.067 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/falloc.h presence... yes 2023-05-11T07:37:53.067 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/falloc.h... yes 2023-05-11T07:37:53.119 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-11T07:37:53.141 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-11T07:37:53.141 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-11T07:37:53.186 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-11T07:37:53.208 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-11T07:37:53.209 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-11T07:37:53.254 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/platform_defs.h usability... no 2023-05-11T07:37:53.276 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/platform_defs.h presence... no 2023-05-11T07:37:53.276 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/platform_defs.h... no 2023-05-11T07:37:53.322 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfs/ioctl.h usability... no 2023-05-11T07:37:53.344 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfs/ioctl.h presence... no 2023-05-11T07:37:53.344 INFO:teuthology.orchestra.run.smithi144.stdout:checking for btrfs/ioctl.h... no 2023-05-11T07:37:53.389 INFO:teuthology.orchestra.run.smithi144.stdout:checking cifs/ioctl.h usability... no 2023-05-11T07:37:53.411 INFO:teuthology.orchestra.run.smithi144.stdout:checking cifs/ioctl.h presence... no 2023-05-11T07:37:53.411 INFO:teuthology.orchestra.run.smithi144.stdout:checking for cifs/ioctl.h... no 2023-05-11T07:37:53.459 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/mman.h usability... yes 2023-05-11T07:37:53.475 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/mman.h presence... yes 2023-05-11T07:37:53.475 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/mman.h... yes 2023-05-11T07:37:53.509 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xfs_log_format.h... no 2023-05-11T07:37:53.572 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare... no 2023-05-11T07:37:53.626 INFO:teuthology.orchestra.run.smithi144.stdout:checking for uuid_compare in -luuid... yes 2023-05-11T07:37:53.704 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xfs.h... yes 2023-05-11T07:37:53.733 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/libxfs.h... no 2023-05-11T07:37:53.768 INFO:teuthology.orchestra.run.smithi144.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-11T07:37:53.819 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/xqm.h... yes 2023-05-11T07:37:53.896 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-11T07:37:53.939 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/handle.h usability... yes 2023-05-11T07:37:53.953 INFO:teuthology.orchestra.run.smithi144.stdout:checking xfs/handle.h presence... yes 2023-05-11T07:37:53.953 INFO:teuthology.orchestra.run.smithi144.stdout:checking for xfs/handle.h... yes 2023-05-11T07:37:54.022 INFO:teuthology.orchestra.run.smithi144.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-11T07:37:54.071 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/acl.h usability... yes 2023-05-11T07:37:54.088 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/acl.h presence... yes 2023-05-11T07:37:54.088 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/acl.h... yes 2023-05-11T07:37:54.146 INFO:teuthology.orchestra.run.smithi144.stdout:checking acl/libacl.h usability... yes 2023-05-11T07:37:54.163 INFO:teuthology.orchestra.run.smithi144.stdout:checking acl/libacl.h presence... yes 2023-05-11T07:37:54.163 INFO:teuthology.orchestra.run.smithi144.stdout:checking for acl/libacl.h... yes 2023-05-11T07:37:54.228 INFO:teuthology.orchestra.run.smithi144.stdout:checking for acl_init in -lacl... yes 2023-05-11T07:37:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm-ndbm.h usability... no 2023-05-11T07:37:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm-ndbm.h presence... no 2023-05-11T07:37:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gdbm-ndbm.h... no 2023-05-11T07:37:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm/ndbm.h usability... no 2023-05-11T07:37:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:checking gdbm/ndbm.h presence... no 2023-05-11T07:37:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:checking for gdbm/ndbm.h... no 2023-05-11T07:37:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:checking ndbm.h usability... no 2023-05-11T07:37:54.420 INFO:teuthology.orchestra.run.smithi144.stdout:checking ndbm.h presence... no 2023-05-11T07:37:54.421 INFO:teuthology.orchestra.run.smithi144.stdout:checking for ndbm.h... no 2023-05-11T07:37:54.465 INFO:teuthology.orchestra.run.smithi144.stdout:checking libaio.h usability... yes 2023-05-11T07:37:54.486 INFO:teuthology.orchestra.run.smithi144.stdout:checking libaio.h presence... yes 2023-05-11T07:37:54.486 INFO:teuthology.orchestra.run.smithi144.stdout:checking for libaio.h... yes 2023-05-11T07:37:54.528 INFO:teuthology.orchestra.run.smithi144.stdout:checking liburing.h usability... no 2023-05-11T07:37:54.550 INFO:teuthology.orchestra.run.smithi144.stdout:checking liburing.h presence... no 2023-05-11T07:37:54.551 INFO:teuthology.orchestra.run.smithi144.stdout:checking for liburing.h... no 2023-05-11T07:37:54.591 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/capability.h usability... no 2023-05-11T07:37:54.613 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/capability.h presence... no 2023-05-11T07:37:54.613 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/capability.h... no 2023-05-11T07:37:54.655 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fiemap.h usability... yes 2023-05-11T07:37:54.670 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fiemap.h presence... yes 2023-05-11T07:37:54.670 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/fiemap.h... yes 2023-05-11T07:37:54.728 INFO:teuthology.orchestra.run.smithi144.stdout:checking for fallocate... yes 2023-05-11T07:37:54.785 INFO:teuthology.orchestra.run.smithi144.stdout:checking for open_by_handle_at... yes 2023-05-11T07:37:54.830 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/prctl.h usability... yes 2023-05-11T07:37:54.846 INFO:teuthology.orchestra.run.smithi144.stdout:checking sys/prctl.h presence... yes 2023-05-11T07:37:54.846 INFO:teuthology.orchestra.run.smithi144.stdout:checking for sys/prctl.h... yes 2023-05-11T07:37:54.890 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fs.h usability... yes 2023-05-11T07:37:54.906 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/fs.h presence... yes 2023-05-11T07:37:54.906 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/fs.h... yes 2023-05-11T07:37:54.946 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfsutil.h usability... no 2023-05-11T07:37:54.967 INFO:teuthology.orchestra.run.smithi144.stdout:checking btrfsutil.h presence... no 2023-05-11T07:37:54.968 INFO:teuthology.orchestra.run.smithi144.stdout:checking for btrfsutil.h... no 2023-05-11T07:37:55.028 INFO:teuthology.orchestra.run.smithi144.stdout:checking for copy_file_range... yes 2023-05-11T07:37:55.089 INFO:teuthology.orchestra.run.smithi144.stdout:checking for SEEK_DATA... yes 2023-05-11T07:37:55.165 INFO:teuthology.orchestra.run.smithi144.stdout:checking for BMV_OF_SHARED... yes 2023-05-11T07:37:55.227 INFO:teuthology.orchestra.run.smithi144.stdout:checking for nftw... yes 2023-05-11T07:37:55.290 INFO:teuthology.orchestra.run.smithi144.stdout:checking for RLIMIT_NOFILE... yes 2023-05-11T07:37:55.325 INFO:teuthology.orchestra.run.smithi144.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-11T07:37:55.383 INFO:teuthology.orchestra.run.smithi144.stdout:checking for renameat2... yes 2023-05-11T07:37:55.441 INFO:teuthology.orchestra.run.smithi144.stdout:checking for reallocarray... yes 2023-05-11T07:37:55.471 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct mount_attr... no 2023-05-11T07:37:55.540 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-11T07:37:55.609 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-11T07:37:55.677 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-11T07:37:55.746 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-11T07:37:55.815 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-11T07:37:55.884 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-11T07:37:55.952 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-11T07:37:56.003 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs.h usability... yes 2023-05-11T07:37:56.018 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs.h presence... yes 2023-05-11T07:37:56.019 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/btrfs.h... yes 2023-05-11T07:37:56.075 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-11T07:37:56.091 INFO:teuthology.orchestra.run.smithi144.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-11T07:37:56.091 INFO:teuthology.orchestra.run.smithi144.stdout:checking for linux/btrfs_tree.h... yes 2023-05-11T07:37:56.158 INFO:teuthology.orchestra.run.smithi144.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-11T07:37:56.185 INFO:teuthology.orchestra.run.smithi144.stdout:configure: creating ./config.status 2023-05-11T07:37:56.989 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/builddefs 2023-05-11T07:37:57.016 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: creating include/config.h 2023-05-11T07:37:57.036 INFO:teuthology.orchestra.run.smithi144.stdout:config.status: executing libtool commands 2023-05-11T07:37:57.109 INFO:teuthology.orchestra.run.smithi144.stdout:Building include 2023-05-11T07:37:57.115 INFO:teuthology.orchestra.run.smithi144.stdout:Building lib 2023-05-11T07:37:57.121 INFO:teuthology.orchestra.run.smithi144.stdout: [LTDEP] 2023-05-11T07:37:57.316 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dataascii.lo 2023-05-11T07:37:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] databin.lo 2023-05-11T07:37:57.728 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] datapid.lo 2023-05-11T07:37:57.907 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] file_lock.lo 2023-05-11T07:37:58.134 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] forker.lo 2023-05-11T07:37:58.344 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pattern.lo 2023-05-11T07:37:58.535 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] open_flags.lo 2023-05-11T07:37:58.751 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] random_range.lo 2023-05-11T07:37:59.047 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] string_to_tokens.lo 2023-05-11T07:37:59.221 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] str_to_bytes.lo 2023-05-11T07:37:59.425 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] tlibio.lo 2023-05-11T07:37:59.732 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] write_log.lo 2023-05-11T07:38:00.049 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] random.lo 2023-05-11T07:38:00.233 INFO:teuthology.orchestra.run.smithi144.stdout: [LD] 2023-05-11T07:38:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:Building ltp 2023-05-11T07:38:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:00.591 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] doio 2023-05-11T07:38:01.315 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsstress 2023-05-11T07:38:02.674 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsx 2023-05-11T07:38:03.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:38:03.135 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:38:03.599 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] growfiles 2023-05-11T07:38:04.185 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] iogen 2023-05-11T07:38:04.621 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-stress 2023-05-11T07:38:05.116 INFO:teuthology.orchestra.run.smithi144.stdout:Building src 2023-05-11T07:38:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:07.543 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: [DEP] 2023-05-11T07:38:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirstress 2023-05-11T07:38:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fill 2023-05-11T07:38:08.539 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fill2 2023-05-11T07:38:08.853 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] getpagesize 2023-05-11T07:38:09.071 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] holes 2023-05-11T07:38:09.351 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] lstat64 2023-05-11T07:38:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] nametest 2023-05-11T07:38:09.942 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] permname 2023-05-11T07:38:10.227 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] randholes 2023-05-11T07:38:10.561 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] runas 2023-05-11T07:38:10.824 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] truncfile 2023-05-11T07:38:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] usemem 2023-05-11T07:38:11.325 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmapcat 2023-05-11T07:38:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] append_reader 2023-05-11T07:38:11.795 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] append_writer 2023-05-11T07:38:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirperf 2023-05-11T07:38:12.540 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] metaperf 2023-05-11T07:38:12.875 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] devzero 2023-05-11T07:38:13.137 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] feature 2023-05-11T07:38:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] alloc 2023-05-11T07:38:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fault 2023-05-11T07:38:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fstest 2023-05-11T07:38:14.311 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_access_root 2023-05-11T07:38:14.550 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] godown 2023-05-11T07:38:14.807 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] resvtest 2023-05-11T07:38:15.079 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] writemod 2023-05-11T07:38:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] writev_on_pagefault 2023-05-11T07:38:15.552 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] makeextents 2023-05-11T07:38:15.820 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] itrash 2023-05-11T07:38:16.059 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] rename 2023-05-11T07:38:16.280 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] multi_open_unlink 2023-05-11T07:38:16.528 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] unwritten_sync 2023-05-11T07:38:16.795 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] genhashnames 2023-05-11T07:38:17.065 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_holes 2023-05-11T07:38:17.296 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_writev 2023-05-11T07:38:17.528 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_truncate_cmtime 2023-05-11T07:38:17.771 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dirhash_collide 2023-05-11T07:38:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_rename_overwrite 2023-05-11T07:38:18.260 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] holetest 2023-05-11T07:38:18.561 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_truncate_self 2023-05-11T07:38:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] af_unix 2023-05-11T07:38:19.020 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_stale_pmd 2023-05-11T07:38:19.258 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_cow_race 2023-05-11T07:38:19.508 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_fallocate 2023-05-11T07:38:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsync-err 2023-05-11T07:38:20.013 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_write_ro 2023-05-11T07:38:20.248 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-11T07:38:20.493 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-11T07:38:20.733 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_ofd_locks 2023-05-11T07:38:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_collision 2023-05-11T07:38:21.304 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmap-write-concurrent 2023-05-11T07:38:21.557 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_get_file_time 2023-05-11T07:38:21.790 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_create_short_dirs 2023-05-11T07:38:22.045 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_create_long_dirs 2023-05-11T07:38:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_enospc 2023-05-11T07:38:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_writev_overlap 2023-05-11T07:38:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] checkpoint_journal 2023-05-11T07:38:23.061 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mmap-rw-fault 2023-05-11T07:38:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] allocstale 2023-05-11T07:38:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_cow_memory_failure 2023-05-11T07:38:23.835 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fake-dump-rootino 2023-05-11T07:38:24.069 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-buf-fault 2023-05-11T07:38:24.308 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfsctl 2023-05-11T07:38:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bstat 2023-05-11T07:38:24.870 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mtab 2023-05-11T07:38:25.139 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] getdevicesize 2023-05-11T07:38:25.364 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] preallo_rw_pattern_reader 2023-05-11T07:38:25.610 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] preallo_rw_pattern_writer 2023-05-11T07:38:25.860 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] ftrunc 2023-05-11T07:38:26.092 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] trunc 2023-05-11T07:38:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fs_perms 2023-05-11T07:38:26.588 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] testx 2023-05-11T07:38:26.802 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] looptest 2023-05-11T07:38:27.077 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] locktest 2023-05-11T07:38:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] unwritten_mmap 2023-05-11T07:38:27.712 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_unlink_test 2023-05-11T07:38:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] deduperace 2023-05-11T07:38:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_unlink_test_modified 2023-05-11T07:38:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_offset 2023-05-11T07:38:28.799 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_futimens 2023-05-11T07:38:29.025 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_immutable 2023-05-11T07:38:29.698 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] stale_handle 2023-05-11T07:38:29.956 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] pwrite_mmap_blocked 2023-05-11T07:38:30.196 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_offset2 2023-05-11T07:38:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] seek_sanity_test 2023-05-11T07:38:30.967 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] seek_copy_test 2023-05-11T07:38:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_1 2023-05-11T07:38:31.462 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_2 2023-05-11T07:38:31.698 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fsync-tester 2023-05-11T07:38:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] nsexec 2023-05-11T07:38:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] cloner 2023-05-11T07:38:32.553 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] renameat2 2023-05-11T07:38:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_getcwd 2023-05-11T07:38:33.050 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] e4compact 2023-05-11T07:38:33.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:38:33.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:38:33.338 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] test-nextquota 2023-05-11T07:38:33.594 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] punch-alternating 2023-05-11T07:38:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-11T07:38:34.109 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] listxattr 2023-05-11T07:38:34.341 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-interleaved 2023-05-11T07:38:34.585 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_dir_type 2023-05-11T07:38:34.826 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] dio-invalidate-cache 2023-05-11T07:38:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] stat_test 2023-05-11T07:38:35.492 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_encrypted_d_revalidate 2023-05-11T07:38:35.744 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] attr_replace_test 2023-05-11T07:38:35.995 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] swapon 2023-05-11T07:38:36.245 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mkswap 2023-05-11T07:38:36.481 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_attr_corruption 2023-05-11T07:38:36.717 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_open_tmpfiles 2023-05-11T07:38:36.983 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fscrypt-crypt-util 2023-05-11T07:38:37.684 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] bulkstat_null_ocount 2023-05-11T07:38:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] splice-test 2023-05-11T07:38:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] chprojid_fail 2023-05-11T07:38:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] detached_mounts_propagation 2023-05-11T07:38:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] ext4_resize 2023-05-11T07:38:38.957 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_readdir_3 2023-05-11T07:38:39.236 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] splice2pipe 2023-05-11T07:38:39.483 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] uuid_ioctl 2023-05-11T07:38:39.724 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fiemap-tester 2023-05-11T07:38:40.083 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_stripealign 2023-05-11T07:38:40.320 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] open_by_handle 2023-05-11T07:38:40.654 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] t_mmap_dio 2023-05-11T07:38:40.902 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] xfsfind 2023-05-11T07:38:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] fssum 2023-05-11T07:38:41.691 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-05-11T07:38:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] replay-log 2023-05-11T07:38:42.100 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-05-11T07:38:42.106 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-05-11T07:38:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-11T07:38:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-fcntl-race 2023-05-11T07:38:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-subblock-eof-read 2023-05-11T07:38:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-append-write-read-race 2023-05-11T07:38:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-invalidate-readahead 2023-05-11T07:38:43.385 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-hole-filling-race 2023-05-11T07:38:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-11T07:38:43.847 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-last-ref-held-by-io 2023-05-11T07:38:44.108 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-cycle-write 2023-05-11T07:38:44.379 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-extend-stat 2023-05-11T07:38:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-11T07:38:44.855 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-invalidate-failure 2023-05-11T07:38:45.103 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aiodio_sparse2 2023-05-11T07:38:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aiocp 2023-05-11T07:38:45.715 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-cow-race 2023-05-11T07:38:45.963 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-write-verify 2023-05-11T07:38:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] aio-dio-eof-race 2023-05-11T07:38:46.517 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-05-11T07:38:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] vfstest 2023-05-11T07:38:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: [CC] mount-idmapped 2023-05-11T07:38:48.959 INFO:teuthology.orchestra.run.smithi144.stdout:Building m4 2023-05-11T07:38:48.966 INFO:teuthology.orchestra.run.smithi144.stdout:Building common 2023-05-11T07:38:48.973 INFO:teuthology.orchestra.run.smithi144.stdout:Building tests 2023-05-11T07:38:48.982 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-05-11T07:38:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/perf/group.list 2023-05-11T07:38:49.018 INFO:teuthology.orchestra.run.smithi144.stdout:Building ext4 2023-05-11T07:38:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ext4/group.list 2023-05-11T07:38:49.113 INFO:teuthology.orchestra.run.smithi144.stdout:Building ocfs2 2023-05-11T07:38:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ocfs2/group.list 2023-05-11T07:38:49.153 INFO:teuthology.orchestra.run.smithi144.stdout:Building overlay 2023-05-11T07:38:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/overlay/group.list 2023-05-11T07:38:49.250 INFO:teuthology.orchestra.run.smithi144.stdout:Building cifs 2023-05-11T07:38:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/cifs/group.list 2023-05-11T07:38:49.288 INFO:teuthology.orchestra.run.smithi144.stdout:Building generic 2023-05-11T07:38:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/generic/group.list 2023-05-11T07:38:49.523 INFO:teuthology.orchestra.run.smithi144.stdout:Building shared 2023-05-11T07:38:49.532 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/shared/group.list 2023-05-11T07:38:49.571 INFO:teuthology.orchestra.run.smithi144.stdout:Building nfs 2023-05-11T07:38:49.580 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/nfs/group.list 2023-05-11T07:38:49.613 INFO:teuthology.orchestra.run.smithi144.stdout:Building f2fs 2023-05-11T07:38:49.622 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/f2fs/group.list 2023-05-11T07:38:49.661 INFO:teuthology.orchestra.run.smithi144.stdout:Building udf 2023-05-11T07:38:49.671 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/udf/group.list 2023-05-11T07:38:49.698 INFO:teuthology.orchestra.run.smithi144.stdout:Building ceph 2023-05-11T07:38:49.707 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ceph/group.list 2023-05-11T07:38:49.740 INFO:teuthology.orchestra.run.smithi144.stdout:Building xfs 2023-05-11T07:38:49.751 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/xfs/group.list 2023-05-11T07:38:49.980 INFO:teuthology.orchestra.run.smithi144.stdout:Building btrfs 2023-05-11T07:38:49.990 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/btrfs/group.list 2023-05-11T07:38:50.122 INFO:teuthology.orchestra.run.smithi144.stdout:Building tmpfs 2023-05-11T07:38:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/tmpfs/group.list 2023-05-11T07:38:50.161 INFO:teuthology.orchestra.run.smithi144.stdout:Building selftest 2023-05-11T07:38:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/selftest/group.list 2023-05-11T07:38:50.201 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo make install) 2023-05-11T07:38:50.286 INFO:teuthology.orchestra.run.smithi144.stdout:Building include 2023-05-11T07:38:50.292 INFO:teuthology.orchestra.run.smithi144.stdout:Building lib 2023-05-11T07:38:50.299 INFO:teuthology.orchestra.run.smithi144.stdout:Building ltp 2023-05-11T07:38:50.307 INFO:teuthology.orchestra.run.smithi144.stdout:Building src 2023-05-11T07:38:50.364 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-05-11T07:38:50.371 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-05-11T07:38:50.378 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-05-11T07:38:50.385 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-05-11T07:38:50.392 INFO:teuthology.orchestra.run.smithi144.stdout:Building m4 2023-05-11T07:38:50.399 INFO:teuthology.orchestra.run.smithi144.stdout:Building common 2023-05-11T07:38:50.406 INFO:teuthology.orchestra.run.smithi144.stdout:Building tests 2023-05-11T07:38:50.415 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-05-11T07:38:50.424 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/perf/group.list 2023-05-11T07:38:50.451 INFO:teuthology.orchestra.run.smithi144.stdout:Building ext4 2023-05-11T07:38:50.460 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ext4/group.list 2023-05-11T07:38:50.545 INFO:teuthology.orchestra.run.smithi144.stdout:Building ocfs2 2023-05-11T07:38:50.554 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ocfs2/group.list 2023-05-11T07:38:50.585 INFO:teuthology.orchestra.run.smithi144.stdout:Building overlay 2023-05-11T07:38:50.594 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/overlay/group.list 2023-05-11T07:38:50.681 INFO:teuthology.orchestra.run.smithi144.stdout:Building cifs 2023-05-11T07:38:50.690 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/cifs/group.list 2023-05-11T07:38:50.718 INFO:teuthology.orchestra.run.smithi144.stdout:Building generic 2023-05-11T07:38:50.730 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/generic/group.list 2023-05-11T07:38:50.949 INFO:teuthology.orchestra.run.smithi144.stdout:Building shared 2023-05-11T07:38:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/shared/group.list 2023-05-11T07:38:50.997 INFO:teuthology.orchestra.run.smithi144.stdout:Building nfs 2023-05-11T07:38:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/nfs/group.list 2023-05-11T07:38:51.040 INFO:teuthology.orchestra.run.smithi144.stdout:Building f2fs 2023-05-11T07:38:51.049 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/f2fs/group.list 2023-05-11T07:38:51.088 INFO:teuthology.orchestra.run.smithi144.stdout:Building udf 2023-05-11T07:38:51.097 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/udf/group.list 2023-05-11T07:38:51.124 INFO:teuthology.orchestra.run.smithi144.stdout:Building ceph 2023-05-11T07:38:51.133 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ceph/group.list 2023-05-11T07:38:51.166 INFO:teuthology.orchestra.run.smithi144.stdout:Building xfs 2023-05-11T07:38:51.177 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/xfs/group.list 2023-05-11T07:38:51.398 INFO:teuthology.orchestra.run.smithi144.stdout:Building btrfs 2023-05-11T07:38:51.408 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/btrfs/group.list 2023-05-11T07:38:51.536 INFO:teuthology.orchestra.run.smithi144.stdout:Building tmpfs 2023-05-11T07:38:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/tmpfs/group.list 2023-05-11T07:38:51.576 INFO:teuthology.orchestra.run.smithi144.stdout:Building selftest 2023-05-11T07:38:51.585 INFO:teuthology.orchestra.run.smithi144.stdout: [GROUP] /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/selftest/group.list 2023-05-11T07:38:51.613 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-11T07:38:51.615 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T07:38:51.615 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-11T07:38:51.618 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T07:38:51.619 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-11T07:38:51.622 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-11T07:38:51.643 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-11T07:38:51.804 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-11T07:38:51.826 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-11T07:38:51.855 INFO:teuthology.orchestra.run.smithi144.stdout:Building log-writes 2023-05-11T07:38:51.862 INFO:teuthology.orchestra.run.smithi144.stdout:Building perf 2023-05-11T07:38:51.868 INFO:teuthology.orchestra.run.smithi144.stdout:Building aio-dio-regress 2023-05-11T07:38:51.876 INFO:teuthology.orchestra.run.smithi144.stdout:Building vfs 2023-05-11T07:38:51.881 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C log-writes install 2023-05-11T07:38:51.883 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-11T07:38:51.904 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-11T07:38:51.926 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C perf install 2023-05-11T07:38:51.929 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-11T07:38:51.950 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-11T07:38:52.004 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-11T07:38:52.006 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-11T07:38:52.028 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-11T07:38:52.155 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake -C vfs install 2023-05-11T07:38:52.158 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-11T07:38:52.180 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-11T07:38:52.208 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-11T07:38:52.229 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-11T07:38:54.951 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-11T07:38:55.151 INFO:teuthology.orchestra.run.smithi144.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-11T07:38:55.203 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-11T07:38:55.205 INFO:teuthology.orchestra.run.smithi144.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T07:38:55.206 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-11T07:38:55.208 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-11T07:38:55.229 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-11T07:38:55.547 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-11T07:38:55.550 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/btrfs/ install 2023-05-11T07:38:55.553 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-11T07:38:55.574 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-11T07:38:57.485 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-11T07:38:57.506 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 014.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 055.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 225.out 096.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 276.out 183.out 094.out 046.out 273.out 265.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 165.out 026.out 021.out 035.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 254.out 111.out 011.out 155.out 275.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 114.out 138.out 095.out 038.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 085.out 067.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 241.out 235.out 253.out 257.out 124.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 028.out 150.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 036.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 086.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 003.out 076.out 245.out 074.out 222.out 159.out 249.out 122.out 234.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 077.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out /var/lib/xfstests/tests/btrfs 2023-05-11T07:38:59.413 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ceph/ install 2023-05-11T07:38:59.415 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-11T07:38:59.436 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-11T07:38:59.483 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-11T07:38:59.504 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-11T07:38:59.552 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/cifs/ install 2023-05-11T07:38:59.555 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-11T07:38:59.575 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-11T07:38:59.596 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-11T07:38:59.618 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-11T07:38:59.638 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ext4/ install 2023-05-11T07:38:59.642 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-11T07:38:59.662 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-11T07:39:00.121 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-11T07:39:00.142 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-05-11T07:39:00.621 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/f2fs/ install 2023-05-11T07:39:00.623 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-11T07:39:00.644 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-11T07:39:00.671 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-11T07:39:00.692 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-11T07:39:00.720 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/generic/ install 2023-05-11T07:39:00.726 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-11T07:39:00.747 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-11T07:39:03.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:39:03.427 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:39:05.533 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-11T07:39:05.554 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 531.out 243.out 592.out 282.out 272.out 472.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 622.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 566.out 295.out 390.out 497.out 160.out 291.out 274.out 061.out 239.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 030.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 667.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 280.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 433.out 704.out 108.out 504.out 404.out 104.out 655.out 021.out 452.out 457.out 297.out 393.out 333.out 599.out 476.out 535.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 436.out 485.out 120.out 175.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 167.out 724.out 206.out 352.out 663.out 394.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 715.out 279.out 544.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 075.out 684.out 674.out 550.out 052.out 062.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 688.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 244.out 385.out 005.out 336.out 150.out 579.out 236.out 505.out 405.out 342.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 691.out 305.out 105.out 263.out 144.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 634.out 560.out 581.out 166.out 707.out 461.out 381.out 445.out 307.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 613.out 326.out 082.out 480.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 487.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 534.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 173.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 376.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 513.out 554.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 310.out 427.out 259.out 210.out 449.out 327.out 330.out 110.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 643.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 565.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 141.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 012.out 195.out 388.out 682.out 483.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 142.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 301.out 010.out 001.out 096.out 495.out 048.out 665.out 589.out 095.out 697.out 145.out 641.out 464.out 491.out 081.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 169.out 090.out 080.out 708.out 608.out 508.out 409.out 309.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 304.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 548.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out /var/lib/xfstests/tests/generic 2023-05-11T07:39:10.377 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/nfs/ install 2023-05-11T07:39:10.379 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-11T07:39:10.400 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-11T07:39:10.421 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-11T07:39:10.442 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-11T07:39:10.463 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/ocfs2/ install 2023-05-11T07:39:10.466 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-11T07:39:10.486 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-11T07:39:10.507 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-11T07:39:10.528 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-11T07:39:10.550 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/overlay/ install 2023-05-11T07:39:10.553 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-11T07:39:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-11T07:39:11.215 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-11T07:39:11.236 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-05-11T07:39:11.880 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/perf/ install 2023-05-11T07:39:11.883 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-11T07:39:11.908 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-11T07:39:11.925 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-11T07:39:11.945 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-11T07:39:11.967 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/selftest/ install 2023-05-11T07:39:11.969 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-11T07:39:11.991 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-11T07:39:12.044 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-11T07:39:12.065 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-11T07:39:12.118 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/shared/ install 2023-05-11T07:39:12.121 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-11T07:39:12.142 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-11T07:39:12.176 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-11T07:39:12.197 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-11T07:39:12.231 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/tmpfs/ install 2023-05-11T07:39:12.233 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-11T07:39:12.254 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-11T07:39:12.275 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-11T07:39:12.296 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-11T07:39:12.317 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/udf/ install 2023-05-11T07:39:12.320 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-11T07:39:12.341 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-11T07:39:12.362 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-11T07:39:12.383 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-11T07:39:12.404 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Kh63E6MZ0bxfstests-dev/tests/xfs/ install 2023-05-11T07:39:12.409 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-11T07:39:12.431 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-11T07:39:16.939 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-11T07:39:16.961 INFO:teuthology.orchestra.run.smithi144.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-05-11T07:39:21.531 INFO:teuthology.orchestra.run.smithi144.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-11T07:39:21.552 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-11T07:39:21.573 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-11T07:39:21.594 INFO:teuthology.orchestra.run.smithi144.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-11T07:39:21.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T07:39:21.619 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec ls tests/generic) 2023-05-11T07:39:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:001 2023-05-11T07:39:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:001.out 2023-05-11T07:39:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:002 2023-05-11T07:39:21.662 INFO:teuthology.orchestra.run.smithi144.stdout:002.out 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:003 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:003.out 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:004 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:004.out 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:005 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:005.out 2023-05-11T07:39:21.663 INFO:teuthology.orchestra.run.smithi144.stdout:006 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:006.out 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:007 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:007.out 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:008 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:008.out 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:009 2023-05-11T07:39:21.664 INFO:teuthology.orchestra.run.smithi144.stdout:009.out 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:010 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:010.out 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:011 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:011.out 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:012 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:012.out 2023-05-11T07:39:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:013 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:013.out 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:014 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:014.out 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:015 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:015.out 2023-05-11T07:39:21.666 INFO:teuthology.orchestra.run.smithi144.stdout:016 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:016.out 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:017 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:017.out 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:018 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:018.out 2023-05-11T07:39:21.667 INFO:teuthology.orchestra.run.smithi144.stdout:019 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:019.out 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:020 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:020.out 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:021 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:021.out 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:022 2023-05-11T07:39:21.668 INFO:teuthology.orchestra.run.smithi144.stdout:022.out 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:023 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:023.out 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:024 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:024.out 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:025 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:025.out 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:026 2023-05-11T07:39:21.669 INFO:teuthology.orchestra.run.smithi144.stdout:026.out 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:027 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:027.out 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:028 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:028.out 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:029 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:029.out 2023-05-11T07:39:21.670 INFO:teuthology.orchestra.run.smithi144.stdout:030 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:030.out 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:031 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:031.out 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:032 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:032.out 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:033 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:033.out 2023-05-11T07:39:21.671 INFO:teuthology.orchestra.run.smithi144.stdout:034 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:034.out 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:035 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:035.cfg 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:035.out.default 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:035.out.nfs 2023-05-11T07:39:21.672 INFO:teuthology.orchestra.run.smithi144.stdout:036 2023-05-11T07:39:21.673 INFO:teuthology.orchestra.run.smithi144.stdout:036.out 2023-05-11T07:39:21.673 INFO:teuthology.orchestra.run.smithi144.stdout:037 2023-05-11T07:39:21.673 INFO:teuthology.orchestra.run.smithi144.stdout:037.out 2023-05-11T07:39:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:038 2023-05-11T07:39:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:038.out 2023-05-11T07:39:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:039 2023-05-11T07:39:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:039.out 2023-05-11T07:39:21.675 INFO:teuthology.orchestra.run.smithi144.stdout:040 2023-05-11T07:39:21.675 INFO:teuthology.orchestra.run.smithi144.stdout:040.out 2023-05-11T07:39:21.675 INFO:teuthology.orchestra.run.smithi144.stdout:041 2023-05-11T07:39:21.675 INFO:teuthology.orchestra.run.smithi144.stdout:041.out 2023-05-11T07:39:21.676 INFO:teuthology.orchestra.run.smithi144.stdout:042 2023-05-11T07:39:21.676 INFO:teuthology.orchestra.run.smithi144.stdout:042.out 2023-05-11T07:39:21.676 INFO:teuthology.orchestra.run.smithi144.stdout:043 2023-05-11T07:39:21.677 INFO:teuthology.orchestra.run.smithi144.stdout:043.out 2023-05-11T07:39:21.677 INFO:teuthology.orchestra.run.smithi144.stdout:044 2023-05-11T07:39:21.677 INFO:teuthology.orchestra.run.smithi144.stdout:044.out 2023-05-11T07:39:21.677 INFO:teuthology.orchestra.run.smithi144.stdout:045 2023-05-11T07:39:21.678 INFO:teuthology.orchestra.run.smithi144.stdout:045.out 2023-05-11T07:39:21.678 INFO:teuthology.orchestra.run.smithi144.stdout:046 2023-05-11T07:39:21.678 INFO:teuthology.orchestra.run.smithi144.stdout:046.out 2023-05-11T07:39:21.678 INFO:teuthology.orchestra.run.smithi144.stdout:047 2023-05-11T07:39:21.679 INFO:teuthology.orchestra.run.smithi144.stdout:047.out 2023-05-11T07:39:21.679 INFO:teuthology.orchestra.run.smithi144.stdout:048 2023-05-11T07:39:21.679 INFO:teuthology.orchestra.run.smithi144.stdout:048.out 2023-05-11T07:39:21.679 INFO:teuthology.orchestra.run.smithi144.stdout:049 2023-05-11T07:39:21.680 INFO:teuthology.orchestra.run.smithi144.stdout:049.out 2023-05-11T07:39:21.680 INFO:teuthology.orchestra.run.smithi144.stdout:050 2023-05-11T07:39:21.680 INFO:teuthology.orchestra.run.smithi144.stdout:050.cfg 2023-05-11T07:39:21.680 INFO:teuthology.orchestra.run.smithi144.stdout:050.out.default 2023-05-11T07:39:21.681 INFO:teuthology.orchestra.run.smithi144.stdout:050.out.nojournal 2023-05-11T07:39:21.681 INFO:teuthology.orchestra.run.smithi144.stdout:050.out.xfsquota 2023-05-11T07:39:21.681 INFO:teuthology.orchestra.run.smithi144.stdout:051 2023-05-11T07:39:21.681 INFO:teuthology.orchestra.run.smithi144.stdout:051.out 2023-05-11T07:39:21.681 INFO:teuthology.orchestra.run.smithi144.stdout:052 2023-05-11T07:39:21.682 INFO:teuthology.orchestra.run.smithi144.stdout:052.out 2023-05-11T07:39:21.682 INFO:teuthology.orchestra.run.smithi144.stdout:053 2023-05-11T07:39:21.682 INFO:teuthology.orchestra.run.smithi144.stdout:053.out 2023-05-11T07:39:21.682 INFO:teuthology.orchestra.run.smithi144.stdout:054 2023-05-11T07:39:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:054.out 2023-05-11T07:39:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:055 2023-05-11T07:39:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:055.out 2023-05-11T07:39:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:056 2023-05-11T07:39:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:056.out 2023-05-11T07:39:21.684 INFO:teuthology.orchestra.run.smithi144.stdout:057 2023-05-11T07:39:21.684 INFO:teuthology.orchestra.run.smithi144.stdout:057.out 2023-05-11T07:39:21.684 INFO:teuthology.orchestra.run.smithi144.stdout:058 2023-05-11T07:39:21.684 INFO:teuthology.orchestra.run.smithi144.stdout:058.out 2023-05-11T07:39:21.685 INFO:teuthology.orchestra.run.smithi144.stdout:059 2023-05-11T07:39:21.685 INFO:teuthology.orchestra.run.smithi144.stdout:059.out 2023-05-11T07:39:21.685 INFO:teuthology.orchestra.run.smithi144.stdout:060 2023-05-11T07:39:21.685 INFO:teuthology.orchestra.run.smithi144.stdout:060.out 2023-05-11T07:39:21.686 INFO:teuthology.orchestra.run.smithi144.stdout:061 2023-05-11T07:39:21.686 INFO:teuthology.orchestra.run.smithi144.stdout:061.out 2023-05-11T07:39:21.686 INFO:teuthology.orchestra.run.smithi144.stdout:062 2023-05-11T07:39:21.687 INFO:teuthology.orchestra.run.smithi144.stdout:062.out 2023-05-11T07:39:21.687 INFO:teuthology.orchestra.run.smithi144.stdout:063 2023-05-11T07:39:21.687 INFO:teuthology.orchestra.run.smithi144.stdout:063.out 2023-05-11T07:39:21.687 INFO:teuthology.orchestra.run.smithi144.stdout:064 2023-05-11T07:39:21.688 INFO:teuthology.orchestra.run.smithi144.stdout:064.out 2023-05-11T07:39:21.688 INFO:teuthology.orchestra.run.smithi144.stdout:065 2023-05-11T07:39:21.688 INFO:teuthology.orchestra.run.smithi144.stdout:065.out 2023-05-11T07:39:21.688 INFO:teuthology.orchestra.run.smithi144.stdout:066 2023-05-11T07:39:21.689 INFO:teuthology.orchestra.run.smithi144.stdout:066.out 2023-05-11T07:39:21.689 INFO:teuthology.orchestra.run.smithi144.stdout:067 2023-05-11T07:39:21.689 INFO:teuthology.orchestra.run.smithi144.stdout:067.out 2023-05-11T07:39:21.689 INFO:teuthology.orchestra.run.smithi144.stdout:068 2023-05-11T07:39:21.690 INFO:teuthology.orchestra.run.smithi144.stdout:068.out 2023-05-11T07:39:21.690 INFO:teuthology.orchestra.run.smithi144.stdout:069 2023-05-11T07:39:21.690 INFO:teuthology.orchestra.run.smithi144.stdout:069.out 2023-05-11T07:39:21.690 INFO:teuthology.orchestra.run.smithi144.stdout:070 2023-05-11T07:39:21.691 INFO:teuthology.orchestra.run.smithi144.stdout:070.out 2023-05-11T07:39:21.691 INFO:teuthology.orchestra.run.smithi144.stdout:071 2023-05-11T07:39:21.691 INFO:teuthology.orchestra.run.smithi144.stdout:071.out 2023-05-11T07:39:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:072 2023-05-11T07:39:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:072.out 2023-05-11T07:39:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:073 2023-05-11T07:39:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:073.out 2023-05-11T07:39:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:074 2023-05-11T07:39:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:074.out 2023-05-11T07:39:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:075 2023-05-11T07:39:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:075.out 2023-05-11T07:39:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:076 2023-05-11T07:39:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:076.out 2023-05-11T07:39:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:077 2023-05-11T07:39:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:077.out 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:078 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:078.out 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:079 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:079.out 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:080 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:080.out 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:081 2023-05-11T07:39:21.695 INFO:teuthology.orchestra.run.smithi144.stdout:081.out 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:082 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:082.out 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:083 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:083.out 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:084 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:084.out 2023-05-11T07:39:21.696 INFO:teuthology.orchestra.run.smithi144.stdout:085 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:085.out 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:086 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:086.out 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:087 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:087.out 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:088 2023-05-11T07:39:21.697 INFO:teuthology.orchestra.run.smithi144.stdout:088.out 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:089 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:089.out 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:090 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:090.out 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:091 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:091.out 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:092 2023-05-11T07:39:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:092.out 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:093 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:093.out 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:094 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:094.out 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:095 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:095.out 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:096 2023-05-11T07:39:21.699 INFO:teuthology.orchestra.run.smithi144.stdout:096.out 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:097 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:097.out 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:098 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:098.out 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:099 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:099.out 2023-05-11T07:39:21.700 INFO:teuthology.orchestra.run.smithi144.stdout:100 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:100.out 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:101 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:101.out 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:102 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:102.out 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:103 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:103.out 2023-05-11T07:39:21.701 INFO:teuthology.orchestra.run.smithi144.stdout:104 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:104.out 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:105 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:105.out 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:106 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:106.out 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:107 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:107.out 2023-05-11T07:39:21.702 INFO:teuthology.orchestra.run.smithi144.stdout:108 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:108.out 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:109 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:109.out 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:110 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:110.out 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:111 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:111.out 2023-05-11T07:39:21.703 INFO:teuthology.orchestra.run.smithi144.stdout:112 2023-05-11T07:39:21.704 INFO:teuthology.orchestra.run.smithi144.stdout:112.out 2023-05-11T07:39:21.704 INFO:teuthology.orchestra.run.smithi144.stdout:113 2023-05-11T07:39:21.704 INFO:teuthology.orchestra.run.smithi144.stdout:113.out 2023-05-11T07:39:21.704 INFO:teuthology.orchestra.run.smithi144.stdout:114 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:114.out 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:115 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:115.out 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:116 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:116.out 2023-05-11T07:39:21.705 INFO:teuthology.orchestra.run.smithi144.stdout:117 2023-05-11T07:39:21.706 INFO:teuthology.orchestra.run.smithi144.stdout:117.out 2023-05-11T07:39:21.706 INFO:teuthology.orchestra.run.smithi144.stdout:118 2023-05-11T07:39:21.706 INFO:teuthology.orchestra.run.smithi144.stdout:118.out 2023-05-11T07:39:21.706 INFO:teuthology.orchestra.run.smithi144.stdout:119 2023-05-11T07:39:21.707 INFO:teuthology.orchestra.run.smithi144.stdout:119.out 2023-05-11T07:39:21.707 INFO:teuthology.orchestra.run.smithi144.stdout:120 2023-05-11T07:39:21.707 INFO:teuthology.orchestra.run.smithi144.stdout:120.out 2023-05-11T07:39:21.707 INFO:teuthology.orchestra.run.smithi144.stdout:121 2023-05-11T07:39:21.708 INFO:teuthology.orchestra.run.smithi144.stdout:121.out 2023-05-11T07:39:21.708 INFO:teuthology.orchestra.run.smithi144.stdout:122 2023-05-11T07:39:21.708 INFO:teuthology.orchestra.run.smithi144.stdout:122.out 2023-05-11T07:39:21.708 INFO:teuthology.orchestra.run.smithi144.stdout:123 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:123.out 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:124 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:124.out 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:125 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:125.out 2023-05-11T07:39:21.709 INFO:teuthology.orchestra.run.smithi144.stdout:126 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:126.out 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:127 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:127.out 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:128 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:128.out 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:129 2023-05-11T07:39:21.710 INFO:teuthology.orchestra.run.smithi144.stdout:129.out 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:130 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:130.out 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:131 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:131.out 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:132 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:132.out 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:133 2023-05-11T07:39:21.711 INFO:teuthology.orchestra.run.smithi144.stdout:133.out 2023-05-11T07:39:21.712 INFO:teuthology.orchestra.run.smithi144.stdout:134 2023-05-11T07:39:21.712 INFO:teuthology.orchestra.run.smithi144.stdout:134.out 2023-05-11T07:39:21.712 INFO:teuthology.orchestra.run.smithi144.stdout:135 2023-05-11T07:39:21.712 INFO:teuthology.orchestra.run.smithi144.stdout:135.out 2023-05-11T07:39:21.712 INFO:teuthology.orchestra.run.smithi144.stdout:136 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:136.out 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:137 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:137.out 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:138 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:138.out 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:139 2023-05-11T07:39:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:139.out 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:140 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:140.out 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:141 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:141.out 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:142 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:142.out 2023-05-11T07:39:21.714 INFO:teuthology.orchestra.run.smithi144.stdout:143 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:143.out 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:144 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:144.out 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:145 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:145.out 2023-05-11T07:39:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:146 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:146.out 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:147 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:147.out 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:148 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:148.out 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:149 2023-05-11T07:39:21.716 INFO:teuthology.orchestra.run.smithi144.stdout:149.out 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:150 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:150.out 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:151 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:151.out 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:152 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:152.out 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:153 2023-05-11T07:39:21.717 INFO:teuthology.orchestra.run.smithi144.stdout:153.out 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:154 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:154.out 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:155 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:155.out 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:156 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:156.out 2023-05-11T07:39:21.718 INFO:teuthology.orchestra.run.smithi144.stdout:157 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:157.out 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:158 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:158.out 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:159 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:159.out 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:160 2023-05-11T07:39:21.719 INFO:teuthology.orchestra.run.smithi144.stdout:160.out 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:161 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:161.out 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:162 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:162.out 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:163 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:163.out 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:164 2023-05-11T07:39:21.720 INFO:teuthology.orchestra.run.smithi144.stdout:164.out 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:165 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:165.out 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:166 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:166.out 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:167 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:167.out 2023-05-11T07:39:21.721 INFO:teuthology.orchestra.run.smithi144.stdout:168 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:168.out 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:169 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:169.out 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:170 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:170.out 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:171 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:171.out 2023-05-11T07:39:21.722 INFO:teuthology.orchestra.run.smithi144.stdout:172 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:172.out 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:173 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:173.out 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:174 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:174.out 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:175 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:175.out 2023-05-11T07:39:21.723 INFO:teuthology.orchestra.run.smithi144.stdout:176 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:176.out 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:177 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:177.out 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:178 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:178.out 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:179 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:179.out 2023-05-11T07:39:21.724 INFO:teuthology.orchestra.run.smithi144.stdout:180 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:180.out 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:181 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:181.out 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:182 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:182.out 2023-05-11T07:39:21.725 INFO:teuthology.orchestra.run.smithi144.stdout:183 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:183.out 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:184 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:184.out 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:185 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:185.out 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:186 2023-05-11T07:39:21.726 INFO:teuthology.orchestra.run.smithi144.stdout:186.out 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:187 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:187.out 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:188 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:188.out 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:189 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:189.out 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:190 2023-05-11T07:39:21.727 INFO:teuthology.orchestra.run.smithi144.stdout:190.out 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:191 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:191.out 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:192 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:192.out 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:193 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:193.out 2023-05-11T07:39:21.728 INFO:teuthology.orchestra.run.smithi144.stdout:194 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:194.out 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:195 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:195.out 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:196 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:196.out 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:197 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:197.out 2023-05-11T07:39:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:198 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:198.out 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:199 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:199.out 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:200 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:200.out 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:201 2023-05-11T07:39:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:201.out 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:202 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:202.out 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:203 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:203.out 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:204 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:204.out 2023-05-11T07:39:21.731 INFO:teuthology.orchestra.run.smithi144.stdout:205 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:205.out 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:206 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:206.out 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:207 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:207.out 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:208 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:208.out 2023-05-11T07:39:21.732 INFO:teuthology.orchestra.run.smithi144.stdout:209 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:209.out 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:210 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:210.out 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:211 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:211.out 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:212 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:212.out 2023-05-11T07:39:21.733 INFO:teuthology.orchestra.run.smithi144.stdout:213 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:213.out 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:214 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:214.out 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:215 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:215.out 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:216 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:216.out 2023-05-11T07:39:21.734 INFO:teuthology.orchestra.run.smithi144.stdout:217 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:217.out 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:218 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:218.out 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:219 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:219.out 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:220 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:220.out 2023-05-11T07:39:21.735 INFO:teuthology.orchestra.run.smithi144.stdout:221 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:221.out 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:222 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:222.out 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:223 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:223.out 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:224 2023-05-11T07:39:21.736 INFO:teuthology.orchestra.run.smithi144.stdout:224.out 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:225 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:225.out 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:226 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:226.out 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:227 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:227.out 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:228 2023-05-11T07:39:21.737 INFO:teuthology.orchestra.run.smithi144.stdout:228.out 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:229 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:229.out 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:230 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:230.out 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:231 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:231.out 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:232 2023-05-11T07:39:21.738 INFO:teuthology.orchestra.run.smithi144.stdout:232.out 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:233 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:233.out 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:234 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:234.out 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:235 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:235.out 2023-05-11T07:39:21.739 INFO:teuthology.orchestra.run.smithi144.stdout:236 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:236.out 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:237 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:237.out 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:238 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:238.out 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:239 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:239.out 2023-05-11T07:39:21.740 INFO:teuthology.orchestra.run.smithi144.stdout:240 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:240.out 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:241 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:241.out 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:242 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:242.out 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:243 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:243.out 2023-05-11T07:39:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:244 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:244.out 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:245 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:245.out 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:246 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:246.out 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:247 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:247.out 2023-05-11T07:39:21.742 INFO:teuthology.orchestra.run.smithi144.stdout:248 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:248.out 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:249 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:249.out 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:250 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:250.out 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:251 2023-05-11T07:39:21.743 INFO:teuthology.orchestra.run.smithi144.stdout:251.out 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:252 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:252.out 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:253 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:253.out 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:254 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:254.out 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:255 2023-05-11T07:39:21.744 INFO:teuthology.orchestra.run.smithi144.stdout:255.out 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:256 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:256.out 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:257 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:257.out 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:258 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:258.out 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:259 2023-05-11T07:39:21.745 INFO:teuthology.orchestra.run.smithi144.stdout:259.out 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:260 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:260.out 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:261 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:261.out 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:262 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:262.out 2023-05-11T07:39:21.746 INFO:teuthology.orchestra.run.smithi144.stdout:263 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:263.out 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:264 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:264.out 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:265 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:265.out 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:266 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:266.out 2023-05-11T07:39:21.747 INFO:teuthology.orchestra.run.smithi144.stdout:267 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:267.out 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:268 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:268.out 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:269 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:269.out 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:270 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:270.out 2023-05-11T07:39:21.748 INFO:teuthology.orchestra.run.smithi144.stdout:271 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:271.out 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:272 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:272.out 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:273 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:273.out 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:274 2023-05-11T07:39:21.749 INFO:teuthology.orchestra.run.smithi144.stdout:274.out 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:275 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:275.out 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:276 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:276.out 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:277 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:277.out 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:278 2023-05-11T07:39:21.750 INFO:teuthology.orchestra.run.smithi144.stdout:278.out 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:279 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:279.out 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:280 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:280.out 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:281 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:281.out 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:282 2023-05-11T07:39:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:282.out 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:283 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:283.out 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:284 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:284.out 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:285 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:285.out 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:286 2023-05-11T07:39:21.752 INFO:teuthology.orchestra.run.smithi144.stdout:286.out 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:287 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:287.out 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:288 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:288.out 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:289 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:289.out 2023-05-11T07:39:21.753 INFO:teuthology.orchestra.run.smithi144.stdout:290 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:290.out 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:291 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:291.out 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:292 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:292.out 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:293 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:293.out 2023-05-11T07:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:294 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:294.out 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:295 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:295.out 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:296 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:296.out 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:297 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:297.out 2023-05-11T07:39:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:298 2023-05-11T07:39:21.756 INFO:teuthology.orchestra.run.smithi144.stdout:298.out 2023-05-11T07:39:21.756 INFO:teuthology.orchestra.run.smithi144.stdout:299 2023-05-11T07:39:21.756 INFO:teuthology.orchestra.run.smithi144.stdout:299.out 2023-05-11T07:39:21.756 INFO:teuthology.orchestra.run.smithi144.stdout:300 2023-05-11T07:39:21.756 INFO:teuthology.orchestra.run.smithi144.stdout:300.out 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:301 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:301.out 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:302 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:302.out 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:303 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:303.out 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:304 2023-05-11T07:39:21.757 INFO:teuthology.orchestra.run.smithi144.stdout:304.out 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:305 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:305.out 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:306 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:306.out 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:307 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:307.out 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:308 2023-05-11T07:39:21.758 INFO:teuthology.orchestra.run.smithi144.stdout:308.out 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:309 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:309.out 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:310 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:310.out 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:311 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:311.out 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:312 2023-05-11T07:39:21.759 INFO:teuthology.orchestra.run.smithi144.stdout:312.out 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:313 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:313.out 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:314 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:314.out 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:315 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:315.out 2023-05-11T07:39:21.760 INFO:teuthology.orchestra.run.smithi144.stdout:316 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:316.out 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:317 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:317.out 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:318 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:318.out 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:319 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:319.out 2023-05-11T07:39:21.761 INFO:teuthology.orchestra.run.smithi144.stdout:320 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:320.out 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:321 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:321.out 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:322 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:322.out 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:323 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:323.out 2023-05-11T07:39:21.762 INFO:teuthology.orchestra.run.smithi144.stdout:324 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:324.out 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:325 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:325.out 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:326 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:326.out 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:327 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:327.out 2023-05-11T07:39:21.763 INFO:teuthology.orchestra.run.smithi144.stdout:328 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:328.out 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:329 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:329.out 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:330 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:330.out 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:331 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:331.out 2023-05-11T07:39:21.764 INFO:teuthology.orchestra.run.smithi144.stdout:332 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:332.out 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:333 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:333.out 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:334 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:334.out 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:335 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:335.out 2023-05-11T07:39:21.765 INFO:teuthology.orchestra.run.smithi144.stdout:336 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:336.out 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:337 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:337.out 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:338 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:338.out 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:339 2023-05-11T07:39:21.766 INFO:teuthology.orchestra.run.smithi144.stdout:339.out 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:340 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:340.out 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:341 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:341.out 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:342 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:342.out 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:343 2023-05-11T07:39:21.767 INFO:teuthology.orchestra.run.smithi144.stdout:343.out 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:344 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:344.out 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:345 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:345.out 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:346 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:346.out 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:347 2023-05-11T07:39:21.768 INFO:teuthology.orchestra.run.smithi144.stdout:347.out 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:348 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:348.out 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:349 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:349.out 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:350 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:350.out 2023-05-11T07:39:21.769 INFO:teuthology.orchestra.run.smithi144.stdout:351 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:351.out 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:352 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:352.out 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:353 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:353.out 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:354 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:354.out 2023-05-11T07:39:21.770 INFO:teuthology.orchestra.run.smithi144.stdout:355 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:355.out 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:356 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:356.out 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:357 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:357.out 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:358 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:358.out 2023-05-11T07:39:21.771 INFO:teuthology.orchestra.run.smithi144.stdout:359 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:359.out 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:360 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:360.out 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:361 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:361.out 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:362 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:362.out 2023-05-11T07:39:21.772 INFO:teuthology.orchestra.run.smithi144.stdout:363 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:363.out 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:364 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:364.out 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:365 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:365.out 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:366 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:366.out 2023-05-11T07:39:21.773 INFO:teuthology.orchestra.run.smithi144.stdout:367 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:367.out 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:368 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:368.out 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:369 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:369.out 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:370 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:370.out 2023-05-11T07:39:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:371 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:371.out 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:372 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:372.out 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:373 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:373.out 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:374 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:374.out 2023-05-11T07:39:21.775 INFO:teuthology.orchestra.run.smithi144.stdout:375 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:375.out 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:376 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:376.out 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:377 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:377.out 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:378 2023-05-11T07:39:21.776 INFO:teuthology.orchestra.run.smithi144.stdout:378.out 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:379 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:379.out 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:380 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:380.out 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:381 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:381.out 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:382 2023-05-11T07:39:21.777 INFO:teuthology.orchestra.run.smithi144.stdout:382.out 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:383 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:383.out 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:384 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:384.out 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:385 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:385.out 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:386 2023-05-11T07:39:21.778 INFO:teuthology.orchestra.run.smithi144.stdout:386.out 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:387 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:387.out 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:388 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:388.out 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:389 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:389.out 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:390 2023-05-11T07:39:21.779 INFO:teuthology.orchestra.run.smithi144.stdout:390.out 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:391 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:391.out 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:392 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:392.out 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:393 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:393.out 2023-05-11T07:39:21.780 INFO:teuthology.orchestra.run.smithi144.stdout:394 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:394.out 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:395 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:395.out 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:396 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:396.out 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:397 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:397.out 2023-05-11T07:39:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:398 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:398.out 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:399 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:399.out 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:400 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:400.out 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:401 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:401.out 2023-05-11T07:39:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:402 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:402.out 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:403 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:403.out 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:404 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:404.out 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:405 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:405.out 2023-05-11T07:39:21.783 INFO:teuthology.orchestra.run.smithi144.stdout:406 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:406.out 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:407 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:407.out 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:408 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:408.out 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:409 2023-05-11T07:39:21.784 INFO:teuthology.orchestra.run.smithi144.stdout:409.out 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:410 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:410.out 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:411 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:411.out 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:412 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:412.out 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:413 2023-05-11T07:39:21.785 INFO:teuthology.orchestra.run.smithi144.stdout:413.out 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:414 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:414.out 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:415 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:415.out 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:416 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:416.out 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:417 2023-05-11T07:39:21.786 INFO:teuthology.orchestra.run.smithi144.stdout:417.out 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:418 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:418.out 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:419 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:419.out 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:420 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:420.out 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:421 2023-05-11T07:39:21.787 INFO:teuthology.orchestra.run.smithi144.stdout:421.out 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:422 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:422.out 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:423 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:423.out 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:424 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:424.out 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:425 2023-05-11T07:39:21.788 INFO:teuthology.orchestra.run.smithi144.stdout:425.out 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:426 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:426.out 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:427 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:427.out 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:428 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:428.out 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:429 2023-05-11T07:39:21.789 INFO:teuthology.orchestra.run.smithi144.stdout:429.out 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:430 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:430.out 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:431 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:431.out 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:432 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:432.out 2023-05-11T07:39:21.790 INFO:teuthology.orchestra.run.smithi144.stdout:433 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:433.out 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:434 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:434.out 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:435 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:435.out 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:436 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:436.out 2023-05-11T07:39:21.791 INFO:teuthology.orchestra.run.smithi144.stdout:437 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:437.out 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:438 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:438.out 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:439 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:439.out 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:440 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:440.out 2023-05-11T07:39:21.792 INFO:teuthology.orchestra.run.smithi144.stdout:441 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:441.out 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:442 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:442.out 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:443 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:443.out 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:444 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:444.out 2023-05-11T07:39:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:445 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:445.out 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:446 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:446.out 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:447 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:447.out 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:448 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:448.out 2023-05-11T07:39:21.794 INFO:teuthology.orchestra.run.smithi144.stdout:449 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:449.out 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:450 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:450.out 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:451 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:451.out 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:452 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:452.out 2023-05-11T07:39:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:453 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:453.out 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:454 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:454.out 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:455 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:455.out 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:456 2023-05-11T07:39:21.796 INFO:teuthology.orchestra.run.smithi144.stdout:456.out 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:457 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:457.out 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:458 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:458.out 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:459 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:459.out 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:460 2023-05-11T07:39:21.797 INFO:teuthology.orchestra.run.smithi144.stdout:460.out 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:461 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:461.out 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:462 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:462.out 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:463 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:463.out 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:464 2023-05-11T07:39:21.798 INFO:teuthology.orchestra.run.smithi144.stdout:464.out 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:465 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:465.out 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:466 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:466.out 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:467 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:467.out 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:468 2023-05-11T07:39:21.799 INFO:teuthology.orchestra.run.smithi144.stdout:468.out 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:469 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:469.out 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:470 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:470.out 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:471 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:471.out 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:472 2023-05-11T07:39:21.800 INFO:teuthology.orchestra.run.smithi144.stdout:472.out 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:473 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:473.out 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:474 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:474.out 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:475 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:475.out 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:476 2023-05-11T07:39:21.801 INFO:teuthology.orchestra.run.smithi144.stdout:476.out 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:477 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:477.out 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:478 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:478.out 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:479 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:479.out 2023-05-11T07:39:21.802 INFO:teuthology.orchestra.run.smithi144.stdout:480 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:480.out 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:481 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:481.out 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:482 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:482.out 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:483 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:483.out 2023-05-11T07:39:21.803 INFO:teuthology.orchestra.run.smithi144.stdout:484 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:484.out 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:485 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:485.out 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:486 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:486.out 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:487 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:487.out 2023-05-11T07:39:21.804 INFO:teuthology.orchestra.run.smithi144.stdout:488 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:488.out 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:489 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:489.out 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:490 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:490.out 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:491 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:491.out 2023-05-11T07:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:492 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:492.out 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:493 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:493.out 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:494 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:494.out 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:495 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:495.out 2023-05-11T07:39:21.806 INFO:teuthology.orchestra.run.smithi144.stdout:496 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:496.out 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:497 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:497.out 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:498 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:498.out 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:499 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:499.out 2023-05-11T07:39:21.807 INFO:teuthology.orchestra.run.smithi144.stdout:500 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:500.out 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:501 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:501.out 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:502 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:502.out 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:503 2023-05-11T07:39:21.808 INFO:teuthology.orchestra.run.smithi144.stdout:503.out 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:504 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:504.out 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:505 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:505.out 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:506 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:506.out 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:507 2023-05-11T07:39:21.809 INFO:teuthology.orchestra.run.smithi144.stdout:507.out 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:508 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:508.out 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:509 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:509.out 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:510 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:510.out 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:511 2023-05-11T07:39:21.810 INFO:teuthology.orchestra.run.smithi144.stdout:511.out 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:512 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:512.out 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:513 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:513.out 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:514 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:514.out 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:515 2023-05-11T07:39:21.811 INFO:teuthology.orchestra.run.smithi144.stdout:515.out 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:516 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:516.out 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:517 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:517.out 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:518 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:518.out 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:519 2023-05-11T07:39:21.812 INFO:teuthology.orchestra.run.smithi144.stdout:519.out 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:520 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:520.out 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:521 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:521.out 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:522 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:522.out 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:523 2023-05-11T07:39:21.813 INFO:teuthology.orchestra.run.smithi144.stdout:523.out 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:524 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:524.out 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:525 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:525.out 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:526 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:526.out 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:527 2023-05-11T07:39:21.814 INFO:teuthology.orchestra.run.smithi144.stdout:527.out 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:528 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:528.out 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:529 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:529.out 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:530 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:530.out 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:531 2023-05-11T07:39:21.815 INFO:teuthology.orchestra.run.smithi144.stdout:531.out 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:532 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:532.out 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:533 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:533.out 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:534 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:534.out 2023-05-11T07:39:21.816 INFO:teuthology.orchestra.run.smithi144.stdout:535 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:535.out 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:536 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:536.out 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:537 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:537.out 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:538 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:538.out 2023-05-11T07:39:21.817 INFO:teuthology.orchestra.run.smithi144.stdout:539 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:539.out 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:540 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:540.out 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:541 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:541.out 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:542 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:542.out 2023-05-11T07:39:21.818 INFO:teuthology.orchestra.run.smithi144.stdout:543 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:543.out 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:544 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:544.out 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:545 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:545.out 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:546 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:546.out 2023-05-11T07:39:21.819 INFO:teuthology.orchestra.run.smithi144.stdout:547 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:547.out 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:548 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:548.out 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:549 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:549.out 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:550 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:550.out 2023-05-11T07:39:21.820 INFO:teuthology.orchestra.run.smithi144.stdout:551 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:551.out 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:552 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:552.out 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:553 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:553.out 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:554 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:554.out 2023-05-11T07:39:21.821 INFO:teuthology.orchestra.run.smithi144.stdout:555 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:555.out 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:556 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:556.out 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:557 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:557.out 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:558 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:558.out 2023-05-11T07:39:21.822 INFO:teuthology.orchestra.run.smithi144.stdout:559 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:559.out 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:560 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:560.out 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:561 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:561.out 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:562 2023-05-11T07:39:21.823 INFO:teuthology.orchestra.run.smithi144.stdout:562.out 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:563 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:563.out 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:564 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:564.out 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:565 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:565.out 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:566 2023-05-11T07:39:21.824 INFO:teuthology.orchestra.run.smithi144.stdout:566.out 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:567 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:567.out 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:568 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:568.out 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:569 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:569.out 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:570 2023-05-11T07:39:21.825 INFO:teuthology.orchestra.run.smithi144.stdout:570.out 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:571 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:571.out 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:572 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:572.out 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:573 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:573.out 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:574 2023-05-11T07:39:21.826 INFO:teuthology.orchestra.run.smithi144.stdout:574.out 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:575 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:575.out 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:576 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:576.out 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:577 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:577.out 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:578 2023-05-11T07:39:21.827 INFO:teuthology.orchestra.run.smithi144.stdout:578.out 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:579 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:579.out 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:580 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:580.out 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:581 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:581.out 2023-05-11T07:39:21.828 INFO:teuthology.orchestra.run.smithi144.stdout:582 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:582.out 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:583 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:583.out 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:584 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:584.out 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:585 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:585.out 2023-05-11T07:39:21.829 INFO:teuthology.orchestra.run.smithi144.stdout:586 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:586.out 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:587 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:587.out 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:588 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:588.out 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:589 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:589.out 2023-05-11T07:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:590 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:590.out 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:591 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:591.out 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:592 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:592.out 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:593 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:593.out 2023-05-11T07:39:21.831 INFO:teuthology.orchestra.run.smithi144.stdout:594 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:594.out 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:595 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:595.out 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:596 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:596.out 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:597 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:597.out 2023-05-11T07:39:21.832 INFO:teuthology.orchestra.run.smithi144.stdout:598 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:598.out 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:599 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:599.out 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:600 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:600.out 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:601 2023-05-11T07:39:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:601.out 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:602 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:602.out 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:603 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:603.out 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:604 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:604.out 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:605 2023-05-11T07:39:21.834 INFO:teuthology.orchestra.run.smithi144.stdout:605.out 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:606 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:606.out 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:607 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:607.out 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:608 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:608.out 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:609 2023-05-11T07:39:21.835 INFO:teuthology.orchestra.run.smithi144.stdout:609.out 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:610 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:610.out 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:611 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:611.out 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:612 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:612.out 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:613 2023-05-11T07:39:21.836 INFO:teuthology.orchestra.run.smithi144.stdout:613.out 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:614 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:614.out 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:615 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:615.out 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:616 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:616.out 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:617 2023-05-11T07:39:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:617.out 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:618 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:618.out 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:619 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:619.out 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:620 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:620.out 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:621 2023-05-11T07:39:21.838 INFO:teuthology.orchestra.run.smithi144.stdout:621.out 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:622 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:622.out 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:623 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:623.out 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:624 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:624.out 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:625 2023-05-11T07:39:21.839 INFO:teuthology.orchestra.run.smithi144.stdout:625.out 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:626 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:626.out 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:627 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:627.out 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:628 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:628.out 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:629 2023-05-11T07:39:21.840 INFO:teuthology.orchestra.run.smithi144.stdout:629.out 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:630 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:630.out 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:631 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:631.out 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:632 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:632.out 2023-05-11T07:39:21.841 INFO:teuthology.orchestra.run.smithi144.stdout:633 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:633.out 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:634 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:634.out 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:635 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:635.out 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:636 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:636.out 2023-05-11T07:39:21.842 INFO:teuthology.orchestra.run.smithi144.stdout:637 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:637.out 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:638 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:638.out 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:639 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:639.out 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:640 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:640.out 2023-05-11T07:39:21.843 INFO:teuthology.orchestra.run.smithi144.stdout:641 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:641.out 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:642 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:642.out 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:643 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:643.out 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:644 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:644.out 2023-05-11T07:39:21.844 INFO:teuthology.orchestra.run.smithi144.stdout:645 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:645.out 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:646 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:646.out 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:647 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:647.out 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:648 2023-05-11T07:39:21.845 INFO:teuthology.orchestra.run.smithi144.stdout:648.out 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:649 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:649.out 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:650 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:650.out 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:651 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:651.out 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:652 2023-05-11T07:39:21.846 INFO:teuthology.orchestra.run.smithi144.stdout:652.out 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:653 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:653.out 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:654 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:654.out 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:655 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:655.out 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:656 2023-05-11T07:39:21.847 INFO:teuthology.orchestra.run.smithi144.stdout:656.out 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:657 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:657.out 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:658 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:658.out 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:659 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:659.out 2023-05-11T07:39:21.848 INFO:teuthology.orchestra.run.smithi144.stdout:660 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:660.out 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:661 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:661.out 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:662 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:662.out 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:663 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:663.out 2023-05-11T07:39:21.849 INFO:teuthology.orchestra.run.smithi144.stdout:664 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:664.out 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:665 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:665.out 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:666 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:666.out 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:667 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:667.out 2023-05-11T07:39:21.850 INFO:teuthology.orchestra.run.smithi144.stdout:668 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:668.out 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:669 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:669.out 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:670 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:670.out 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:671 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:671.out 2023-05-11T07:39:21.851 INFO:teuthology.orchestra.run.smithi144.stdout:672 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:672.out 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:673 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:673.out 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:674 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:674.out 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:675 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:675.out 2023-05-11T07:39:21.852 INFO:teuthology.orchestra.run.smithi144.stdout:676 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:676.out 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:677 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:677.out 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:678 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:678.out 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:679 2023-05-11T07:39:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:679.out 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:680 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:680.out 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:681 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:681.out 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:682 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:682.out 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:683 2023-05-11T07:39:21.854 INFO:teuthology.orchestra.run.smithi144.stdout:683.out 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:684 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:684.out 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:685 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:685.out 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:686 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:686.out 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:687 2023-05-11T07:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:687.out 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:688 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:688.out 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:689 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:689.out 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:690 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:690.out 2023-05-11T07:39:21.856 INFO:teuthology.orchestra.run.smithi144.stdout:691 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:691.out 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:692 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:692.out 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:693 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:693.out 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:694 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:694.out 2023-05-11T07:39:21.857 INFO:teuthology.orchestra.run.smithi144.stdout:695 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:695.out 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:696 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:696.out 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:697 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:697.out 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:698 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:698.out 2023-05-11T07:39:21.858 INFO:teuthology.orchestra.run.smithi144.stdout:699 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:699.out 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:700 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:700.out 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:701 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:701.out 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:702 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:702.out 2023-05-11T07:39:21.859 INFO:teuthology.orchestra.run.smithi144.stdout:703 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:703.out 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:704 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:704.out 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:705 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:705.out 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:706 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:706.out 2023-05-11T07:39:21.860 INFO:teuthology.orchestra.run.smithi144.stdout:707 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:707.out 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:708 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:708.out 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:709 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:709.out 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:710 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:710.out 2023-05-11T07:39:21.861 INFO:teuthology.orchestra.run.smithi144.stdout:711 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:711.out 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:712 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:712.out 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:713 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:713.out 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:714 2023-05-11T07:39:21.862 INFO:teuthology.orchestra.run.smithi144.stdout:714.out 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:715 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:715.out 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:716 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:716.out 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:717 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:717.out 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:718 2023-05-11T07:39:21.863 INFO:teuthology.orchestra.run.smithi144.stdout:718.out 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:719 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:719.out 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:720 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:720.out 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:721 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:721.out 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:722 2023-05-11T07:39:21.864 INFO:teuthology.orchestra.run.smithi144.stdout:722.out 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:723 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:723.out 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:724 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:724.out 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:725 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:725.out 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:726 2023-05-11T07:39:21.865 INFO:teuthology.orchestra.run.smithi144.stdout:726.out 2023-05-11T07:39:21.866 INFO:teuthology.orchestra.run.smithi144.stdout:727 2023-05-11T07:39:21.866 INFO:teuthology.orchestra.run.smithi144.stdout:727.out 2023-05-11T07:39:21.866 INFO:teuthology.orchestra.run.smithi144.stdout:group.list 2023-05-11T07:39:21.866 INFO:teuthology.orchestra.run.smithi144.stdout:Makefile 2023-05-11T07:39:21.866 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-11T07:39:22.321 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:22.332 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:22.333 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:22.335 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:29.723 INFO:teuthology.orchestra.run.smithi144.stdout:generic/001 7s 2023-05-11T07:39:29.735 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/001 2023-05-11T07:39:29.736 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:39:29.740 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:29.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:29.917 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-11T07:39:30.332 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:30.343 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:30.344 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:30.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:31.160 INFO:teuthology.orchestra.run.smithi144.stdout:generic/002 1s 2023-05-11T07:39:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/002 2023-05-11T07:39:31.172 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:39:31.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:31.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:31.253 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-11T07:39:31.659 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:31.670 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:31.671 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:31.674 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:31.674 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:33.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:39:33.590 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:39:42.097 INFO:teuthology.orchestra.run.smithi144.stdout:generic/003 - output mismatch (see /tmp/tmp.Kh63E6MZ0bxfstests-dev/results//generic/003.out.bad) 2023-05-11T07:39:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: --- tests/generic/003.out 2023-05-11 07:37:31.920486006 +0000 2023-05-11T07:39:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: +++ /tmp/tmp.Kh63E6MZ0bxfstests-dev/results//generic/003.out.bad 2023-05-11 07:39:42.092349441 +0000 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: @@ -1,2 +1,6 @@ 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: QA output created by 003 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: +ERROR: access time has not been updated after accessing file1 first time 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: +ERROR: access time has not been updated after accessing file2 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: +ERROR: access time has not been updated after accessing file3 second time 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: +ERROR: access time has not been updated after accessing file3 third time 2023-05-11T07:39:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: Silence is golden 2023-05-11T07:39:42.107 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/003 2023-05-11T07:39:42.108 INFO:teuthology.orchestra.run.smithi144.stdout:Failures: generic/003 2023-05-11T07:39:42.108 INFO:teuthology.orchestra.run.smithi144.stdout:Failed 1 of 1 tests 2023-05-11T07:39:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:42.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:39:42.132 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T07:39:42.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T07:39:42.133 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-11T07:39:42.545 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:42.556 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:42.557 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:42.559 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:42.559 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:43.059 INFO:teuthology.orchestra.run.smithi144.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-11T07:39:43.067 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/004 2023-05-11T07:39:43.068 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: generic/004 2023-05-11T07:39:43.068 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:39:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:43.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:43.105 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-11T07:39:43.513 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:43.525 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:43.525 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:43.528 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:43.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:44.218 INFO:teuthology.orchestra.run.smithi144.stdout:generic/005 1s 2023-05-11T07:39:44.229 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/005 2023-05-11T07:39:44.229 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:39:44.234 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:39:44.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:44.344 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-11T07:39:44.767 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:39:44.779 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:44.780 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:39:44.782 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:39:44.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:40:03.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:40:03.736 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:40:08.478 INFO:teuthology.orchestra.run.smithi144.stdout:generic/006 24s 2023-05-11T07:40:09.282 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/006 2023-05-11T07:40:09.283 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:40:09.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:40:09.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:40:09.495 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-11T07:40:09.924 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:40:09.935 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:40:09.937 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:40:09.939 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:40:09.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:40:33.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:40:33.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:41:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:generic/007 50s 2023-05-11T07:41:04.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:41:04.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:41:04.594 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/007 2023-05-11T07:41:04.595 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:04.600 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:04.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:04.762 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-11T07:41:05.419 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:05.429 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:05.430 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:05.433 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:05.433 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:06.024 INFO:teuthology.orchestra.run.smithi144.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T07:41:06.034 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/008 2023-05-11T07:41:06.034 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: generic/008 2023-05-11T07:41:06.034 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:06.039 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:06.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:06.090 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-11T07:41:06.504 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:06.514 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:06.515 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:06.517 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:06.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:07.076 INFO:teuthology.orchestra.run.smithi144.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T07:41:07.085 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/009 2023-05-11T07:41:07.085 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: generic/009 2023-05-11T07:41:07.085 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:07.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:07.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:07.141 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-11T07:41:07.541 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:07.552 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:07.553 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:07.555 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:07.556 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:08.009 INFO:teuthology.orchestra.run.smithi144.stdout:generic/010 [not run] /tmp/tmp.Kh63E6MZ0bxfstests-dev/src/dbtest not built 2023-05-11T07:41:08.018 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/010 2023-05-11T07:41:08.018 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: generic/010 2023-05-11T07:41:08.018 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:08.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:08.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:08.059 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-11T07:41:08.460 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:08.471 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:08.472 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:08.474 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:35.518 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:41:35.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:41:40.920 INFO:teuthology.orchestra.run.smithi144.stdout:generic/011 32s 2023-05-11T07:41:40.944 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/011 2023-05-11T07:41:40.944 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:41.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:41.415 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-11T07:41:41.823 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:41.834 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:41.835 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:41.837 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:41.837 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:42.550 INFO:teuthology.orchestra.run.smithi144.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-05-11T07:41:42.559 INFO:teuthology.orchestra.run.smithi144.stdout:Ran: generic/012 2023-05-11T07:41:42.559 INFO:teuthology.orchestra.run.smithi144.stdout:Not run: generic/012 2023-05-11T07:41:42.560 INFO:teuthology.orchestra.run.smithi144.stdout:Passed all 1 tests 2023-05-11T07:41:42.565 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:41:42.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:41:42.645 DEBUG:teuthology.orchestra.run.smithi144:> (cd /tmp/tmp.Kh63E6MZ0bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-11T07:41:43.059 INFO:teuthology.orchestra.run.smithi144.stdout:FSTYP -- ceph 2023-05-11T07:41:43.070 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM -- Linux/x86_64 smithi144 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:41:43.071 INFO:teuthology.orchestra.run.smithi144.stdout:MKFS_OPTIONS -- 172.21.15.144:6789:/scratch 2023-05-11T07:41:43.074 INFO:teuthology.orchestra.run.smithi144.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCLmlxkakRjCxAAQHTYRukg4fjyUHt9o8Anfw== -o context=system_u:object_r:root_t:s0 172.21.15.144:6789:/scratch /tmp/tmp.YcD326Vnm7scratch 2023-05-11T07:41:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-05-11T07:42:05.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:42:05.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:42:36.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:42:36.730 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:43:06.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:43:06.830 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:43:37.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:43:37.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:07.100 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:07.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:37.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:37.310 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:45:07.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:45:07.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:45:37.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:45:37.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:46:07.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:46:07.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:46:37.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:46:37.977 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:47:08.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:47:08.123 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:47:38.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:47:38.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:48:08.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:48:08.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:48:38.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:48:38.721 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:49:08.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:49:08.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:49:39.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:49:39.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:50:09.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:50:09.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:50:39.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:50:39.418 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:51:09.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:51:09.538 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:51:39.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:51:39.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:52:09.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:52:09.949 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:52:40.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:52:40.048 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:53:10.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:53:10.242 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:53:40.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:53:40.441 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:54:10.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:54:10.620 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:54:41.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:54:41.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:11.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:11.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:41.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:41.332 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:56:11.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:56:11.478 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:56:41.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:56:41.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:57:11.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:57:11.946 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:57:42.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:57:42.050 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:58:12.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:58:12.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:58:42.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:58:42.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:59:12.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:59:12.589 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:59:42.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:59:42.743 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:00:12.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:00:12.915 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:00:43.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:00:43.086 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:01:13.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:01:13.425 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:01:43.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:01:43.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:02:13.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:02:13.719 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:02:43.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:02:43.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:14.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:14.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:44.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:44.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:04:14.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:04:14.394 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:04:44.563 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:04:44.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:05:14.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:05:14.685 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:05:44.876 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:05:44.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:06:15.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:06:15.102 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:06:45.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:06:45.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:15.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:15.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:45.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:45.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:15.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:15.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:45.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:45.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:15.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:15.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:46.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:46.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:16.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:16.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:46.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:46.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:16.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:16.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:46.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:46.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:16.971 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:16.975 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:47.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:47.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:17.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:17.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:47.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:47.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:17.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:17.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:47.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:47.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:18.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:18.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:48.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:48.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:18.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:18.567 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:48.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:48.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:18.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:18.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:49.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:49.078 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:19.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:19.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:49.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:49.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:19.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:19.701 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:49.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:49.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:20.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:20.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:50.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:50.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:20.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:20.329 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:50.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:50.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:20.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:20.913 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:51.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:51.050 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:21.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:21.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:51.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:51.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:21.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:21.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:51.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:51.760 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:22.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:22.047 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:52.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:52.168 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:22.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:22.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:52.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:52.464 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:22.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:22.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:52.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:52.961 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:23.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:23.363 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:53.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:53.503 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:23.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:23.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:53.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:53.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:23.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:23.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:54.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:54.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:24.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:24.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:54.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:54.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:24.678 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:24.683 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:54.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:54.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:25.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:25.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:55.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:55.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:25.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:25.376 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:55.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:55.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:25.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:25.726 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:55.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:55.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:26.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:26.215 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:56.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:56.331 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:26.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:26.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:56.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:56.714 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:26.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:26.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:57.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:57.015 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:27.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:27.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:57.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:57.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:27.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:27.562 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:57.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:57.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:41:27.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:41:27.856 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:41:57.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:41:57.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:42:28.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:42:28.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:42:58.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:42:58.287 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:28.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:28.477 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:58.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:58.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:44:28.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:44:28.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:44:58.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:44:58.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:45:29.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:45:29.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:45:59.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:45:59.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:29.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:29.431 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:59.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:59.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:29.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:29.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:59.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:59.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:48:30.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:48:30.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:49:00.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:49:00.204 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:49:30.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:49:30.425 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:50:00.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:50:00.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:50:30.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:50:30.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:00.949 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:00.954 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:31.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:31.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:01.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:01.304 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:31.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:31.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:01.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:01.819 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:31.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:31.948 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:02.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:02.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:32.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:32.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:02.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:02.364 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:32.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:32.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:02.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:02.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:32.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:32.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:02.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:02.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:33.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:33.147 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:58:03.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:58:03.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:58:33.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:58:33.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:59:03.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:59:03.742 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:59:33.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:59:33.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:00:04.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:00:04.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:00:34.241 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:00:34.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:04.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:04.418 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:34.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:34.572 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:04.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:04.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:34.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:34.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:04.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:04.945 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:35.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:35.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:05.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:05.313 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:35.433 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:35.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:05.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:05.831 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:35.929 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:35.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:06.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:06.194 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:36.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:36.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:06.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:06.448 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:36.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:36.635 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:06.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:06.783 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:36.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:36.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:07.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:07.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:37.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:37.210 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:07.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:07.506 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:37.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:37.627 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:07.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:07.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:37.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:37.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:12:08.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:12:08.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:12:38.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:12:38.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:13:08.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:13:08.564 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:13:38.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:13:38.726 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:08.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:08.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:39.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:39.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:09.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:09.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:39.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:39.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:09.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:09.566 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:39.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:39.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:09.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:09.783 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:39.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:39.954 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:10.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:10.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:40.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:40.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:10.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:10.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:40.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:40.697 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:10.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:10.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:40.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:40.983 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:11.174 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:11.179 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:41.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:41.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:22:11.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:22:11.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:22:41.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:22:41.893 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:23:12.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:23:12.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:23:42.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:23:42.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:12.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:12.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:42.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:42.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:12.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:12.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:42.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:42.779 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:12.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:12.992 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:43.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:43.177 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:13.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:13.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:43.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:43.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:13.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:13.572 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:43.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:43.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:13.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:13.874 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:44.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:44.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:14.229 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:14.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:44.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:44.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:14.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:14.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:44.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:44.762 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:15.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:15.074 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:45.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:45.204 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:15.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:15.383 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:45.775 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:45.780 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:34:15.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:34:15.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:34:46.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:34:46.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:35:16.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:35:16.173 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:35:46.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:35:46.299 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:16.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:16.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:46.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:46.586 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:16.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:16.781 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:46.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:46.887 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:17.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:17.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:47.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:47.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:17.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:17.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:47.692 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:47.698 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:17.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:17.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:48.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:48.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:18.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:18.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:48.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:48.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:18.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:18.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:48.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:48.785 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:18.967 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:18.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:49.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:49.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:19.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:19.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:49.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:49.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:19.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:19.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:49.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:49.728 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:46:19.840 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:46:19.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:46:50.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:46:50.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:47:20.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:47:20.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:47:50.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:47:50.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:20.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:20.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:50.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:50.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:20.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:20.892 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:51.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:51.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:21.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:21.160 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:51.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:51.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:51:21.424 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:51:21.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:51:51.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:51:51.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:52:21.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:52:21.786 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:52:51.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:52:51.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:53:22.092 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:53:22.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:53:52.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:53:52.401 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:22.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:22.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:52.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:52.828 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:22.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:22.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:53.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:53.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:23.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:23.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:53.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:53.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:23.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:23.566 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:53.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:53.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:23.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:23.926 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:54.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:54.082 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:24.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:24.209 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:54.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:54.361 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:24.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:24.473 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:54.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:54.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:24.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:24.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:54.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:54.977 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:25.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:25.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:55.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:55.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:25.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:25.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:55.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:55.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:25.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:25.832 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:55.931 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:55.936 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:26.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:26.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:56.192 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:56.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:26.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:26.376 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:56.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:56.513 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:26.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:26.667 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:56.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:56.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:26.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:26.880 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:57.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:57.081 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:27.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:27.268 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:57.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:57.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:27.695 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:27.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:57.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:57.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:27.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:27.987 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:58.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:58.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:12:28.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:12:28.287 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:12:58.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:12:58.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:13:28.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:13:28.880 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:13:58.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:13:58.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:14:29.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:14:29.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:14:59.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:14:59.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:29.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:29.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:59.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:59.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:16:29.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:16:29.841 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:17:00.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:17:00.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:17:30.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:17:30.187 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:18:00.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:18:00.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:18:30.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:18:30.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:00.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:00.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:30.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:30.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:00.876 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:00.882 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:31.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:31.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:21:01.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:21:01.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:21:31.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:21:31.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:22:01.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:22:01.600 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:22:31.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:22:31.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:23:01.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:23:01.843 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:23:31.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:23:31.949 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:24:02.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:24:02.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:24:32.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:24:32.340 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:25:02.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:25:02.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:25:32.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:25:32.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:02.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:02.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:33.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:33.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:03.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:03.148 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:33.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:33.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:03.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:03.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:33.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:03.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:03.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:33.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:33.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:04.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:04.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:34.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:34.271 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:04.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:04.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:34.539 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:34.544 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:04.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:04.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:34.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:34.803 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:05.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:05.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:35.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:35.324 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:05.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:05.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:35.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:35.759 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:05.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:05.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:36.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:36.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:06.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:06.273 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:36.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:36.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:06.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:06.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:36.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:36.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:06.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:06.825 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:37.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:37.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:07.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:07.177 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:37.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:37.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:07.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:07.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:37.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:37.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:07.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:07.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:37.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:37.975 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:08.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:08.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:38.257 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:38.262 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:08.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:08.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:38.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:38.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:08.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:08.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:39.141 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:39.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:09.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:09.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:39.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:39.553 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:09.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:09.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:39.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:39.911 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:10.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:10.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:40.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:40.256 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:10.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:10.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:40.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:40.644 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:10.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:10.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:40.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:40.943 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:11.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:11.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:41.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:41.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:11.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:11.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:41.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:41.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:11.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:11.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:42.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:42.077 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:12.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:12.175 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:42.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:42.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:12.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:12.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:42.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:42.747 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:12.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:12.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:42.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:42.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:13.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:13.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:43.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:43.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:13.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:13.503 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:43.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:43.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:13.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:13.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:43.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:43.899 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:14.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:14.032 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:44.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:44.213 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:00:14.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:00:14.318 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:00:44.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:00:44.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:01:14.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:01:14.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:01:44.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:01:44.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:02:14.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:02:14.915 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:02:45.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:02:45.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:15.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:15.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:45.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:45.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:15.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:15.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:45.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:45.714 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:15.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:15.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:46.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:46.030 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:16.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:16.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:46.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:46.306 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:16.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:16.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:46.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:46.741 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:16.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:16.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:47.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:47.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:17.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:17.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:47.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:47.305 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:17.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:17.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:47.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:47.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:17.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:17.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:47.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:47.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:12:18.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:12:18.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:12:48.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:12:48.186 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:13:18.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:13:18.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:13:48.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:13:48.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:18.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:18.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:48.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:48.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:18.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:18.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:49.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:49.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:19.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:19.200 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:49.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:49.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:19.563 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:19.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:49.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:49.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:19.876 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:19.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:49.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:49.994 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:20.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:20.186 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:50.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:50.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:20.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:20.469 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:50.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:50.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:20.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:20.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:50.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:50.924 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:22:21.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:22:21.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:22:51.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:22:51.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:23:21.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:23:21.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:23:51.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:23:51.711 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:24:21.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:24:21.899 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:24:52.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:24:52.170 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:25:22.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:25:22.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:25:52.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:25:52.468 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:22.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:22.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:52.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:52.803 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:27:22.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:27:22.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:27:53.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:27:53.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:28:23.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:28:23.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:28:53.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:28:53.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:23.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:23.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:53.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:53.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:23.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:23.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:53.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:53.978 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:24.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:24.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:54.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:54.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:24.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:24.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:54.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:54.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:24.624 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:24.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:54.816 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:54.821 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:24.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:25.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:55.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:55.163 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:25.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:25.382 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:55.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:55.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:25.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:25.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:55.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:55.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:25.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:26.002 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:56.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:56.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:26.323 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:26.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:56.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:56.457 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:26.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:26.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:56.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:56.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:27.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:27.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:57.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:57.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:27.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:27.417 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:57.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:57.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:27.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:27.702 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:57.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:57.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:28.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:28.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:58.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:58.177 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:28.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:28.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:58.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:58.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:28.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:28.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:58.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:58.679 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:28.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:28.841 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:59.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:59.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:29.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:29.154 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:59.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:59.305 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:29.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:29.510 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:59.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:59.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:30.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:30.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:00.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:00.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:30.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:30.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:00.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:00.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:30.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:30.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:00.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:00.767 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:30.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:30.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:00.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:01.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:31.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:31.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:01.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:01.377 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:31.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:31.506 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:01.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:01.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:31.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:31.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:01.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:01.921 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:32.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:32.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:02.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:02.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:32.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:32.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:02.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:02.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:32.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:32.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:02.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:02.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:33.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:33.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:03.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:03.269 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:33.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:33.464 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:03.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:03.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:33.740 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:33.745 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:03.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:03.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:34.050 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:34.056 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:04.201 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:04.206 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:34.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:34.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:04.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:04.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:34.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:34.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:04.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:04.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:34.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:34.889 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:05.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:05.253 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:35.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:35.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:05.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:05.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:35.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:35.660 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:05.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:05.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:35.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:35.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:06.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:06.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:36.247 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:36.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:06.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:06.431 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:36.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:36.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:06.952 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:06.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:37.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:37.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:07.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:07.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:37.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:37.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:07.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:07.692 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:37.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:37.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:07.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:07.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:38.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:38.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:08.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:08.318 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:38.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:38.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:08.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:08.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:38.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:38.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:08.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:08.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:39.094 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:39.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:09.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:09.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:39.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:39.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:09.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:09.598 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:39.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:39.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:10.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:10.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:40.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:40.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:10.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:10.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:40.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:40.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:10.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:10.685 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:40.788 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:40.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:10.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:10.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:41.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:41.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:11.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:11.195 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:41.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:41.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:11.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:11.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:41.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:41.743 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:11.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:11.924 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:42.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:42.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:12.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:12.233 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:42.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:42.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:12.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:12.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:42.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:42.671 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:12.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:12.775 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:42.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:42.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:13.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:13.127 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:43.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:43.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:13.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:13.446 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:43.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:43.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:13.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:13.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:43.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:44.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:14.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:14.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:44.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:44.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:14.560 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:14.565 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:44.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:44.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:14.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:14.906 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:45.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:45.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:15.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:15.283 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:45.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:45.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:15.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:15.554 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:45.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:45.726 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:15.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:15.916 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:46.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:46.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:16.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:16.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:46.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:46.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:16.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:16.436 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:46.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:46.580 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:16.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:16.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:46.967 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:46.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:17.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:17.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:47.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:47.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:17.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:17.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:47.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:47.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:17.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:17.856 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:48.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:48.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:18.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:18.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:48.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:48.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:18.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:18.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:48.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:48.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:18.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:19.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:49.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:49.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:19.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:19.259 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:49.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:49.428 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:19.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:19.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:49.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:49.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:19.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:19.982 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:50.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:50.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:20.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:20.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:50.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:50.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:20.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:20.667 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:50.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:50.781 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:20.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:20.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:51.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:51.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:21.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:21.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:51.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:51.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:21.425 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:21.430 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:51.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:51.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:21.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:21.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:51.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:51.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:21.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:21.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:52.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:52.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:22.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:22.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:52.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:52.478 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:22.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:22.590 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:52.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:52.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:22.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:22.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:52.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:52.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:23.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:23.082 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:53.241 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:53.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:23.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:23.407 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:53.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:53.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:23.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:23.633 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:53.750 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:53.755 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:23.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:23.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:54.092 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:54.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:24.272 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:24.277 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:54.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:54.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:24.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:24.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:54.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:54.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:24.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:24.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:54.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:54.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:25.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:25.178 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:55.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:55.292 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:25.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:25.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:55.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:55.617 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:25.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:25.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:55.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:55.951 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:26.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:26.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:56.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:56.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:26.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:26.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:56.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:56.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:26.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:26.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:57.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:57.032 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:27.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:27.237 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:57.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:57.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:27.513 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:27.518 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:57.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:57.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:27.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:27.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:58.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:58.081 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:28.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:28.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:58.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:58.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:28.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:28.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:58.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:58.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:28.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:28.753 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:58.927 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:58.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:29.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:29.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:59.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:59.166 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:29.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:29.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:59.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:59.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:29.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:29.642 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:59.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:59.797 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:29.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:29.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:00.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:00.123 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:30.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:30.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:00.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:00.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:30.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:30.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:00.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:00.983 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:31.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:31.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:01.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:01.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:31.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:31.425 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:01.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:01.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:31.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:31.713 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:01.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:01.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:31.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:32.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:02.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:02.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:32.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:32.303 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:02.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:02.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:32.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:32.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:02.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:02.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:32.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:32.758 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:02.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:02.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:32.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:32.975 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:03.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:03.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:33.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:33.273 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:03.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:03.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:33.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:33.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:03.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:03.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:33.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:33.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:04.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:04.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:34.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:34.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:04.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:04.473 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:34.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:34.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:04.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:04.780 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:34.952 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:34.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:05.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:05.153 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:35.310 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:35.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:05.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:05.486 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:35.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:35.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:05.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:05.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:35.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:35.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:06.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:06.110 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:36.247 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:36.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:06.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:06.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:36.563 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:36.603 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:06.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:06.786 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:36.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:36.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:07.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:07.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:37.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:37.333 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:07.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:07.503 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:37.694 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:37.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:07.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:07.887 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:38.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:38.050 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:08.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:08.172 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:38.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:38.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:08.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:08.539 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:38.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:38.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:08.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:08.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:39.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:39.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:09.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:09.199 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:39.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:39.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:09.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:09.552 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:39.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:39.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:09.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:09.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:40.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:40.027 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:10.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:10.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:40.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:40.284 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:10.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:10.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:40.518 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:40.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:10.630 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:10.635 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:40.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:40.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:10.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:10.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:41.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:41.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:11.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:11.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:41.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:41.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:11.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:11.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:41.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:41.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:11.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:11.630 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:41.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:41.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:11.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:11.948 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:42.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:42.056 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:12.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:12.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:42.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:42.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:12.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:12.565 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:42.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:42.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:12.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:12.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:43.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:43.051 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:13.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:13.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:43.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:43.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:13.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:13.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:43.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:43.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:13.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:13.725 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:43.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:43.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:14.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:14.036 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:44.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:44.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:14.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:14.428 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:44.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:44.592 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:14.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:14.769 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:44.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:44.933 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:15.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:15.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:45.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:45.324 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:15.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:15.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:45.560 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:45.565 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:15.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:15.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:45.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:45.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:15.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:16.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:46.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:46.125 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:16.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:16.329 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:46.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:46.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:16.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:16.621 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:46.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:46.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:16.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:16.988 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:47.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:47.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:17.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:17.298 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:47.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:47.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:17.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:17.664 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:47.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:47.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:17.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:17.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:48.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:48.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:18.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:18.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:48.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:48.519 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:18.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:18.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:48.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:48.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:19.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:19.040 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:49.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:49.229 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:19.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:19.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:49.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:49.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:19.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:19.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:49.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:49.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:19.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:19.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:50.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:50.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:20.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:20.377 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:50.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:50.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:20.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:20.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:50.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:50.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:21.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:21.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:51.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:51.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:21.320 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:21.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:51.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:51.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:21.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:21.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:51.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:51.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:21.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:21.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:52.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:52.035 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:22.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:22.213 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:52.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:52.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:22.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:22.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:52.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:52.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:22.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:22.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:53.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:53.010 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:23.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:23.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:53.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:53.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:23.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:23.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:53.649 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:53.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:23.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:23.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:53.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:53.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:24.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:24.109 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:54.258 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:54.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:24.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:24.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:54.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:54.563 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:24.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:24.761 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:54.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:54.898 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:25.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:25.077 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:55.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:55.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:25.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:25.361 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:55.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:55.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:25.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:25.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:55.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:55.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:26.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:26.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:56.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:56.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:26.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:26.307 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:56.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:56.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:26.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:26.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:56.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:56.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:27.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:27.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:57.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:57.128 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:27.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:27.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:57.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:57.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:27.537 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:27.542 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:57.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:57.729 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:27.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:27.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:58.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:58.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:28.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:28.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:58.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:58.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:28.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:28.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:58.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:58.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:28.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:28.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:58.952 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:58.957 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:29.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:29.127 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:59.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:59.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:29.343 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:29.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:59.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:59.453 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:29.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:29.561 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:59.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:59.667 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:29.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:29.780 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:59.879 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:59.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:30.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:30.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:00.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:00.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:30.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:30.222 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:00.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:00.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:30.433 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:30.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:00.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:00.554 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:30.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:30.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:00.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:00.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:30.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:30.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:01.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:01.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:31.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:31.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:01.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:01.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:31.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:31.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:01.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:01.632 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:31.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:31.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:01.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:01.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:32.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:32.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:02.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:02.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:32.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:32.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:02.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:02.478 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:32.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:32.674 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:02.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:02.863 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:33.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:33.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:03.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:03.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:33.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:33.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:03.510 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:03.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:33.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:33.704 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:03.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:03.892 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:34.083 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:34.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:04.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:04.202 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:34.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:34.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:04.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:04.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:34.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:34.688 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:04.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:04.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:35.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:35.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:05.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:05.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:35.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:35.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:05.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:05.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:35.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:35.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:05.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:05.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:35.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:35.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:06.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:06.186 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:36.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:36.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:06.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:06.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:36.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:36.843 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:07.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:07.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:37.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:37.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:07.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:07.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:37.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:37.555 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:07.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:07.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:37.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:37.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:07.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:07.951 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:38.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:38.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:08.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:08.343 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:38.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:38.450 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:08.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:08.627 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:38.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:38.814 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:08.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:08.953 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:39.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:39.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:09.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:09.215 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:39.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:39.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:09.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:09.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:39.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:39.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:09.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:09.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:40.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:40.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:10.240 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:10.245 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:40.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:40.408 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:10.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:10.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:40.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:40.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:10.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:10.797 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:40.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:40.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:11.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:11.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:41.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:41.110 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:11.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:11.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:41.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:41.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:11.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:11.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:41.519 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:41.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:11.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:11.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:41.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:41.742 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:11.841 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:11.846 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:41.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:41.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:12.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:12.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:42.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:42.177 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:12.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:12.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:42.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:42.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:12.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:12.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:42.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:42.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:12.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:12.724 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:42.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:42.828 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:12.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:12.948 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:43.047 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:43.053 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:13.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:13.166 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:43.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:43.272 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:13.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:13.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:43.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:43.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:13.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:13.608 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:43.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:43.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:13.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:13.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:44.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:44.040 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:14.244 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:14.249 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:44.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:44.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:14.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:14.521 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:44.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:44.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:14.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:14.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:45.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:45.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:15.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:15.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:45.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:45.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:15.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:15.343 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:45.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:45.448 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:15.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:15.562 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:45.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:45.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:15.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:15.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:45.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:45.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:16.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:16.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:46.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:46.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:16.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:16.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:46.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:46.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:16.852 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:16.857 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:47.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:47.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:17.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:17.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:47.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:47.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:17.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:17.467 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:47.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:47.656 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:17.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:17.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:47.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:47.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:18.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:18.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:48.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:48.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:18.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:18.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:48.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:48.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:18.685 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:18.690 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:48.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:48.861 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:19.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:19.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:49.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:49.157 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:19.262 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:19.267 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:49.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:49.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:19.539 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:19.543 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:49.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:49.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:19.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:19.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:50.094 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:50.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:20.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:20.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:50.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:50.407 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:20.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:20.521 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:50.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:50.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:20.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:20.729 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:50.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:50.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:20.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:20.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:51.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:51.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:21.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:21.163 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:51.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:51.270 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:21.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:21.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:51.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:51.467 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:21.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:21.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:51.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:51.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:21.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:21.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:51.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:51.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:21.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:21.997 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:52.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:52.119 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:22.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:22.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:52.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:52.345 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:22.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:22.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:52.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:52.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:22.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:22.725 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:52.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:52.920 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:23.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:23.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:53.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:53.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:23.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:23.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:53.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:53.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:23.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:23.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:53.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:53.814 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:23.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:23.993 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:54.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:54.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:24.455 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:24.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:54.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:54.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:24.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:24.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:54.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:54.874 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:25.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:25.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:55.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:55.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:25.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:25.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:55.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:55.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:25.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:25.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:55.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:55.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:25.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:25.911 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:56.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:56.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:26.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:26.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:56.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:56.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:26.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:26.587 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:56.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:56.759 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:26.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:26.869 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:57.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:57.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:27.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:27.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:57.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:57.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:27.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:27.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:57.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:57.634 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:27.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:27.730 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:57.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:57.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:28.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:28.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:58.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:58.269 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:28.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:28.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:58.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:58.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:28.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:28.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:58.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:58.905 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:29.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:29.086 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:59.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:59.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:29.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:29.461 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:59.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:59.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:29.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:29.921 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:00.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:00.017 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:30.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:30.189 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:00.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:00.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:30.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:30.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:00.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:00.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:30.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:30.841 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:01.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:01.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:31.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:31.250 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:01.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:01.366 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:31.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:31.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:01.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:01.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:31.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:31.814 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:01.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:01.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:32.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:32.078 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:02.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:02.231 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:32.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:32.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:02.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:02.620 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:32.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:32.757 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:02.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:02.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:33.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:33.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:03.307 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:03.313 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:33.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:33.510 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:03.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:03.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:33.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:33.843 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:03.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:03.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:34.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:34.119 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:04.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:04.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:34.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:34.409 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:04.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:04.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:34.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:34.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:04.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:04.893 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:35.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:35.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:05.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:05.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:35.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:35.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:05.533 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:05.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:35.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:35.744 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:05.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:05.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:36.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:36.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:06.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:06.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:36.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:36.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:06.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:06.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:36.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:36.689 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:06.806 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:06.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:36.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:36.982 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:07.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:07.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:37.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:37.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:07.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:07.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:37.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:37.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:07.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:07.757 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:37.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:37.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:08.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:08.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:38.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:38.207 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:08.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:08.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:38.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:38.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:08.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:08.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:38.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:38.734 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:08.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:08.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:39.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:39.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:09.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:09.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:39.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:39.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:09.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:09.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:39.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:39.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:09.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:09.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:39.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:39.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:10.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:10.061 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:40.244 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:40.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:10.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:10.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:40.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:40.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:10.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:10.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:40.829 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:40.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:10.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:10.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:41.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:41.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:11.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:11.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:41.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:41.353 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:11.503 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:11.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:41.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:41.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:11.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:11.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:41.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:41.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:12.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:12.170 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:42.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:42.358 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:12.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:12.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:42.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:42.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:12.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:12.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:42.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:43.001 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:13.134 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:13.139 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:43.306 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:43.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:13.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:13.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:43.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:43.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:13.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:13.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:44.049 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:44.054 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:14.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:14.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:44.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:44.446 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:14.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:14.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:44.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:44.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:15.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:15.033 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:45.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:45.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:15.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:15.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:45.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:45.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:15.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:15.668 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:45.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:45.805 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:15.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:16.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:46.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:46.140 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:16.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:16.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:46.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:46.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:16.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:16.609 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:46.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:46.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:16.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:16.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:47.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:47.149 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:17.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:17.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:47.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:47.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:17.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:17.563 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:47.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:47.660 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:17.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:17.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:47.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:47.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:17.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:17.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:48.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:48.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:18.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:18.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:48.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:48.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:18.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:18.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:48.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:48.744 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:18.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:18.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:48.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:48.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:19.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:19.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:49.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:49.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:19.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:19.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:49.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:49.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:19.768 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:19.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:49.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:49.896 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:20.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:20.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:50.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:50.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:20.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:20.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:50.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:50.664 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:20.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:20.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:50.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:50.956 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:21.048 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:21.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:51.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:51.161 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:21.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:21.345 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:51.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:51.516 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:21.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:21.639 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:51.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:51.811 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:21.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:21.966 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:52.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:52.119 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:22.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:22.284 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:52.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:52.437 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:22.537 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:22.542 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:52.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:52.730 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:22.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:22.915 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:53.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:53.048 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:23.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:23.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:53.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:53.408 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:23.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:23.587 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:53.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:53.759 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:23.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:23.930 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:54.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:54.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:24.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:24.225 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:54.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:54.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:24.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:24.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:54.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:54.712 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:24.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:24.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:54.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:55.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:25.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:25.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:55.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:55.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:25.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:25.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:55.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:55.671 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:25.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:25.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:55.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:55.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:26.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:26.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:56.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:56.237 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:26.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:26.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:56.591 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:56.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:26.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:26.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:56.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:56.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:27.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:27.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:57.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:57.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:27.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:27.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:57.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:57.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:27.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:27.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:58.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:58.118 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:28.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:28.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:58.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:58.443 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:28.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:28.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:58.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:58.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:28.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:28.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:58.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:58.961 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:29.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:29.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:59.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:59.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:29.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:29.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:59.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:59.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:29.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:29.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:59.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:59.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:30.059 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:30.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:00.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:00.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:30.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:30.364 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:00.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:00.485 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:30.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:30.671 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:00.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:00.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:30.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:30.954 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:01.047 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:01.053 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:31.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:31.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:01.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:01.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:31.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:31.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:01.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:01.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:31.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:31.833 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:01.971 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:01.976 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:32.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:32.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:02.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:02.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:32.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:32.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:02.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:02.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:32.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:32.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:03.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:03.018 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:33.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:33.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:03.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:03.345 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:33.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:33.546 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:03.747 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:03.752 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:33.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:33.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:04.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:04.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:34.297 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:34.302 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:04.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:04.478 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:34.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:34.659 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:04.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:04.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:34.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:34.943 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:05.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:05.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:35.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:35.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:05.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:05.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:35.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:35.428 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:05.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:05.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:35.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:35.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:38:05.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:38:05.765 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:38:35.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:38:35.861 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:39:05.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:39:05.983 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:39:36.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:39:36.084 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:40:06.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:40:06.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:40:36.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:40:36.293 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:41:06.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:41:06.406 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:41:36.514 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:41:36.519 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:42:06.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:42:06.659 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:42:36.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:42:36.831 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:43:07.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:43:07.017 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:43:37.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:43:37.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:44:07.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:44:07.303 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:44:37.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:44:37.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:45:07.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:45:07.651 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:45:37.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:45:37.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:46:07.980 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:46:07.988 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:46:38.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:46:38.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:47:08.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:47:08.335 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:47:38.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:47:38.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:48:08.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:48:08.627 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:48:38.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:48:38.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:49:08.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:49:08.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:49:39.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:49:39.097 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:50:09.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:50:09.285 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:50:39.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:50:39.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:51:09.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:51:09.561 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:51:39.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:51:39.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:52:09.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:52:09.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:52:40.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:52:40.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:53:10.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:53:10.135 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:53:40.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:53:40.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:54:10.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:54:10.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:54:40.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:54:40.651 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:55:10.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:55:10.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:55:40.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:55:40.945 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:56:11.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:56:11.115 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:56:41.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:56:41.236 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:57:11.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:57:11.431 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:57:41.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:57:41.553 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:58:11.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:58:11.738 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:58:41.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:58:41.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:59:12.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:59:12.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:59:42.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:59:42.180 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:00:12.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:00:12.286 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:00:42.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:00:42.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:01:12.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:01:12.651 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:01:42.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:01:42.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:02:12.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:02:12.920 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:02:43.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:02:43.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:03:13.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:03:13.272 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:03:43.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:03:43.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:04:13.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:04:13.580 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:04:43.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:04:43.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:05:13.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:05:13.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:05:43.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:05:43.959 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:06:14.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:06:14.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:06:44.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:06:44.208 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:07:14.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:07:14.313 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:07:44.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:07:44.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:08:14.537 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:08:14.542 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:08:44.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:08:44.638 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:09:14.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:09:14.777 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:09:44.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:09:44.890 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:10:14.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:10:14.988 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:10:45.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:10:45.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:11:15.241 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:11:15.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:11:45.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:11:45.418 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:12:15.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:12:15.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:12:45.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:12:45.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:13:15.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:13:15.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:13:45.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:13:46.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:14:16.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:14:16.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:14:46.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:14:46.228 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:15:16.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:15:16.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:15:46.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:15:46.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:16:16.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:16:16.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:16:46.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:16:46.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:17:16.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:17:16.742 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:17:46.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:17:46.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:18:16.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:18:16.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T19:18:42.587 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-11T19:18:42.588 DEBUG:teuthology.task.console_log:Killing console logger for smithi144 2023-05-11T19:18:42.588 DEBUG:teuthology.task.console_log:Killing console logger for smithi145 2023-05-11T19:18:42.589 DEBUG:teuthology.exit:Finished running handlers